Aug 28 09:25:29 devstack cinder-volume[75141]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 28 09:25:29 devstack cinder-volume[75141]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 28 09:25:29 devstack cinder-volume[75141]: we strongly recommend against using it for new projects. Aug 28 09:25:29 devstack cinder-volume[75141]: If you are already using Eventlet, we recommend migrating to a different Aug 28 09:25:29 devstack cinder-volume[75141]: framework. For more detail see Aug 28 09:25:29 devstack cinder-volume[75141]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 28 09:25:29 devstack cinder-volume[75141]: import eventlet # noqa Aug 28 09:25:32 devstack cinder-volume[75141]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75141) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 28 09:25:32 devstack cinder-volume[75141]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75141) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 28 09:25:32 devstack cinder-volume[75141]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75141) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 28 09:25:33 devstack cinder-volume[75141]: INFO dbcounter [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] Registered counter for database cinder Aug 28 09:25:33 devstack cinder-volume[75141]: DEBUG oslo_db.sqlalchemy.engines [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75141) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 28 09:25:33 devstack cinder-volume[75141]: DEBUG dbcounter [-] [75141] Writer thread running {{(pid=75141) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 28 09:25:33 devstack cinder-volume[75141]: INFO cinder.rpc [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 28 09:25:33 devstack cinder-volume[75141]: INFO cinder.rpc [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 28 09:25:33 devstack cinder-volume[75141]: DEBUG oslo_db.sqlalchemy.engines [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75141) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 28 09:25:33 devstack cinder-volume[75141]: INFO cinder.volume.manager [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] Determined volume DB was empty at startup. Aug 28 09:25:33 devstack cinder-volume[75141]: DEBUG cinder.volume.manager [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75141) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 28 09:25:33 devstack cinder-volume[75141]: INFO cinder.volume.manager [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 28 09:25:33 devstack cinder-volume[75141]: WARNING stevedore.named [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 28 09:25:33 devstack cinder-volume[75141]: WARNING castellan.key_manager [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 28 09:25:33 devstack cinder-volume[75141]: WARNING cinder.keymgr.conf_key_mgr [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 28 09:25:33 devstack cinder-volume[75141]: DEBUG cinder.volume.drivers.lvm [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75141) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Aug 28 09:25:33 devstack cinder-volume[75141]: DEBUG oslo_concurrency.processutils [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75141) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_concurrency.processutils [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] CMD "cinder-rtstool verify" returned: 0 in 0.443s {{(pid=75141) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_db.sqlalchemy.engines [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75141) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 28 09:25:34 devstack cinder-volume[75141]: INFO cinder.rpc [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Aug 28 09:25:34 devstack cinder-volume[75141]: INFO cinder.rpc [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Aug 28 09:25:34 devstack cinder-volume[75141]: WARNING stevedore.named [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 28 09:25:34 devstack cinder-volume[75141]: WARNING castellan.key_manager [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 28 09:25:34 devstack cinder-volume[75141]: INFO cinder.volume.manager [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_db.sqlalchemy.engines [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75141) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 28 09:25:34 devstack cinder-volume[75141]: INFO oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] Starting 1 workers Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] Started child 75292 {{(pid=75141) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] Full set of CONF: {{(pid=75141) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] ******************************************************************************** {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] Configuration options gathered from: {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] ================================================================================ {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] allow_availability_zone_fallback = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] allow_compression_on_image_upload = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] allowed_direct_url_schemes = [] {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] api_rate_limit = True {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] auth_strategy = keystone {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] az_cache_duration = 3600 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_availability_zone = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_host = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_name = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_stats_polling_interval = 60 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75292]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backup_api_class = cinder.backup.api.API {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backup_name_template = backup-%s {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backup_use_same_host = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backup_use_temp_snapshot = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] chap_password = **** {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] chap_username = {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] cinder_internal_tenant_project_id = c5eb5a397c9d460c8a7fc935b90f9d0c {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] cinder_internal_tenant_user_id = 9922b57450e24f12933757730d53ed5a {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] cloned_volume_same_az = True {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] cluster = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] compression_format = gzip {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] compute_api_class = cinder.compute.nova.API {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] config_dir = [] {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] config_source = [] {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] control_exchange = openstack {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] debug = True {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] default_availability_zone = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] default_group_type = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] default_volume_type = lvmdriver-1 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] disk_geometry = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] driver_client_cert = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] driver_client_cert_key = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] driver_data_namespace = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] driver_ssl_cert_path = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] driver_ssl_cert_verify = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] driver_use_ssl = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] enable_force_upload = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] enable_new_services = True {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] enable_unsupported_driver = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] enforce_multipath_for_image_xfer = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] filter_function = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] glance_api_insecure = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] glance_api_servers = ['http://192.168.122.31/image'] {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] glance_api_ssl_compression = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] glance_ca_certificates_file = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] glance_catalog_info = image:glance:publicURL {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] glance_certfile = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] glance_keyfile = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] glance_num_retries = 3 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] glance_request_timeout = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] goodness_function = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] graceful_shutdown_timeout = 5 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] group_api_class = cinder.group.api.API {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] host = devstack {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] image_compress_on_upload = True {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] image_conversion_address_space_limit = 1 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] image_conversion_cpu_limit = 60 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] image_conversion_disable = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] image_upload_use_cinder_backend = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] image_upload_use_internal_tenant = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] image_volume_cache_enabled = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] image_volume_cache_max_count = 0 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] image_volume_cache_max_size_gb = 0 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] init_host_max_objects_retrieval = 0 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] instance_format = [instance: %(uuid)s] {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] iscsi_target_flags = {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] iscsi_write_cache = on {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] iser_helper = tgtadm {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] iser_ip_address = 192.168.122.31 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] iser_port = 3260 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75292]: INFO cinder.volume.manager [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] Starting volume driver LVMVolumeDriver (3.0.0) Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] log_color = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] log_config_append = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] log_dir = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] log_file = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] log_options = True {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] log_rotate_interval = 1 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] log_rotate_interval_type = days {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] log_rotation_type = none {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] max_age = 0 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] max_logfile_count = 30 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] max_logfile_size_mb = 200 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] max_over_subscription_ratio = 20.0 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] message_reap_interval = 86400 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] message_ttl = 2592000 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] migration_create_volume_timeout_secs = 300 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] monkey_patch = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] monkey_patch_modules = [] {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] my_ip = 192.168.122.31 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] no_snapshot_gb_quota = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] num_iser_scan_tries = 3 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] num_shell_tries = 3 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] num_volume_device_scan_tries = 3 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] nvmeof_conn_info_version = 1 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] nvmet_ns_id = 10 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] nvmet_port_id = 1 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] osapi_max_limit = 1000 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] osapi_volume_ext_list = [] {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] osapi_volume_listen_port = 8776 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] osapi_volume_use_ssl = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] osapi_volume_workers = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] per_volume_size_limit = -1 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] periodic_fuzzy_delay = 60 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] periodic_interval = 60 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] public_endpoint = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] publish_errors = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] quota_backup_gigabytes = 1000 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] quota_backups = 10 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] quota_gigabytes = 1000 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] quota_groups = 10 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] quota_snapshots = 10 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] quota_volumes = 10 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] rate_limit_burst = 0 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.046s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] rate_limit_except_level = CRITICAL {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] rate_limit_interval = 0 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] reinit_driver_count = 3 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] replication_device = **** {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] report_discard_supported = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] report_interval = 120 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] reservation_clean_interval = 86400 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] reservation_expire = 86400 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] reserved_image_namespaces = [] {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] reserved_percentage = 0 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] rpc_response_timeout = 120 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] run_external_periodic_tasks = True {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] scst_target_driver = iscsi {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] scst_target_iqn_name = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] service_down_time = 720 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] shell_completion = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] snapshot_name_template = snapshot-%s {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] snapshot_same_host = True {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] split_loggers = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] state_path = /opt/stack/data/cinder {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] storage_availability_zone = nova {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] storage_protocol = iSCSI {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] syslog_log_facility = LOG_USER {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] target_helper = lioadm {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] target_ip_address = 192.168.122.31 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] target_port = 3260 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] target_protocol = iscsi {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] target_secondary_ip_addresses = [] {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] trace_flags = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] transport_url = **** {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] until_refresh = 0 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] use_chap_auth = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] use_default_quota_class = True {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] use_journal = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] use_json = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] use_multipath_for_image_xfer = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] use_stderr = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] use_syslog = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] verify_glance_signatures = enabled {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] volume_api_class = cinder.volume.api.API {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] volume_backend_name = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] volume_clear = zero {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] volume_clear_ionice = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] volume_clear_size = 0 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] volume_copy_bps_limit = 0 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] volume_dd_blocksize = 1M {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] volume_name_template = volume-%s {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] volume_service_inithost_offload = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] volume_usage_audit_period = month {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] zoning_mode = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_concurrency.disable_process_locking = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:25:34 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] keystone_authtoken.auth_section = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] keystone_authtoken.auth_type = password {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] keystone_authtoken.auth_version = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] keystone_authtoken.cache = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] keystone_authtoken.certfile = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] keystone_authtoken.include_service_catalog = True {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] keystone_authtoken.insecure = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] keystone_authtoken.interface = public {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] keystone_authtoken.keyfile = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] keystone_authtoken.memcache_password = **** {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] keystone_authtoken.memcache_username = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] keystone_authtoken.region_name = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] keystone_authtoken.service_type = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.31/identity {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] cache.backend = dogpile.cache.null {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] cache.backend_argument = **** {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] cache.backend_expiration_time = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] cache.config_prefix = cache.oslo {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] cache.debug_cache_backend = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] cache.enable_retry_client = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] cache.enable_socket_keepalive = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] cache.enabled = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] cache.expiration_time = 600 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] cache.hashclient_retry_attempts = 2 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] cache.memcache_dead_retry = 300 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] cache.memcache_pool_maxsize = 10 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] cache.memcache_sasl_enabled = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] cache.password = **** {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] cache.proxies = [] {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] cache.redis_db = 0 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] cache.redis_server = localhost:6379 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] cache.retry_attempts = 2 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] cache.retry_delay = 0.0 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] cache.socket_keepalive_count = 1 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] cache.socket_keepalive_idle = 1 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] cache.socket_keepalive_interval = 1 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] cache.socket_timeout = 1.0 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] cache.tls_allowed_ciphers = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] cache.tls_cafile = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] cache.tls_certfile = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] cache.tls_enabled = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] cache.tls_keyfile = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] cache.username = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] coordination.backend_url = **** {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] database.asyncio_connection = **** {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] database.asyncio_slave_connection = **** {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] database.backend = sqlalchemy {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] database.connection = **** {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] database.connection_debug = 0 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] database.connection_parameters = {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] database.connection_recycle_time = 3600 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] database.connection_trace = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] database.db_inc_retry_interval = True {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] database.db_max_retries = 20 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] database.db_max_retry_interval = 10 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] database.db_retry_interval = 1 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] database.max_overflow = 50 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] database.max_pool_size = 5 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] database.max_retries = 10 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] database.mysql_wsrep_sync_wait = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] database.pool_timeout = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] database.retry_interval = 10 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] database.slave_connection = **** {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] database.sqlite_synchronous = True {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] database.synchronous_reader = True {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] database.use_db_reconnect = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_messaging_tracing.insecure = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] profiler.connection_string = messaging:// {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] profiler.enabled = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] profiler.es_doc_type = notification {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] profiler.es_scroll_size = 10000 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] profiler.es_scroll_time = 2m {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] profiler.filter_error_trace = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] profiler.hmac_keys = **** {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] profiler.sentinel_service_name = mymaster {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] profiler.socket_timeout = 0.1 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] profiler.trace_requests = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] profiler.trace_sqlalchemy = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] profiler_jaeger.process_tags = {} {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] profiler_jaeger.service_name_prefix = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] profiler_otlp.service_name_prefix = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_policy.enforce_new_defaults = True {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_policy.policy_default_rule = default {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_policy.policy_file = policy.yaml {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack sudo[75299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] privsep_osbrick.group = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] privsep_osbrick.helper_command = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack sudo[75299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] privsep_osbrick.user = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] cinder_sys_admin.group = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] cinder_sys_admin.helper_command = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] cinder_sys_admin.user = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] service_user.auth_section = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] service_user.auth_type = password {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] service_user.cafile = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] service_user.certfile = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] service_user.collect_timing = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] service_user.insecure = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] service_user.keyfile = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] service_user.send_service_user_token = True {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] service_user.split_loggers = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] service_user.timeout = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] glance.auth_section = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] glance.auth_type = password {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] glance.certfile = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] glance.collect_timing = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] glance.insecure = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] glance.keyfile = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] glance.region_name = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] glance.split_loggers = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] glance.timeout = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.backend_availability_zone = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.chap_password = **** {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.chap_username = {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.disk_geometry = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.driver_client_cert = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.driver_client_cert_key = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.driver_data_namespace = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.driver_use_ssl = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.extra_capabilities = {} {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.filter_function = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.goodness_function = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.iscsi_target_flags = {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.iscsi_write_cache = on {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.iser_helper = tgtadm {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.iser_ip_address = 192.168.122.31 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.iser_port = 3260 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.lvm_share_target = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.lvm_type = auto {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.num_shell_tries = 3 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.replication_device = **** {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.report_discard_supported = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.reserved_percentage = 0 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.target_helper = tgtadm {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.target_ip_address = 192.168.122.31 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.target_port = 3260 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.target_protocol = iscsi {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.trace_flags = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.unique_fqdn_network = True {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.use_chap_auth = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.volume_backend_name = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.volume_clear = zero {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.volume_clear_ionice = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.volume_clear_size = 0 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_reports.file_event_handler = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_reports.log_dir = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.backend_host = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.chap_password = **** {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.chap_username = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.disk_geometry = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.driver_client_cert = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.extra_capabilities = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.filter_function = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.goodness_function = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.iser_helper = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.iser_ip_address = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.iser_port = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.lvm_share_target = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.lvm_type = auto {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.num_shell_tries = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.replication_device = **** {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.report_discard_supported = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.reserved_percentage = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.scst_target_driver = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.storage_protocol = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.target_helper = lioadm {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.target_ip_address = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.target_port = 3260 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.trace_flags = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.use_chap_auth = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.volume_clear = zero {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.volume_clear_size = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] lvmdriver-1.volumes_dir = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_messaging_rabbit.ssl = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_messaging_notifications.driver = [] {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_messaging_notifications.retry = -1 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] key_manager.fixed_key = **** {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] barbican.barbican_api_version = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] barbican.barbican_endpoint = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] barbican.barbican_endpoint_type = public {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] barbican.barbican_region_name = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] barbican.cafile = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] barbican.certfile = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] barbican.collect_timing = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] barbican.insecure = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] barbican.keyfile = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] barbican.number_of_retries = 60 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] barbican.retry_delay = 1 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] barbican.send_service_user_token = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] barbican.split_loggers = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] barbican.timeout = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] barbican.verify_ssl = True {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] barbican.verify_ssl_path = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] barbican_service_user.auth_section = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] barbican_service_user.auth_type = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] barbican_service_user.cafile = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] barbican_service_user.certfile = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] barbican_service_user.collect_timing = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] barbican_service_user.insecure = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] barbican_service_user.keyfile = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] barbican_service_user.split_loggers = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] barbican_service_user.timeout = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] vault.approle_role_id = **** {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] vault.approle_secret_id = **** {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] vault.auth_method = approle {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] vault.auth_path = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] vault.kv_mountpoint = secret {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] vault.kv_path = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] vault.kv_version = 2 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] vault.namespace = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:34 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] vault.root_token_id = **** {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:35 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] vault.ssl_ca_crt_file = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:35 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] vault.timeout = 60.0 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:35 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] vault.token_file = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:35 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] vault.token_role = None {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:35 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] vault.use_ssl = False {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:35 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:25:35 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] ******************************************************************************** {{(pid=75141) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 28 09:25:35 devstack sudo[75299]: pam_unix(sudo:session): session closed for user root Aug 28 09:25:35 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.376s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:25:35 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:25:35 devstack sudo[75321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 28 09:25:35 devstack sudo[75321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:25:35 devstack sudo[75321]: pam_unix(sudo:session): session closed for user root Aug 28 09:25:35 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.341s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:25:35 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 09:25:35 devstack cinder-volume[75292]: INFO cinder.brick.local_dev.lvm [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Aug 28 09:25:35 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:25:35 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:25:35 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:25:35 devstack sudo[75454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 28 09:25:35 devstack sudo[75454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:25:35 devstack sudo[75454]: pam_unix(sudo:session): session closed for user root Aug 28 09:25:35 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:25:35 devstack cinder-volume[75292]: DEBUG cinder.brick.local_dev.lvm [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75292) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Aug 28 09:25:35 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:25:35 devstack sudo[75547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 28 09:25:35 devstack sudo[75547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:25:36 devstack sudo[75547]: pam_unix(sudo:session): session closed for user root Aug 28 09:25:36 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.520s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:25:36 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:25:36 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:25:36 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:25:36 devstack sudo[75733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 28 09:25:36 devstack sudo[75733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:25:36 devstack sudo[75733]: pam_unix(sudo:session): session closed for user root Aug 28 09:25:36 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:25:36 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:25:36 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:25:36 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:25:36 devstack sudo[75825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Aug 28 09:25:36 devstack sudo[75825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:25:36 devstack sudo[75825]: pam_unix(sudo:session): session closed for user root Aug 28 09:25:36 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.311s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:25:36 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:25:36 devstack sudo[75908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 28 09:25:36 devstack sudo[75908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:25:37 devstack sudo[75908]: pam_unix(sudo:session): session closed for user root Aug 28 09:25:37 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:25:37 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:25:37 devstack sudo[75911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 28 09:25:37 devstack sudo[75911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:25:37 devstack sudo[75911]: pam_unix(sudo:session): session closed for user root Aug 28 09:25:37 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.349s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:25:37 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:25:37 devstack sudo[75994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 28 09:25:37 devstack sudo[75994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:25:37 devstack sudo[75994]: pam_unix(sudo:session): session closed for user root Aug 28 09:25:37 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:25:37 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:25:37 devstack sudo[76000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 28 09:25:37 devstack sudo[76000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:25:38 devstack sudo[76000]: pam_unix(sudo:session): session closed for user root Aug 28 09:25:38 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.296s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:25:38 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:25:38 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:25:38 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:25:38 devstack sudo[76074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 28 09:25:38 devstack sudo[76074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:25:38 devstack sudo[76074]: pam_unix(sudo:session): session closed for user root Aug 28 09:25:38 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.285s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:25:38 devstack cinder-volume[75292]: INFO cinder.volume.drivers.lvm [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] Enabling LVM thin provisioning by default because a thin pool exists. Aug 28 09:25:38 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:25:38 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:25:38 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:25:38 devstack sudo[76098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 28 09:25:38 devstack sudo[76098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:25:38 devstack sudo[76098]: pam_unix(sudo:session): session closed for user root Aug 28 09:25:38 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.287s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:25:38 devstack cinder-volume[75292]: DEBUG cinder.volume.drivers.lvm [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] Updating volume stats {{(pid=75292) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 28 09:25:38 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:25:38 devstack sudo[76102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 28 09:25:38 devstack sudo[76102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:25:39 devstack sudo[76102]: pam_unix(sudo:session): session closed for user root Aug 28 09:25:39 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:25:39 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:25:39 devstack sudo[76105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 28 09:25:39 devstack sudo[76105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:25:39 devstack sudo[76105]: pam_unix(sudo:session): session closed for user root Aug 28 09:25:39 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:25:39 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:25:39 devstack sudo[76108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 28 09:25:39 devstack sudo[76108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:25:39 devstack sudo[76108]: pam_unix(sudo:session): session closed for user root Aug 28 09:25:39 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:25:39 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:25:39 devstack sudo[76111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 28 09:25:39 devstack sudo[76111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:25:39 devstack sudo[76111]: pam_unix(sudo:session): session closed for user root Aug 28 09:25:39 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:25:39 devstack cinder-volume[75292]: INFO cinder.volume.driver [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] Driver hasn't implemented _init_vendor_properties() Aug 28 09:25:39 devstack cinder-volume[75292]: DEBUG cinder.volume.driver [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75292) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 28 09:25:39 devstack cinder-volume[75292]: DEBUG oslo_db.sqlalchemy.engines [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75292) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 28 09:25:39 devstack cinder-volume[75292]: DEBUG dbcounter [-] [75292] Writer thread running {{(pid=75292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 28 09:25:39 devstack cinder-volume[75292]: DEBUG cinder.db.api [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] Building query based on filter {{(pid=75292) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 28 09:25:39 devstack cinder-volume[75292]: DEBUG cinder.image.image_utils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75292) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 28 09:25:39 devstack cinder-volume[75292]: INFO cinder.keymgr.migration [None req-d449673a-e916-4bd2-9701-6fdaf6faca73 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 28 09:25:39 devstack cinder-volume[75292]: DEBUG cinder.volume.drivers.lvm [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] Updating volume stats {{(pid=75292) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 28 09:25:39 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:25:39 devstack sudo[76115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 28 09:25:39 devstack sudo[76115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:25:40 devstack sudo[76115]: pam_unix(sudo:session): session closed for user root Aug 28 09:25:40 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:25:40 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:25:40 devstack sudo[76120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 28 09:25:40 devstack sudo[76120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:25:40 devstack sudo[76120]: pam_unix(sudo:session): session closed for user root Aug 28 09:25:40 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:25:40 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:25:40 devstack sudo[76123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 28 09:25:40 devstack sudo[76123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:25:40 devstack sudo[76123]: pam_unix(sudo:session): session closed for user root Aug 28 09:25:40 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.299s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:25:40 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:25:40 devstack sudo[76127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 28 09:25:40 devstack sudo[76127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:25:41 devstack sudo[76127]: pam_unix(sudo:session): session closed for user root Aug 28 09:25:41 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:25:41 devstack cinder-volume[75292]: DEBUG cinder.manager [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] Notifying Schedulers of capabilities ... {{(pid=75292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:25:41 devstack cinder-volume[75292]: INFO cinder.volume.manager [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] Driver initialization completed successfully. Aug 28 09:25:41 devstack cinder-volume[75292]: INFO cinder.manager [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] Initiating service 2 cleanup Aug 28 09:25:41 devstack cinder-volume[75292]: INFO cinder.manager [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] Service 2 cleanup completed. Aug 28 09:25:41 devstack cinder-volume[75292]: DEBUG cinder.service [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] Creating RPC server for service cinder-volume {{(pid=75292) start /opt/stack/cinder/cinder/service.py:231}} Aug 28 09:25:41 devstack cinder-volume[75292]: DEBUG cinder.service [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75292) start /opt/stack/cinder/cinder/service.py:237}} Aug 28 09:25:41 devstack cinder-volume[75292]: INFO cinder.volume.manager [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Aug 28 09:25:41 devstack cinder-volume[75292]: DEBUG cinder.volume.drivers.lvm [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] Updating volume stats {{(pid=75292) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 28 09:25:41 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:25:41 devstack sudo[76133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 28 09:25:41 devstack sudo[76133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:25:41 devstack sudo[76133]: pam_unix(sudo:session): session closed for user root Aug 28 09:25:41 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:25:41 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:25:41 devstack sudo[76137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 28 09:25:41 devstack sudo[76137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:25:41 devstack sudo[76137]: pam_unix(sudo:session): session closed for user root Aug 28 09:25:41 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:25:41 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:25:41 devstack sudo[76141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 28 09:25:41 devstack sudo[76141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:25:42 devstack sudo[76141]: pam_unix(sudo:session): session closed for user root Aug 28 09:25:42 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:25:42 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:25:42 devstack sudo[76144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 28 09:25:42 devstack sudo[76144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:25:42 devstack sudo[76144]: pam_unix(sudo:session): session closed for user root Aug 28 09:25:42 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:25:42 devstack cinder-volume[75292]: INFO cinder.volume.manager [None req-ca36f6e3-5650-4783-8159-b46dfed56024 None None] Driver post RPC initialization completed successfully. Aug 28 09:25:44 devstack cinder-volume[75141]: DEBUG dbcounter [-] [75141] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75141) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:25:52 devstack cinder-volume[75292]: DEBUG dbcounter [-] [75292] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:25:52 devstack cinder-volume[75292]: DEBUG dbcounter [-] [75292] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=75292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:26:16 devstack cinder-volume[75292]: DEBUG oslo_service.periodic_task [None req-672bf1eb-af5e-4521-898d-d7a3bc8dec82 None None] Running periodic task VolumeManager._thread_info {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:26:16 devstack cinder-volume[75292]: DEBUG cinder.volume.manager [None req-672bf1eb-af5e-4521-898d-d7a3bc8dec82 None None] thread count: 6 {{(pid=75292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 09:26:16 devstack cinder-volume[75292]: DEBUG cinder.volume.manager [None req-672bf1eb-af5e-4521-898d-d7a3bc8dec82 None None] thread info: [<_MainThread(MainThread, started 136681573576832)>, , , , , ] {{(pid=75292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 09:27:16 devstack cinder-volume[75292]: DEBUG oslo_service.periodic_task [None req-672bf1eb-af5e-4521-898d-d7a3bc8dec82 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:27:16 devstack cinder-volume[75292]: DEBUG cinder.volume.drivers.lvm [None req-672bf1eb-af5e-4521-898d-d7a3bc8dec82 None None] Updating volume stats {{(pid=75292) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 28 09:27:16 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-672bf1eb-af5e-4521-898d-d7a3bc8dec82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:27:16 devstack sudo[81338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 28 09:27:16 devstack sudo[81338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:27:16 devstack sudo[81338]: pam_unix(sudo:session): session closed for user root Aug 28 09:27:16 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-672bf1eb-af5e-4521-898d-d7a3bc8dec82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:27:16 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-672bf1eb-af5e-4521-898d-d7a3bc8dec82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:27:16 devstack sudo[81341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 28 09:27:16 devstack sudo[81341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:27:16 devstack sudo[81341]: pam_unix(sudo:session): session closed for user root Aug 28 09:27:16 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-672bf1eb-af5e-4521-898d-d7a3bc8dec82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:27:16 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-672bf1eb-af5e-4521-898d-d7a3bc8dec82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:27:16 devstack sudo[81345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 28 09:27:16 devstack sudo[81345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:27:17 devstack sudo[81345]: pam_unix(sudo:session): session closed for user root Aug 28 09:27:17 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-672bf1eb-af5e-4521-898d-d7a3bc8dec82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:27:17 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-672bf1eb-af5e-4521-898d-d7a3bc8dec82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:27:17 devstack sudo[81350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 28 09:27:17 devstack sudo[81350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:27:17 devstack sudo[81350]: pam_unix(sudo:session): session closed for user root Aug 28 09:27:17 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-672bf1eb-af5e-4521-898d-d7a3bc8dec82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:27:17 devstack cinder-volume[75292]: DEBUG cinder.manager [None req-672bf1eb-af5e-4521-898d-d7a3bc8dec82 None None] Notifying Schedulers of capabilities ... {{(pid=75292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:27:17 devstack cinder-volume[75292]: DEBUG oslo_service.periodic_task [None req-672bf1eb-af5e-4521-898d-d7a3bc8dec82 None None] Running periodic task VolumeManager._thread_info {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:27:17 devstack cinder-volume[75292]: DEBUG cinder.volume.manager [None req-672bf1eb-af5e-4521-898d-d7a3bc8dec82 None None] thread count: 6 {{(pid=75292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 09:27:17 devstack cinder-volume[75292]: DEBUG cinder.volume.manager [None req-672bf1eb-af5e-4521-898d-d7a3bc8dec82 None None] thread info: [<_MainThread(MainThread, started 136681573576832)>, , , , , ] {{(pid=75292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 09:27:52 devstack cinder-volume[75292]: DEBUG dbcounter [-] [75292] Writing DB stats cinder:SELECT=1 {{(pid=75292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:27:52 devstack cinder-volume[75292]: DEBUG dbcounter [-] [75292] Writing DB stats cinder:UPDATE=1 {{(pid=75292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:28:16 devstack cinder-volume[75292]: DEBUG oslo_service.periodic_task [None req-672bf1eb-af5e-4521-898d-d7a3bc8dec82 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:28:16 devstack cinder-volume[75292]: DEBUG cinder.volume.drivers.lvm [None req-672bf1eb-af5e-4521-898d-d7a3bc8dec82 None None] Updating volume stats {{(pid=75292) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 28 09:28:16 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-672bf1eb-af5e-4521-898d-d7a3bc8dec82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:28:16 devstack sudo[82830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 28 09:28:16 devstack sudo[82830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:28:16 devstack sudo[82830]: pam_unix(sudo:session): session closed for user root Aug 28 09:28:16 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-672bf1eb-af5e-4521-898d-d7a3bc8dec82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:28:16 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-672bf1eb-af5e-4521-898d-d7a3bc8dec82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:28:16 devstack sudo[82853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 28 09:28:16 devstack sudo[82853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:28:16 devstack sudo[82853]: pam_unix(sudo:session): session closed for user root Aug 28 09:28:16 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-672bf1eb-af5e-4521-898d-d7a3bc8dec82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:28:16 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-672bf1eb-af5e-4521-898d-d7a3bc8dec82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:28:16 devstack sudo[82856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 28 09:28:16 devstack sudo[82856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:28:17 devstack sudo[82856]: pam_unix(sudo:session): session closed for user root Aug 28 09:28:17 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-672bf1eb-af5e-4521-898d-d7a3bc8dec82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:28:17 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-672bf1eb-af5e-4521-898d-d7a3bc8dec82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:28:17 devstack sudo[82861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 28 09:28:17 devstack sudo[82861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:28:17 devstack sudo[82861]: pam_unix(sudo:session): session closed for user root Aug 28 09:28:17 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-672bf1eb-af5e-4521-898d-d7a3bc8dec82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:28:17 devstack cinder-volume[75292]: DEBUG cinder.manager [None req-672bf1eb-af5e-4521-898d-d7a3bc8dec82 None None] Notifying Schedulers of capabilities ... {{(pid=75292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:28:17 devstack cinder-volume[75292]: DEBUG oslo_service.periodic_task [None req-672bf1eb-af5e-4521-898d-d7a3bc8dec82 None None] Running periodic task VolumeManager._thread_info {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:28:17 devstack cinder-volume[75292]: DEBUG cinder.volume.manager [None req-672bf1eb-af5e-4521-898d-d7a3bc8dec82 None None] thread count: 6 {{(pid=75292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 09:28:17 devstack cinder-volume[75292]: DEBUG cinder.volume.manager [None req-672bf1eb-af5e-4521-898d-d7a3bc8dec82 None None] thread info: [<_MainThread(MainThread, started 136681573576832)>, , , , , ] {{(pid=75292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 09:29:16 devstack cinder-volume[75292]: DEBUG oslo_service.periodic_task [None req-672bf1eb-af5e-4521-898d-d7a3bc8dec82 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:29:16 devstack cinder-volume[75292]: DEBUG cinder.volume.drivers.lvm [None req-672bf1eb-af5e-4521-898d-d7a3bc8dec82 None None] Updating volume stats {{(pid=75292) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 28 09:29:16 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-672bf1eb-af5e-4521-898d-d7a3bc8dec82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:29:16 devstack sudo[84347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 28 09:29:16 devstack sudo[84347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:29:16 devstack sudo[84347]: pam_unix(sudo:session): session closed for user root Aug 28 09:29:16 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-672bf1eb-af5e-4521-898d-d7a3bc8dec82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:29:16 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-672bf1eb-af5e-4521-898d-d7a3bc8dec82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:29:16 devstack sudo[84350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 28 09:29:16 devstack sudo[84350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:29:16 devstack sudo[84350]: pam_unix(sudo:session): session closed for user root Aug 28 09:29:16 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-672bf1eb-af5e-4521-898d-d7a3bc8dec82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:29:16 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-672bf1eb-af5e-4521-898d-d7a3bc8dec82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:29:16 devstack sudo[84356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 28 09:29:16 devstack sudo[84356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:29:17 devstack sudo[84356]: pam_unix(sudo:session): session closed for user root Aug 28 09:29:17 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-672bf1eb-af5e-4521-898d-d7a3bc8dec82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:29:17 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-672bf1eb-af5e-4521-898d-d7a3bc8dec82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:29:17 devstack sudo[84359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 28 09:29:17 devstack sudo[84359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:29:17 devstack sudo[84359]: pam_unix(sudo:session): session closed for user root Aug 28 09:29:17 devstack cinder-volume[75292]: DEBUG oslo_concurrency.processutils [None req-672bf1eb-af5e-4521-898d-d7a3bc8dec82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:29:17 devstack cinder-volume[75292]: DEBUG cinder.manager [None req-672bf1eb-af5e-4521-898d-d7a3bc8dec82 None None] Notifying Schedulers of capabilities ... {{(pid=75292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:29:17 devstack cinder-volume[75292]: DEBUG oslo_service.periodic_task [None req-672bf1eb-af5e-4521-898d-d7a3bc8dec82 None None] Running periodic task VolumeManager._thread_info {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:29:17 devstack cinder-volume[75292]: DEBUG cinder.volume.manager [None req-672bf1eb-af5e-4521-898d-d7a3bc8dec82 None None] thread count: 6 {{(pid=75292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 09:29:17 devstack cinder-volume[75292]: DEBUG cinder.volume.manager [None req-672bf1eb-af5e-4521-898d-d7a3bc8dec82 None None] thread info: [<_MainThread(MainThread, started 136681573576832)>, , , , , ] {{(pid=75292) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 09:29:52 devstack cinder-volume[75292]: DEBUG dbcounter [-] [75292] Writing DB stats cinder:SELECT=1 {{(pid=75292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:29:52 devstack cinder-volume[75292]: DEBUG dbcounter [-] [75292] Writing DB stats cinder:UPDATE=1 {{(pid=75292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:29:58 devstack cinder-volume[75141]: INFO oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] Caught SIGTERM, stopping children Aug 28 09:29:58 devstack cinder-volume[75141]: DEBUG oslo_concurrency.lockutils [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] Acquiring lock "singleton_lock" {{(pid=75141) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 28 09:29:58 devstack cinder-volume[75141]: DEBUG oslo_concurrency.lockutils [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] Acquired lock "singleton_lock" {{(pid=75141) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 28 09:29:58 devstack cinder-volume[75141]: DEBUG oslo_concurrency.lockutils [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] Releasing lock "singleton_lock" {{(pid=75141) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 28 09:29:58 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] Stop services. {{(pid=75141) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 28 09:29:58 devstack cinder-volume[75141]: DEBUG oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] Killing children. {{(pid=75141) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 28 09:29:58 devstack cinder-volume[75141]: INFO oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] Waiting on 1 children to exit Aug 28 09:30:01 devstack cinder-volume[75292]: DEBUG oslo_concurrency.lockutils [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] Acquiring lock "singleton_lock" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 28 09:30:01 devstack cinder-volume[75292]: DEBUG oslo_concurrency.lockutils [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] Acquired lock "singleton_lock" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 28 09:30:01 devstack cinder-volume[75292]: DEBUG oslo_concurrency.lockutils [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] Releasing lock "singleton_lock" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 28 09:30:01 devstack cinder-volume[75292]: WARNING amqp [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 28 09:30:01 devstack cinder-volume[75292]: WARNING amqp [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 28 09:30:01 devstack cinder-volume[75141]: INFO oslo_service.backend._eventlet.service [None req-1570c6f6-1523-4630-9976-f6e909ae2cd7 None None] Child 75292 exited with status 0 Aug 28 09:30:01 devstack cinder-volume[85278]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 28 09:30:01 devstack cinder-volume[85278]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 28 09:30:01 devstack cinder-volume[85278]: we strongly recommend against using it for new projects. Aug 28 09:30:01 devstack cinder-volume[85278]: If you are already using Eventlet, we recommend migrating to a different Aug 28 09:30:01 devstack cinder-volume[85278]: framework. For more detail see Aug 28 09:30:01 devstack cinder-volume[85278]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 28 09:30:01 devstack cinder-volume[85278]: import eventlet # noqa Aug 28 09:30:03 devstack cinder-volume[85278]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85278) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 28 09:30:03 devstack cinder-volume[85278]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85278) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 28 09:30:03 devstack cinder-volume[85278]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85278) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 28 09:30:04 devstack cinder-volume[85278]: INFO dbcounter [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] Registered counter for database cinder Aug 28 09:30:04 devstack cinder-volume[85278]: DEBUG oslo_db.sqlalchemy.engines [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85278) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 28 09:30:04 devstack cinder-volume[85278]: DEBUG dbcounter [-] [85278] Writer thread running {{(pid=85278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 28 09:30:04 devstack cinder-volume[85278]: INFO cinder.rpc [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 28 09:30:04 devstack cinder-volume[85278]: INFO cinder.rpc [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 28 09:30:04 devstack cinder-volume[85278]: DEBUG oslo_db.sqlalchemy.engines [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85278) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 28 09:30:04 devstack cinder-volume[85278]: INFO cinder.volume.manager [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] Determined volume DB was empty at startup. Aug 28 09:30:04 devstack cinder-volume[85278]: DEBUG cinder.volume.manager [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85278) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 28 09:30:04 devstack cinder-volume[85278]: INFO cinder.volume.manager [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 28 09:30:04 devstack cinder-volume[85278]: WARNING stevedore.named [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 28 09:30:04 devstack cinder-volume[85278]: WARNING castellan.key_manager [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 28 09:30:04 devstack cinder-volume[85278]: WARNING cinder.keymgr.conf_key_mgr [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 28 09:30:04 devstack cinder-volume[85278]: INFO cinder.volume.manager [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_db.sqlalchemy.engines [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85278) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 28 09:30:05 devstack cinder-volume[85278]: INFO oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] Starting 1 workers Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] Started child 85499 {{(pid=85278) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] Full set of CONF: {{(pid=85278) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] ******************************************************************************** {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] Configuration options gathered from: {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] ================================================================================ {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] allow_availability_zone_fallback = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] allow_compression_on_image_upload = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] allowed_direct_url_schemes = [] {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] api_rate_limit = True {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] auth_strategy = keystone {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_availability_zone = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_host = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_name = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_stats_polling_interval = 60 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backup_api_class = cinder.backup.api.API {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85499]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backup_name_template = backup-%s {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backup_use_same_host = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backup_use_temp_snapshot = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] chap_password = **** {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] chap_username = {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] cinder_internal_tenant_project_id = c5eb5a397c9d460c8a7fc935b90f9d0c {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] cinder_internal_tenant_user_id = 9922b57450e24f12933757730d53ed5a {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] cluster = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] compression_format = gzip {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] compute_api_class = cinder.compute.nova.API {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] config_dir = [] {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] config_source = [] {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] control_exchange = openstack {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] debug = True {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] default_availability_zone = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] default_group_type = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] default_volume_type = QuobyteHD {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] disk_geometry = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] driver_client_cert = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] driver_client_cert_key = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] driver_data_namespace = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] driver_ssl_cert_path = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] driver_ssl_cert_verify = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] driver_use_ssl = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] enable_new_services = True {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] enable_unsupported_driver = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] enabled_backends = ['QuobyteHD'] {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] enforce_multipath_for_image_xfer = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] filter_function = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] glance_api_insecure = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] glance_api_servers = ['http://192.168.122.31/image'] {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] glance_api_ssl_compression = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] glance_ca_certificates_file = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] glance_catalog_info = image:glance:publicURL {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] glance_certfile = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] glance_keyfile = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] glance_num_retries = 3 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] glance_request_timeout = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] goodness_function = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] graceful_shutdown_timeout = 5 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] group_api_class = cinder.group.api.API {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] host = devstack {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] image_compress_on_upload = True {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] image_conversion_address_space_limit = 1 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] image_conversion_cpu_limit = 60 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] image_conversion_disable = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] image_upload_use_cinder_backend = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] image_upload_use_internal_tenant = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] image_volume_cache_enabled = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] image_volume_cache_max_count = 0 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] image_volume_cache_max_size_gb = 0 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] init_host_max_objects_retrieval = 0 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] instance_format = [instance: %(uuid)s] {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] iscsi_target_flags = {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] iscsi_write_cache = on {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] iser_helper = tgtadm {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] iser_ip_address = 192.168.122.31 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] iser_port = 3260 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] log_color = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] log_config_append = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] log_dir = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] log_file = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] log_options = True {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] log_rotate_interval = 1 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] log_rotate_interval_type = days {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] log_rotation_type = none {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] max_age = 0 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] max_logfile_count = 30 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] max_logfile_size_mb = 200 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] max_over_subscription_ratio = 20.0 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] message_reap_interval = 86400 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] message_ttl = 2592000 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] migration_create_volume_timeout_secs = 300 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] monkey_patch = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] monkey_patch_modules = [] {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] my_ip = 192.168.122.31 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] no_snapshot_gb_quota = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] num_iser_scan_tries = 3 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] num_shell_tries = 3 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] num_volume_device_scan_tries = 3 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] nvmeof_conn_info_version = 1 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] nvmet_ns_id = 10 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] nvmet_port_id = 1 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] osapi_max_limit = 1000 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] osapi_volume_ext_list = [] {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] osapi_volume_listen_port = 8776 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] osapi_volume_use_ssl = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] osapi_volume_workers = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] per_volume_size_limit = -1 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] periodic_fuzzy_delay = 60 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] periodic_interval = 60 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] public_endpoint = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] publish_errors = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] quota_backup_gigabytes = 1000 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] quota_backups = 10 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] quota_gigabytes = 1000 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] quota_groups = 10 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] quota_snapshots = 10 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] quota_volumes = 10 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] rate_limit_burst = 0 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] rate_limit_except_level = CRITICAL {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] rate_limit_interval = 0 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] reinit_driver_count = 3 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] replication_device = **** {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] report_discard_supported = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] report_interval = 120 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] reservation_clean_interval = 86400 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] reservation_expire = 86400 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] reserved_image_namespaces = [] {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] reserved_percentage = 0 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] rpc_response_timeout = 120 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] run_external_periodic_tasks = True {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] scst_target_driver = iscsi {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] scst_target_iqn_name = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] service_down_time = 720 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] shell_completion = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] snapshot_name_template = snapshot-%s {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] split_loggers = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] state_path = /opt/stack/data/cinder {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] storage_availability_zone = nova {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] storage_protocol = iSCSI {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] syslog_log_facility = LOG_USER {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] target_helper = lioadm {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] target_ip_address = 192.168.122.31 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] target_port = 3260 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] target_protocol = iscsi {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] target_secondary_ip_addresses = [] {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] trace_flags = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] transport_url = **** {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] until_refresh = 0 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] use_chap_auth = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] use_default_quota_class = True {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] use_journal = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] use_json = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] use_multipath_for_image_xfer = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] use_stderr = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] use_syslog = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] verify_glance_signatures = enabled {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] volume_api_class = cinder.volume.api.API {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] volume_backend_name = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] volume_clear = zero {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] volume_clear_ionice = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] volume_clear_size = 0 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] volume_copy_bps_limit = 0 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] volume_dd_blocksize = 1M {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] volume_name_template = volume-%s {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] volume_service_inithost_offload = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] volume_usage_audit_period = month {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] zoning_mode = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_concurrency.disable_process_locking = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85499]: INFO cinder.volume.manager [None req-cb90ecb6-8888-49f9-8514-a1bf79f12d58 None None] Starting volume driver QuobyteDriver (1.2.1) Aug 28 09:30:05 devstack cinder-volume[85499]: DEBUG cinder.volume.drivers.remotefs [None req-cb90ecb6-8888-49f9-8514-a1bf79f12d58 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85499) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] keystone_authtoken.auth_section = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] keystone_authtoken.auth_type = password {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] keystone_authtoken.auth_version = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] keystone_authtoken.cache = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] keystone_authtoken.certfile = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] keystone_authtoken.include_service_catalog = True {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] keystone_authtoken.insecure = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] keystone_authtoken.interface = public {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] keystone_authtoken.keyfile = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] keystone_authtoken.memcache_password = **** {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] keystone_authtoken.memcache_username = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] keystone_authtoken.region_name = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] keystone_authtoken.service_type = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.31/identity {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] cache.backend = dogpile.cache.null {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] cache.backend_argument = **** {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] cache.backend_expiration_time = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] cache.config_prefix = cache.oslo {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] cache.debug_cache_backend = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] cache.enable_retry_client = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] cache.enable_socket_keepalive = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] cache.enabled = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] cache.expiration_time = 600 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] cache.hashclient_retry_attempts = 2 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] cache.memcache_dead_retry = 300 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] cache.memcache_pool_maxsize = 10 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] cache.memcache_sasl_enabled = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] cache.password = **** {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] cache.proxies = [] {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] cache.redis_db = 0 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] cache.redis_server = localhost:6379 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] cache.retry_attempts = 2 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] cache.retry_delay = 0.0 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] cache.socket_keepalive_count = 1 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] cache.socket_keepalive_idle = 1 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] cache.socket_keepalive_interval = 1 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] cache.socket_timeout = 1.0 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] cache.tls_allowed_ciphers = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] cache.tls_cafile = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] cache.tls_certfile = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] cache.tls_enabled = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] cache.tls_keyfile = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] cache.username = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] coordination.backend_url = **** {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] database.asyncio_connection = **** {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] database.asyncio_slave_connection = **** {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] database.backend = sqlalchemy {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] database.connection = **** {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] database.connection_debug = 0 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] database.connection_parameters = {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] database.connection_recycle_time = 3600 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] database.connection_trace = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] database.db_inc_retry_interval = True {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] database.db_max_retries = 20 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] database.db_max_retry_interval = 10 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] database.db_retry_interval = 1 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] database.max_overflow = 50 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] database.max_pool_size = 5 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] database.max_retries = 10 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] database.mysql_wsrep_sync_wait = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] database.pool_timeout = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] database.retry_interval = 10 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] database.slave_connection = **** {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] database.sqlite_synchronous = True {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] database.synchronous_reader = True {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] database.use_db_reconnect = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_messaging_tracing.insecure = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] profiler.connection_string = messaging:// {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] profiler.enabled = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] profiler.es_doc_type = notification {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] profiler.es_scroll_size = 10000 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] profiler.es_scroll_time = 2m {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] profiler.filter_error_trace = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] profiler.hmac_keys = **** {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] profiler.sentinel_service_name = mymaster {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] profiler.socket_timeout = 0.1 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] profiler.trace_requests = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] profiler.trace_sqlalchemy = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] profiler_jaeger.process_tags = {} {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] profiler_jaeger.service_name_prefix = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] profiler_otlp.service_name_prefix = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_policy.enforce_new_defaults = True {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_policy.policy_default_rule = default {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_policy.policy_file = policy.yaml {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] privsep_osbrick.group = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] privsep_osbrick.helper_command = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] privsep_osbrick.user = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] cinder_sys_admin.group = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] cinder_sys_admin.helper_command = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85499]: DEBUG cinder.volume.drivers.quobyte [None req-cb90ecb6-8888-49f9-8514-a1bf79f12d58 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85499) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Aug 28 09:30:05 devstack cinder-volume[85499]: WARNING cinder.volume.drivers.quobyte [None req-cb90ecb6-8888-49f9-8514-a1bf79f12d58 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 28 09:30:05 devstack cinder-volume[85499]: WARNING cinder.volume.drivers.quobyte [None req-cb90ecb6-8888-49f9-8514-a1bf79f12d58 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] cinder_sys_admin.user = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] service_user.auth_section = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] service_user.auth_type = password {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] service_user.cafile = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] service_user.certfile = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] service_user.collect_timing = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] service_user.insecure = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85499]: DEBUG oslo_concurrency.processutils [None req-cb90ecb6-8888-49f9-8514-a1bf79f12d58 None None] Running cmd (subprocess): mount.quobyte {{(pid=85499) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] service_user.keyfile = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] service_user.send_service_user_token = True {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] service_user.split_loggers = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] service_user.timeout = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] glance.auth_section = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] glance.auth_type = password {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] glance.certfile = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] glance.collect_timing = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] glance.insecure = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] glance.keyfile = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] glance.region_name = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] glance.split_loggers = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] glance.timeout = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.backend_availability_zone = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.chap_password = **** {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.chap_username = {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.disk_geometry = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.driver_client_cert = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.driver_client_cert_key = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.driver_data_namespace = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.driver_use_ssl = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.extra_capabilities = {} {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.filter_function = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.goodness_function = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.iscsi_target_flags = {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.iscsi_write_cache = on {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.iser_helper = tgtadm {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.iser_ip_address = 192.168.122.31 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.iser_port = 3260 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.nas_host = {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.nas_login = admin {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.nas_mount_options = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.nas_password = **** {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.nas_private_key = {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.nas_share_path = {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.num_shell_tries = 3 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.quobyte_volume_url = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.replication_device = **** {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.report_discard_supported = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.reserved_percentage = 0 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.target_helper = tgtadm {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.target_ip_address = 192.168.122.31 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.target_port = 3260 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.target_protocol = iscsi {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.trace_flags = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.unique_fqdn_network = True {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.use_chap_auth = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.volume_backend_name = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.volume_clear = zero {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.volume_clear_ionice = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.volume_clear_size = 0 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_reports.file_event_handler = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_reports.log_dir = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.backend_availability_zone = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.backend_host = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.chap_password = **** {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.chap_username = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.chiscsi_conf = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.disk_geometry = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.driver_client_cert = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.driver_data_namespace = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.driver_use_ssl = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.extra_capabilities = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.filter_function = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.goodness_function = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.iser_helper = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.iser_ip_address = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.iser_port = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.iser_target_prefix = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.nas_host = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.nas_login = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.nas_mount_options = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.nas_password = **** {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.nas_private_key = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.nas_share_path = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.nas_ssh_port = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.num_shell_tries = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.nvmet_port_id = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.replication_device = **** {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.report_discard_supported = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack quobyte-client[85500]: Reading configuration file: /etc/quobyte/client.cfg Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.reserved_percentage = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.scst_target_driver = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.storage_protocol = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.target_helper = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.target_ip_address = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack quobyte-client[85500]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.target_port = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.target_prefix = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.target_protocol = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.trace_flags = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85499]: DEBUG oslo_concurrency.processutils [None req-cb90ecb6-8888-49f9-8514-a1bf79f12d58 None None] CMD "mount.quobyte" returned: 1 in 0.123s {{(pid=85499) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.use_chap_auth = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85499]: DEBUG oslo_concurrency.lockutils [None req-cb90ecb6-8888-49f9-8514-a1bf79f12d58 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85499) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85499]: DEBUG oslo_concurrency.lockutils [None req-cb90ecb6-8888-49f9-8514-a1bf79f12d58 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85499) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:30:05 devstack cinder-volume[85499]: DEBUG cinder.volume.drivers.quobyte [None req-cb90ecb6-8888-49f9-8514-a1bf79f12d58 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=85499) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.volume_clear = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.volume_clear_size = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] QuobyteHD.volumes_dir = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85499]: INFO cinder.volume.drivers.quobyte [None req-cb90ecb6-8888-49f9-8514-a1bf79f12d58 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b ... Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85499]: DEBUG oslo_concurrency.processutils [None req-cb90ecb6-8888-49f9-8514-a1bf79f12d58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 -c /etc/quobyte/client-cinder.cfg {{(pid=85499) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_messaging_rabbit.ssl = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_messaging_notifications.driver = [] {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_messaging_notifications.retry = -1 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] key_manager.fixed_key = **** {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] barbican.barbican_api_version = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] barbican.barbican_endpoint = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] barbican.barbican_endpoint_type = public {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] barbican.barbican_region_name = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] barbican.cafile = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] barbican.certfile = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] barbican.collect_timing = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] barbican.insecure = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] barbican.keyfile = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] barbican.number_of_retries = 60 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] barbican.retry_delay = 1 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] barbican.send_service_user_token = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] barbican.split_loggers = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] barbican.timeout = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] barbican.verify_ssl = True {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] barbican.verify_ssl_path = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] barbican_service_user.auth_section = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] barbican_service_user.auth_type = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] barbican_service_user.cafile = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] barbican_service_user.certfile = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] barbican_service_user.collect_timing = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] barbican_service_user.insecure = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] barbican_service_user.keyfile = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] barbican_service_user.split_loggers = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] barbican_service_user.timeout = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] vault.approle_role_id = **** {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] vault.approle_secret_id = **** {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] vault.auth_method = approle {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] vault.auth_path = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] vault.kv_mountpoint = secret {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] vault.kv_path = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] vault.kv_version = 2 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] vault.namespace = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] vault.root_token_id = **** {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] vault.ssl_ca_crt_file = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] vault.timeout = 60.0 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] vault.token_file = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] vault.token_role = None {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] vault.use_ssl = False {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:05 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] ******************************************************************************** {{(pid=85278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 28 09:30:05 devstack sudo[85505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 -c /etc/quobyte/client-cinder.cfg Aug 28 09:30:05 devstack sudo[85505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:30:05 devstack sudo[85505]: pam_unix(sudo:session): session closed for user root Aug 28 09:30:05 devstack cinder-volume[85499]: DEBUG oslo_concurrency.processutils [None req-cb90ecb6-8888-49f9-8514-a1bf79f12d58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.382s {{(pid=85499) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:30:05 devstack cinder-volume[85499]: INFO cinder.volume.drivers.quobyte [None req-cb90ecb6-8888-49f9-8514-a1bf79f12d58 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b succeeded Aug 28 09:30:05 devstack cinder-volume[85499]: DEBUG cinder.volume.drivers.quobyte [None req-cb90ecb6-8888-49f9-8514-a1bf79f12d58 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=85499) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:30:05 devstack cinder-volume[85499]: DEBUG oslo_concurrency.lockutils [None req-cb90ecb6-8888-49f9-8514-a1bf79f12d58 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.396s {{(pid=85499) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:30:05 devstack cinder-volume[85499]: DEBUG oslo_concurrency.processutils [None req-cb90ecb6-8888-49f9-8514-a1bf79f12d58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=85499) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:30:05 devstack sudo[85574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:30:05 devstack sudo[85574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:30:06 devstack sudo[85574]: pam_unix(sudo:session): session closed for user root Aug 28 09:30:06 devstack cinder-volume[85499]: DEBUG oslo_concurrency.processutils [None req-cb90ecb6-8888-49f9-8514-a1bf79f12d58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.236s {{(pid=85499) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:30:06 devstack cinder-volume[85499]: INFO cinder.volume.driver [None req-cb90ecb6-8888-49f9-8514-a1bf79f12d58 None None] Driver hasn't implemented _init_vendor_properties() Aug 28 09:30:06 devstack cinder-volume[85499]: DEBUG cinder.volume.driver [None req-cb90ecb6-8888-49f9-8514-a1bf79f12d58 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.6184768676758, 'free_capacity_gb': 1774.6184768676758, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85499) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 28 09:30:06 devstack cinder-volume[85499]: DEBUG oslo_db.sqlalchemy.engines [None req-cb90ecb6-8888-49f9-8514-a1bf79f12d58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85499) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 28 09:30:06 devstack cinder-volume[85499]: DEBUG dbcounter [-] [85499] Writer thread running {{(pid=85499) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 28 09:30:06 devstack cinder-volume[85499]: DEBUG cinder.db.api [None req-cb90ecb6-8888-49f9-8514-a1bf79f12d58 None None] Building query based on filter {{(pid=85499) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 28 09:30:06 devstack cinder-volume[85499]: DEBUG cinder.image.image_utils [None req-cb90ecb6-8888-49f9-8514-a1bf79f12d58 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85499) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 28 09:30:06 devstack cinder-volume[85499]: INFO cinder.keymgr.migration [None req-df5e1448-88c6-48af-b3ff-c75966ef53df None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 28 09:30:06 devstack cinder-volume[85499]: DEBUG oslo_concurrency.lockutils [None req-cb90ecb6-8888-49f9-8514-a1bf79f12d58 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85499) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:30:06 devstack cinder-volume[85499]: DEBUG oslo_concurrency.lockutils [None req-cb90ecb6-8888-49f9-8514-a1bf79f12d58 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85499) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:30:06 devstack cinder-volume[85499]: DEBUG cinder.volume.drivers.quobyte [None req-cb90ecb6-8888-49f9-8514-a1bf79f12d58 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=85499) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:30:06 devstack cinder-volume[85499]: DEBUG cinder.volume.drivers.quobyte [None req-cb90ecb6-8888-49f9-8514-a1bf79f12d58 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=85499) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:30:06 devstack cinder-volume[85499]: DEBUG oslo_concurrency.lockutils [None req-cb90ecb6-8888-49f9-8514-a1bf79f12d58 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85499) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:30:06 devstack cinder-volume[85499]: DEBUG oslo_concurrency.processutils [None req-cb90ecb6-8888-49f9-8514-a1bf79f12d58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=85499) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:30:06 devstack sudo[85577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:30:06 devstack sudo[85577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:30:06 devstack sudo[85577]: pam_unix(sudo:session): session closed for user root Aug 28 09:30:06 devstack cinder-volume[85499]: DEBUG oslo_concurrency.processutils [None req-cb90ecb6-8888-49f9-8514-a1bf79f12d58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.245s {{(pid=85499) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:30:06 devstack cinder-volume[85499]: DEBUG cinder.manager [None req-cb90ecb6-8888-49f9-8514-a1bf79f12d58 None None] Notifying Schedulers of capabilities ... {{(pid=85499) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:30:06 devstack cinder-volume[85499]: INFO cinder.volume.manager [None req-cb90ecb6-8888-49f9-8514-a1bf79f12d58 None None] Driver initialization completed successfully. Aug 28 09:30:06 devstack cinder-volume[85499]: INFO cinder.manager [None req-cb90ecb6-8888-49f9-8514-a1bf79f12d58 None None] Initiating service 3 cleanup Aug 28 09:30:06 devstack cinder-volume[85499]: INFO cinder.manager [None req-cb90ecb6-8888-49f9-8514-a1bf79f12d58 None None] Service 3 cleanup completed. Aug 28 09:30:06 devstack cinder-volume[85499]: DEBUG cinder.service [None req-cb90ecb6-8888-49f9-8514-a1bf79f12d58 None None] Creating RPC server for service cinder-volume {{(pid=85499) start /opt/stack/cinder/cinder/service.py:231}} Aug 28 09:30:06 devstack cinder-volume[85499]: DEBUG cinder.service [None req-cb90ecb6-8888-49f9-8514-a1bf79f12d58 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85499) start /opt/stack/cinder/cinder/service.py:237}} Aug 28 09:30:06 devstack cinder-volume[85499]: INFO cinder.volume.manager [None req-cb90ecb6-8888-49f9-8514-a1bf79f12d58 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Aug 28 09:30:06 devstack cinder-volume[85499]: DEBUG oslo_concurrency.lockutils [None req-cb90ecb6-8888-49f9-8514-a1bf79f12d58 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85499) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:30:06 devstack cinder-volume[85499]: DEBUG oslo_concurrency.lockutils [None req-cb90ecb6-8888-49f9-8514-a1bf79f12d58 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85499) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:30:06 devstack cinder-volume[85499]: DEBUG cinder.volume.drivers.quobyte [None req-cb90ecb6-8888-49f9-8514-a1bf79f12d58 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=85499) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:30:06 devstack cinder-volume[85499]: DEBUG cinder.volume.drivers.quobyte [None req-cb90ecb6-8888-49f9-8514-a1bf79f12d58 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=85499) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:30:06 devstack cinder-volume[85499]: DEBUG oslo_concurrency.lockutils [None req-cb90ecb6-8888-49f9-8514-a1bf79f12d58 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85499) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:30:06 devstack cinder-volume[85499]: DEBUG oslo_concurrency.processutils [None req-cb90ecb6-8888-49f9-8514-a1bf79f12d58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=85499) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:30:06 devstack sudo[85580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:30:06 devstack sudo[85580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:30:06 devstack sudo[85580]: pam_unix(sudo:session): session closed for user root Aug 28 09:30:06 devstack cinder-volume[85499]: DEBUG oslo_concurrency.processutils [None req-cb90ecb6-8888-49f9-8514-a1bf79f12d58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.252s {{(pid=85499) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:30:06 devstack cinder-volume[85499]: INFO cinder.volume.manager [None req-cb90ecb6-8888-49f9-8514-a1bf79f12d58 None None] Driver post RPC initialization completed successfully. Aug 28 09:30:11 devstack cinder-volume[85499]: DEBUG oslo_concurrency.lockutils [None req-93bd0993-d2bf-4249-bbc4-06e2d4c422b5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85499) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:30:11 devstack cinder-volume[85499]: DEBUG oslo_concurrency.lockutils [None req-93bd0993-d2bf-4249-bbc4-06e2d4c422b5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85499) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:30:11 devstack cinder-volume[85499]: DEBUG cinder.volume.drivers.quobyte [None req-93bd0993-d2bf-4249-bbc4-06e2d4c422b5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=85499) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:30:11 devstack cinder-volume[85499]: DEBUG cinder.volume.drivers.quobyte [None req-93bd0993-d2bf-4249-bbc4-06e2d4c422b5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=85499) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:30:11 devstack cinder-volume[85499]: DEBUG oslo_concurrency.lockutils [None req-93bd0993-d2bf-4249-bbc4-06e2d4c422b5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85499) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:30:11 devstack cinder-volume[85499]: DEBUG oslo_concurrency.processutils [None req-93bd0993-d2bf-4249-bbc4-06e2d4c422b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=85499) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:30:11 devstack sudo[85727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:30:11 devstack sudo[85727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:30:11 devstack sudo[85727]: pam_unix(sudo:session): session closed for user root Aug 28 09:30:11 devstack cinder-volume[85499]: DEBUG oslo_concurrency.processutils [None req-93bd0993-d2bf-4249-bbc4-06e2d4c422b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.229s {{(pid=85499) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:30:11 devstack cinder-volume[85499]: DEBUG cinder.manager [None req-93bd0993-d2bf-4249-bbc4-06e2d4c422b5 None None] Notifying Schedulers of capabilities ... {{(pid=85499) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:30:11 devstack cinder-volume[85278]: INFO oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] Caught SIGTERM, stopping children Aug 28 09:30:11 devstack cinder-volume[85278]: DEBUG oslo_concurrency.lockutils [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] Acquiring lock "singleton_lock" {{(pid=85278) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 28 09:30:11 devstack cinder-volume[85278]: DEBUG oslo_concurrency.lockutils [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] Acquired lock "singleton_lock" {{(pid=85278) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 28 09:30:11 devstack cinder-volume[85278]: DEBUG oslo_concurrency.lockutils [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] Releasing lock "singleton_lock" {{(pid=85278) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 28 09:30:11 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] Stop services. {{(pid=85278) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 28 09:30:11 devstack cinder-volume[85278]: DEBUG oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] Killing children. {{(pid=85278) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 28 09:30:11 devstack cinder-volume[85278]: INFO oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] Waiting on 1 children to exit Aug 28 09:30:12 devstack cinder-volume[85499]: DEBUG oslo_service.periodic_task [None req-a20ce2fb-38a9-4196-b21a-0b285279c46e None None] Running periodic task VolumeManager._thread_info {{(pid=85499) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:30:12 devstack cinder-volume[85499]: DEBUG cinder.volume.manager [None req-a20ce2fb-38a9-4196-b21a-0b285279c46e None None] thread count: 6 {{(pid=85499) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 09:30:12 devstack cinder-volume[85499]: DEBUG cinder.volume.manager [None req-a20ce2fb-38a9-4196-b21a-0b285279c46e None None] thread info: [<_MainThread(MainThread, started 133868540334208)>, , , , , ] {{(pid=85499) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 09:30:14 devstack cinder-volume[85499]: DEBUG oslo_concurrency.lockutils [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] Acquiring lock "singleton_lock" {{(pid=85499) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 28 09:30:14 devstack cinder-volume[85499]: DEBUG oslo_concurrency.lockutils [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] Acquired lock "singleton_lock" {{(pid=85499) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 28 09:30:14 devstack cinder-volume[85499]: DEBUG oslo_concurrency.lockutils [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] Releasing lock "singleton_lock" {{(pid=85499) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 28 09:30:14 devstack cinder-volume[85499]: WARNING amqp [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 28 09:30:14 devstack cinder-volume[85499]: WARNING amqp [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 28 09:30:14 devstack cinder-volume[85278]: INFO oslo_service.backend._eventlet.service [None req-53bf3cf7-c96f-4e7c-9a4a-94d01da97841 None None] Child 85499 exited with status 0 Aug 28 09:30:15 devstack cinder-volume[85780]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 28 09:30:15 devstack cinder-volume[85780]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 28 09:30:15 devstack cinder-volume[85780]: we strongly recommend against using it for new projects. Aug 28 09:30:15 devstack cinder-volume[85780]: If you are already using Eventlet, we recommend migrating to a different Aug 28 09:30:15 devstack cinder-volume[85780]: framework. For more detail see Aug 28 09:30:15 devstack cinder-volume[85780]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 28 09:30:15 devstack cinder-volume[85780]: import eventlet # noqa Aug 28 09:30:18 devstack cinder-volume[85780]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85780) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 28 09:30:18 devstack cinder-volume[85780]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85780) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 28 09:30:18 devstack cinder-volume[85780]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85780) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 28 09:30:19 devstack cinder-volume[85780]: INFO dbcounter [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] Registered counter for database cinder Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_db.sqlalchemy.engines [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85780) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG dbcounter [-] [85780] Writer thread running {{(pid=85780) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 28 09:30:19 devstack cinder-volume[85780]: INFO cinder.rpc [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 28 09:30:19 devstack cinder-volume[85780]: INFO cinder.rpc [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_db.sqlalchemy.engines [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85780) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 28 09:30:19 devstack cinder-volume[85780]: INFO cinder.volume.manager [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] Determined volume DB was empty at startup. Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG cinder.volume.manager [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85780) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 28 09:30:19 devstack cinder-volume[85780]: WARNING stevedore.named [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 28 09:30:19 devstack cinder-volume[85780]: WARNING castellan.key_manager [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 28 09:30:19 devstack cinder-volume[85780]: WARNING cinder.keymgr.conf_key_mgr [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 28 09:30:19 devstack cinder-volume[85780]: INFO cinder.volume.manager [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_db.sqlalchemy.engines [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85780) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 28 09:30:19 devstack cinder-volume[85780]: INFO oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] Starting 1 workers Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] Started child 86081 {{(pid=85780) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] Full set of CONF: {{(pid=85780) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] ******************************************************************************** {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] Configuration options gathered from: {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] ================================================================================ {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] allow_availability_zone_fallback = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] allow_compression_on_image_upload = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] allowed_direct_url_schemes = [] {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[86081]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] api_rate_limit = True {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] auth_strategy = keystone {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_availability_zone = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_host = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_name = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_stats_polling_interval = 60 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backup_api_class = cinder.backup.api.API {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backup_name_template = backup-%s {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backup_use_same_host = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backup_use_temp_snapshot = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] chap_password = **** {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] chap_username = {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] cinder_internal_tenant_project_id = c5eb5a397c9d460c8a7fc935b90f9d0c {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] cinder_internal_tenant_user_id = 9922b57450e24f12933757730d53ed5a {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] cluster = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] compression_format = gzip {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] compute_api_class = cinder.compute.nova.API {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] config_dir = [] {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] config_source = [] {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] control_exchange = openstack {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] debug = True {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] default_availability_zone = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] default_group_type = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] default_volume_type = QuobyteHD {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] disk_geometry = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] driver_client_cert = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] driver_client_cert_key = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] driver_data_namespace = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] driver_ssl_cert_path = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] driver_ssl_cert_verify = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] driver_use_ssl = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] enable_new_services = True {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] enable_unsupported_driver = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] enabled_backends = ['QuobyteHD'] {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] enforce_multipath_for_image_xfer = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] filter_function = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] glance_api_insecure = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] glance_api_servers = ['http://192.168.122.31/image'] {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] glance_api_ssl_compression = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] glance_ca_certificates_file = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] glance_catalog_info = image:glance:publicURL {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] glance_certfile = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] glance_keyfile = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] glance_num_retries = 3 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] glance_request_timeout = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] goodness_function = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] graceful_shutdown_timeout = 5 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] group_api_class = cinder.group.api.API {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] host = devstack {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] image_compress_on_upload = True {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] image_conversion_address_space_limit = 1 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] image_conversion_cpu_limit = 60 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] image_conversion_disable = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] image_upload_use_cinder_backend = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] image_upload_use_internal_tenant = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] image_volume_cache_enabled = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] image_volume_cache_max_count = 0 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] image_volume_cache_max_size_gb = 0 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] init_host_max_objects_retrieval = 0 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] instance_format = [instance: %(uuid)s] {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] iscsi_target_flags = {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] iscsi_write_cache = on {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] iser_helper = tgtadm {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] iser_ip_address = 192.168.122.31 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] iser_port = 3260 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] log_color = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] log_config_append = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] log_dir = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] log_file = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] log_options = True {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] log_rotate_interval = 1 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] log_rotate_interval_type = days {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] log_rotation_type = none {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] max_age = 0 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] max_logfile_count = 30 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] max_logfile_size_mb = 200 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] max_over_subscription_ratio = 20.0 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] message_reap_interval = 86400 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] message_ttl = 2592000 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] migration_create_volume_timeout_secs = 300 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] monkey_patch = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] monkey_patch_modules = [] {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] my_ip = 192.168.122.31 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] no_snapshot_gb_quota = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-f7ce949f-9cb8-45a2-ac69-994ad6159d2d None None] Starting volume driver QuobyteDriver (1.2.1) Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] num_iser_scan_tries = 3 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-f7ce949f-9cb8-45a2-ac69-994ad6159d2d None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86081) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] num_shell_tries = 3 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] num_volume_device_scan_tries = 3 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] nvmeof_conn_info_version = 1 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] nvmet_ns_id = 10 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] nvmet_port_id = 1 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] osapi_max_limit = 1000 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] osapi_volume_ext_list = [] {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] osapi_volume_listen_port = 8776 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] osapi_volume_use_ssl = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] osapi_volume_workers = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] per_volume_size_limit = -1 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] periodic_fuzzy_delay = 60 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] periodic_interval = 60 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] public_endpoint = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] publish_errors = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] quota_backup_gigabytes = 1000 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] quota_backups = 10 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] quota_gigabytes = 1000 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] quota_groups = 10 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] quota_snapshots = 10 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] quota_volumes = 10 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] rate_limit_burst = 0 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] rate_limit_except_level = CRITICAL {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] rate_limit_interval = 0 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] reinit_driver_count = 3 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] replication_device = **** {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] report_discard_supported = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] report_interval = 120 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] reservation_clean_interval = 86400 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] reservation_expire = 86400 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] reserved_image_namespaces = [] {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] reserved_percentage = 0 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] rpc_response_timeout = 120 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] run_external_periodic_tasks = True {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] scst_target_driver = iscsi {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] scst_target_iqn_name = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] service_down_time = 720 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] shell_completion = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] snapshot_name_template = snapshot-%s {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] split_loggers = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] state_path = /opt/stack/data/cinder {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] storage_availability_zone = nova {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] storage_protocol = iSCSI {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] syslog_log_facility = LOG_USER {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] target_helper = lioadm {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] target_ip_address = 192.168.122.31 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] target_port = 3260 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] target_protocol = iscsi {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] target_secondary_ip_addresses = [] {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] trace_flags = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] transport_url = **** {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] until_refresh = 0 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] use_chap_auth = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] use_default_quota_class = True {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] use_journal = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] use_json = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] use_multipath_for_image_xfer = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] use_stderr = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] use_syslog = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] verify_glance_signatures = enabled {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] volume_api_class = cinder.volume.api.API {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] volume_backend_name = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] volume_clear = zero {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] volume_clear_ionice = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] volume_clear_size = 0 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] volume_copy_bps_limit = 0 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] volume_dd_blocksize = 1M {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] volume_name_template = volume-%s {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] volume_service_inithost_offload = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] volume_usage_audit_period = month {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] zoning_mode = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_concurrency.disable_process_locking = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] keystone_authtoken.auth_section = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] keystone_authtoken.auth_type = password {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] keystone_authtoken.auth_version = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] keystone_authtoken.cache = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] keystone_authtoken.certfile = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] keystone_authtoken.include_service_catalog = True {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] keystone_authtoken.insecure = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] keystone_authtoken.interface = public {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] keystone_authtoken.keyfile = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] keystone_authtoken.memcache_password = **** {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] keystone_authtoken.memcache_username = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] keystone_authtoken.region_name = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] keystone_authtoken.service_type = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.31/identity {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] cache.backend = dogpile.cache.null {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] cache.backend_argument = **** {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] cache.backend_expiration_time = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] cache.config_prefix = cache.oslo {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] cache.debug_cache_backend = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] cache.enable_retry_client = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] cache.enable_socket_keepalive = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] cache.enabled = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] cache.expiration_time = 600 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] cache.hashclient_retry_attempts = 2 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] cache.memcache_dead_retry = 300 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] cache.memcache_pool_maxsize = 10 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] cache.memcache_sasl_enabled = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] cache.password = **** {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] cache.proxies = [] {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] cache.redis_db = 0 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] cache.redis_server = localhost:6379 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] cache.retry_attempts = 2 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] cache.retry_delay = 0.0 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] cache.socket_keepalive_count = 1 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] cache.socket_keepalive_idle = 1 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] cache.socket_keepalive_interval = 1 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] cache.socket_timeout = 1.0 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] cache.tls_allowed_ciphers = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] cache.tls_cafile = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] cache.tls_certfile = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] cache.tls_enabled = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] cache.tls_keyfile = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] cache.username = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] coordination.backend_url = **** {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] database.asyncio_connection = **** {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] database.asyncio_slave_connection = **** {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] database.backend = sqlalchemy {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] database.connection = **** {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] database.connection_debug = 0 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] database.connection_parameters = {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] database.connection_recycle_time = 3600 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] database.connection_trace = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] database.db_inc_retry_interval = True {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] database.db_max_retries = 20 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] database.db_max_retry_interval = 10 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] database.db_retry_interval = 1 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] database.max_overflow = 50 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] database.max_pool_size = 5 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] database.max_retries = 10 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] database.mysql_wsrep_sync_wait = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] database.pool_timeout = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] database.retry_interval = 10 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] database.slave_connection = **** {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] database.sqlite_synchronous = True {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] database.synchronous_reader = True {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] database.use_db_reconnect = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_messaging_tracing.insecure = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] profiler.connection_string = messaging:// {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] profiler.enabled = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] profiler.es_doc_type = notification {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] profiler.es_scroll_size = 10000 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] profiler.es_scroll_time = 2m {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] profiler.filter_error_trace = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] profiler.hmac_keys = **** {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] profiler.sentinel_service_name = mymaster {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] profiler.socket_timeout = 0.1 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] profiler.trace_requests = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] profiler.trace_sqlalchemy = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] profiler_jaeger.process_tags = {} {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] profiler_jaeger.service_name_prefix = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] profiler_otlp.service_name_prefix = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_policy.enforce_new_defaults = True {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_policy.policy_default_rule = default {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_policy.policy_file = policy.yaml {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] privsep_osbrick.group = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] privsep_osbrick.helper_command = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-f7ce949f-9cb8-45a2-ac69-994ad6159d2d None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86081) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] privsep_osbrick.user = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] cinder_sys_admin.group = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] cinder_sys_admin.helper_command = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.quobyte [None req-f7ce949f-9cb8-45a2-ac69-994ad6159d2d None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.quobyte [None req-f7ce949f-9cb8-45a2-ac69-994ad6159d2d None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] cinder_sys_admin.user = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] service_user.auth_section = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] service_user.auth_type = password {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] service_user.cafile = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f7ce949f-9cb8-45a2-ac69-994ad6159d2d None None] Running cmd (subprocess): mount.quobyte {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] service_user.certfile = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] service_user.collect_timing = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] service_user.insecure = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] service_user.keyfile = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] service_user.send_service_user_token = True {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] service_user.split_loggers = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] service_user.timeout = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] glance.auth_section = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] glance.auth_type = password {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] glance.certfile = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] glance.collect_timing = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] glance.insecure = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] glance.keyfile = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] glance.region_name = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] glance.split_loggers = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] glance.timeout = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.backend_availability_zone = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.chap_password = **** {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.chap_username = {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.disk_geometry = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.driver_client_cert = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.driver_client_cert_key = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.driver_data_namespace = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.driver_use_ssl = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.extra_capabilities = {} {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.filter_function = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.goodness_function = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.iscsi_target_flags = {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.iscsi_write_cache = on {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.iser_helper = tgtadm {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.iser_ip_address = 192.168.122.31 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.iser_port = 3260 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.nas_host = {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.nas_login = admin {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.nas_mount_options = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.nas_password = **** {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.nas_private_key = {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.nas_share_path = {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.num_shell_tries = 3 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.quobyte_volume_url = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.replication_device = **** {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.report_discard_supported = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.reserved_percentage = 0 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.target_helper = tgtadm {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.target_ip_address = 192.168.122.31 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.target_port = 3260 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.target_protocol = iscsi {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.trace_flags = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.unique_fqdn_network = True {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.use_chap_auth = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.volume_backend_name = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.volume_clear = zero {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.volume_clear_ionice = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.volume_clear_size = 0 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_reports.file_event_handler = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_reports.log_dir = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.backend_availability_zone = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.backend_host = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.chap_password = **** {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.chap_username = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.chiscsi_conf = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.disk_geometry = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.driver_client_cert = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.driver_data_namespace = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.driver_use_ssl = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.extra_capabilities = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.filter_function = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.goodness_function = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.iser_helper = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.iser_ip_address = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.iser_port = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.iser_target_prefix = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.nas_host = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.nas_login = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.nas_mount_options = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.nas_password = **** {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.nas_private_key = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.nas_share_path = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.nas_ssh_port = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.num_shell_tries = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.nvmet_port_id = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.replication_device = **** {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.report_discard_supported = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.reserved_percentage = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.scst_target_driver = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.storage_protocol = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack quobyte-client[86082]: Reading configuration file: /etc/quobyte/client.cfg Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.target_helper = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.target_ip_address = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.target_port = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.target_prefix = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.target_protocol = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.trace_flags = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:19 devstack quobyte-client[86082]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.use_chap_auth = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.volume_clear = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.volume_clear_size = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] QuobyteHD.volumes_dir = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_messaging_rabbit.ssl = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f7ce949f-9cb8-45a2-ac69-994ad6159d2d None None] CMD "mount.quobyte" returned: 1 in 0.076s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f7ce949f-9cb8-45a2-ac69-994ad6159d2d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_messaging_notifications.driver = [] {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_messaging_notifications.retry = -1 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f7ce949f-9cb8-45a2-ac69-994ad6159d2d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-f7ce949f-9cb8-45a2-ac69-994ad6159d2d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] key_manager.fixed_key = **** {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] barbican.barbican_api_version = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] barbican.barbican_endpoint = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] barbican.barbican_endpoint_type = public {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] barbican.barbican_region_name = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] barbican.cafile = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] barbican.certfile = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] barbican.collect_timing = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] barbican.insecure = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] barbican.keyfile = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] barbican.number_of_retries = 60 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] barbican.retry_delay = 1 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] barbican.send_service_user_token = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] barbican.split_loggers = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-f7ce949f-9cb8-45a2-ac69-994ad6159d2d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] barbican.timeout = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f7ce949f-9cb8-45a2-ac69-994ad6159d2d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] barbican.verify_ssl = True {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] barbican.verify_ssl_path = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] barbican_service_user.auth_section = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f7ce949f-9cb8-45a2-ac69-994ad6159d2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] barbican_service_user.auth_type = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] barbican_service_user.cafile = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] barbican_service_user.certfile = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] barbican_service_user.collect_timing = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] barbican_service_user.insecure = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] barbican_service_user.keyfile = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] barbican_service_user.split_loggers = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] barbican_service_user.timeout = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] vault.approle_role_id = **** {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] vault.approle_secret_id = **** {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] vault.auth_method = approle {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] vault.auth_path = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] vault.kv_mountpoint = secret {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] vault.kv_path = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] vault.kv_version = 2 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] vault.namespace = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] vault.root_token_id = **** {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] vault.ssl_ca_crt_file = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] vault.timeout = 60.0 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] vault.token_file = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] vault.token_role = None {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] vault.use_ssl = False {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 09:30:20 devstack cinder-volume[85780]: DEBUG oslo_service.backend._eventlet.service [None req-555ec177-ae7b-4824-a113-c3da19b32327 None None] ******************************************************************************** {{(pid=85780) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 28 09:30:20 devstack sudo[86083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:30:20 devstack sudo[86083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:30:20 devstack sudo[86083]: pam_unix(sudo:session): session closed for user root Aug 28 09:30:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f7ce949f-9cb8-45a2-ac69-994ad6159d2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.239s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:30:20 devstack cinder-volume[86081]: INFO cinder.volume.driver [None req-f7ce949f-9cb8-45a2-ac69-994ad6159d2d None None] Driver hasn't implemented _init_vendor_properties() Aug 28 09:30:20 devstack cinder-volume[86081]: DEBUG cinder.volume.driver [None req-f7ce949f-9cb8-45a2-ac69-994ad6159d2d None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.6184768676758, 'free_capacity_gb': 1774.6184768676758, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86081) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 28 09:30:20 devstack cinder-volume[86081]: DEBUG oslo_db.sqlalchemy.engines [None req-f7ce949f-9cb8-45a2-ac69-994ad6159d2d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86081) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 28 09:30:20 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writer thread running {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 28 09:30:20 devstack cinder-volume[86081]: DEBUG cinder.db.api [None req-f7ce949f-9cb8-45a2-ac69-994ad6159d2d None None] Building query based on filter {{(pid=86081) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 28 09:30:20 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-f7ce949f-9cb8-45a2-ac69-994ad6159d2d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86081) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 28 09:30:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f7ce949f-9cb8-45a2-ac69-994ad6159d2d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:30:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f7ce949f-9cb8-45a2-ac69-994ad6159d2d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:30:20 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-f7ce949f-9cb8-45a2-ac69-994ad6159d2d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:30:20 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-f7ce949f-9cb8-45a2-ac69-994ad6159d2d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:30:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f7ce949f-9cb8-45a2-ac69-994ad6159d2d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:30:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f7ce949f-9cb8-45a2-ac69-994ad6159d2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:30:20 devstack cinder-volume[86081]: INFO cinder.keymgr.migration [None req-20bfccfd-1cfc-453d-a49b-53bfe76eaed9 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 28 09:30:20 devstack sudo[86094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:30:20 devstack sudo[86094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:30:20 devstack sudo[86094]: pam_unix(sudo:session): session closed for user root Aug 28 09:30:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f7ce949f-9cb8-45a2-ac69-994ad6159d2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.233s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:30:20 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-f7ce949f-9cb8-45a2-ac69-994ad6159d2d None None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:30:20 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-f7ce949f-9cb8-45a2-ac69-994ad6159d2d None None] Driver initialization completed successfully. Aug 28 09:30:20 devstack cinder-volume[86081]: INFO cinder.manager [None req-f7ce949f-9cb8-45a2-ac69-994ad6159d2d None None] Initiating service 3 cleanup Aug 28 09:30:20 devstack cinder-volume[86081]: INFO cinder.manager [None req-f7ce949f-9cb8-45a2-ac69-994ad6159d2d None None] Service 3 cleanup completed. Aug 28 09:30:20 devstack cinder-volume[86081]: DEBUG cinder.service [None req-f7ce949f-9cb8-45a2-ac69-994ad6159d2d None None] Creating RPC server for service cinder-volume {{(pid=86081) start /opt/stack/cinder/cinder/service.py:231}} Aug 28 09:30:20 devstack cinder-volume[86081]: DEBUG cinder.service [None req-f7ce949f-9cb8-45a2-ac69-994ad6159d2d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86081) start /opt/stack/cinder/cinder/service.py:237}} Aug 28 09:30:20 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-f7ce949f-9cb8-45a2-ac69-994ad6159d2d None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Aug 28 09:30:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f7ce949f-9cb8-45a2-ac69-994ad6159d2d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:30:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f7ce949f-9cb8-45a2-ac69-994ad6159d2d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:30:20 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-f7ce949f-9cb8-45a2-ac69-994ad6159d2d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:30:20 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-f7ce949f-9cb8-45a2-ac69-994ad6159d2d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:30:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f7ce949f-9cb8-45a2-ac69-994ad6159d2d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:30:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f7ce949f-9cb8-45a2-ac69-994ad6159d2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:30:20 devstack sudo[86107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:30:20 devstack sudo[86107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:30:21 devstack sudo[86107]: pam_unix(sudo:session): session closed for user root Aug 28 09:30:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f7ce949f-9cb8-45a2-ac69-994ad6159d2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.232s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:30:21 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-f7ce949f-9cb8-45a2-ac69-994ad6159d2d None None] Driver post RPC initialization completed successfully. Aug 28 09:30:29 devstack cinder-volume[85780]: DEBUG dbcounter [-] [85780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=85780) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:30:30 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writing DB stats cinder:SELECT=2 {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:30:31 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:30:38 devstack cinder-volume[86081]: DEBUG oslo_service.periodic_task [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running periodic task VolumeManager._thread_info {{(pid=86081) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:30:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] thread count: 6 {{(pid=86081) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 09:30:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] thread info: [<_MainThread(MainThread, started 129914189705344)>, , , , , ] {{(pid=86081) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 09:31:19 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-502432a9-44c6-4841-8fe9-c38115c691d1 tempest-TaggedAttachmentsTest-2146882190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:31:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-502432a9-44c6-4841-8fe9-c38115c691d1 tempest-TaggedAttachmentsTest-2146882190 None] Flow 'volume_create_manager' (626fae0b-eb27-4132-9bbf-c82041e62714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:31:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-502432a9-44c6-4841-8fe9-c38115c691d1 tempest-TaggedAttachmentsTest-2146882190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eed3e1fe-19c3-409e-b82e-fbc2c232715a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:31:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-502432a9-44c6-4841-8fe9-c38115c691d1 tempest-TaggedAttachmentsTest-2146882190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eed3e1fe-19c3-409e-b82e-fbc2c232715a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:31:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-367043118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e9db77d-c7b7-4b10-85e8-aa2ea17be1ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84cd819480404c1aa1b9315cd35b06cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:31:19Z,use_quota=True,user_id='5c86aaa77774425e8db776f61df60c93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:31:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-502432a9-44c6-4841-8fe9-c38115c691d1 tempest-TaggedAttachmentsTest-2146882190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53606941-8219-4ed0-9370-6fd59e0e0383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:31:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-502432a9-44c6-4841-8fe9-c38115c691d1 tempest-TaggedAttachmentsTest-2146882190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53606941-8219-4ed0-9370-6fd59e0e0383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:31:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-502432a9-44c6-4841-8fe9-c38115c691d1 tempest-TaggedAttachmentsTest-2146882190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (875e70f4-5c38-4b8a-86f6-dd2ecd31c5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:31:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-502432a9-44c6-4841-8fe9-c38115c691d1 tempest-TaggedAttachmentsTest-2146882190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (875e70f4-5c38-4b8a-86f6-dd2ecd31c5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e9db77d-c7b7-4b10-85e8-aa2ea17be1ad', 'volume_name': 'volume-6e9db77d-c7b7-4b10-85e8-aa2ea17be1ad', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:31:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-502432a9-44c6-4841-8fe9-c38115c691d1 tempest-TaggedAttachmentsTest-2146882190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4a438e6-fd6b-41ba-98b3-31198bfbf791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:31:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-502432a9-44c6-4841-8fe9-c38115c691d1 tempest-TaggedAttachmentsTest-2146882190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4a438e6-fd6b-41ba-98b3-31198bfbf791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:31:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-502432a9-44c6-4841-8fe9-c38115c691d1 tempest-TaggedAttachmentsTest-2146882190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a71ced7-fdf4-4646-876c-49175c53e0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:31:19 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-502432a9-44c6-4841-8fe9-c38115c691d1 tempest-TaggedAttachmentsTest-2146882190 None] Volume 6e9db77d-c7b7-4b10-85e8-aa2ea17be1ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e9db77d-c7b7-4b10-85e8-aa2ea17be1ad', 'volume_size': 1} Aug 28 09:31:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-502432a9-44c6-4841-8fe9-c38115c691d1 tempest-TaggedAttachmentsTest-2146882190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:31:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-502432a9-44c6-4841-8fe9-c38115c691d1 tempest-TaggedAttachmentsTest-2146882190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:31:19 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-502432a9-44c6-4841-8fe9-c38115c691d1 tempest-TaggedAttachmentsTest-2146882190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:31:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-367043118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e9db77d-c7b7-4b10-85e8-aa2ea17be1ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84cd819480404c1aa1b9315cd35b06cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:31:19Z,use_quota=True,user_id='5c86aaa77774425e8db776f61df60c93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:31:19 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-502432a9-44c6-4841-8fe9-c38115c691d1 tempest-TaggedAttachmentsTest-2146882190 None] Creating volume 6e9db77d-c7b7-4b10-85e8-aa2ea17be1ad {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:31:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-502432a9-44c6-4841-8fe9-c38115c691d1 tempest-TaggedAttachmentsTest-2146882190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:31:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-502432a9-44c6-4841-8fe9-c38115c691d1 tempest-TaggedAttachmentsTest-2146882190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:31:19 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-502432a9-44c6-4841-8fe9-c38115c691d1 tempest-TaggedAttachmentsTest-2146882190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:31:19 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-502432a9-44c6-4841-8fe9-c38115c691d1 tempest-TaggedAttachmentsTest-2146882190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:31:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-502432a9-44c6-4841-8fe9-c38115c691d1 tempest-TaggedAttachmentsTest-2146882190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:31:19 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-502432a9-44c6-4841-8fe9-c38115c691d1 tempest-TaggedAttachmentsTest-2146882190 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:31:19 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-502432a9-44c6-4841-8fe9-c38115c691d1 tempest-TaggedAttachmentsTest-2146882190 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:31:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-502432a9-44c6-4841-8fe9-c38115c691d1 tempest-TaggedAttachmentsTest-2146882190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6e9db77d-c7b7-4b10-85e8-aa2ea17be1ad 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:31:19 devstack sudo[86432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6e9db77d-c7b7-4b10-85e8-aa2ea17be1ad 1073741824 Aug 28 09:31:19 devstack sudo[86432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:31:20 devstack sudo[86432]: pam_unix(sudo:session): session closed for user root Aug 28 09:31:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-502432a9-44c6-4841-8fe9-c38115c691d1 tempest-TaggedAttachmentsTest-2146882190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6e9db77d-c7b7-4b10-85e8-aa2ea17be1ad 1073741824" returned: 0 in 0.623s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:31:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-502432a9-44c6-4841-8fe9-c38115c691d1 tempest-TaggedAttachmentsTest-2146882190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6e9db77d-c7b7-4b10-85e8-aa2ea17be1ad {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:31:20 devstack sudo[86770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6e9db77d-c7b7-4b10-85e8-aa2ea17be1ad Aug 28 09:31:20 devstack sudo[86770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:31:20 devstack sudo[86770]: pam_unix(sudo:session): session closed for user root Aug 28 09:31:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-502432a9-44c6-4841-8fe9-c38115c691d1 tempest-TaggedAttachmentsTest-2146882190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6e9db77d-c7b7-4b10-85e8-aa2ea17be1ad" returned: 0 in 0.333s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:31:20 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-502432a9-44c6-4841-8fe9-c38115c691d1 tempest-TaggedAttachmentsTest-2146882190 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:31:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-502432a9-44c6-4841-8fe9-c38115c691d1 tempest-TaggedAttachmentsTest-2146882190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:31:20 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-502432a9-44c6-4841-8fe9-c38115c691d1 tempest-TaggedAttachmentsTest-2146882190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a71ced7-fdf4-4646-876c-49175c53e0cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e9db77d-c7b7-4b10-85e8-aa2ea17be1ad', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:31:20 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-502432a9-44c6-4841-8fe9-c38115c691d1 tempest-TaggedAttachmentsTest-2146882190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93ac224c-83aa-4c95-8938-0b723c711410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:31:20 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-502432a9-44c6-4841-8fe9-c38115c691d1 tempest-TaggedAttachmentsTest-2146882190 None] Volume volume-6e9db77d-c7b7-4b10-85e8-aa2ea17be1ad (6e9db77d-c7b7-4b10-85e8-aa2ea17be1ad): created successfully Aug 28 09:31:20 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-502432a9-44c6-4841-8fe9-c38115c691d1 tempest-TaggedAttachmentsTest-2146882190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93ac224c-83aa-4c95-8938-0b723c711410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:31:20 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-502432a9-44c6-4841-8fe9-c38115c691d1 tempest-TaggedAttachmentsTest-2146882190 None] Flow 'volume_create_manager' (626fae0b-eb27-4132-9bbf-c82041e62714) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:31:20 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-502432a9-44c6-4841-8fe9-c38115c691d1 tempest-TaggedAttachmentsTest-2146882190 None] Created volume successfully. Aug 28 09:31:30 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:31:30 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writing DB stats cinder:UPDATE=5,cinder:SELECT=2,cinder:DELETE=1 {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:31:38 devstack cinder-volume[86081]: DEBUG oslo_service.periodic_task [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86081) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:31:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:31:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:31:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:31:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:31:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:31:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:31:38 devstack sudo[87001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:31:38 devstack sudo[87001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:31:38 devstack sudo[87001]: pam_unix(sudo:session): session closed for user root Aug 28 09:31:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.330s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:31:38 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:31:38 devstack cinder-volume[86081]: DEBUG oslo_service.periodic_task [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running periodic task VolumeManager._thread_info {{(pid=86081) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:31:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] thread count: 6 {{(pid=86081) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 09:31:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] thread info: [<_MainThread(MainThread, started 129914189705344)>, , , , , ] {{(pid=86081) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 09:31:49 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-01a38ebf-820a-4208-8317-6ef2c97ca2ef tempest-VolumesAdminNegativeTest-2082621984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:31:49 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-01a38ebf-820a-4208-8317-6ef2c97ca2ef tempest-VolumesAdminNegativeTest-2082621984 None] Flow 'volume_create_manager' (5bf65147-1f2b-4a46-b589-41cb8d8fc187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:31:49 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-01a38ebf-820a-4208-8317-6ef2c97ca2ef tempest-VolumesAdminNegativeTest-2082621984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95115bb9-1768-4e34-8c4b-70806f04e5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:31:49 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-01a38ebf-820a-4208-8317-6ef2c97ca2ef tempest-VolumesAdminNegativeTest-2082621984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95115bb9-1768-4e34-8c4b-70806f04e5e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-510935526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02689857-9986-4032-b068-22b57dfc7d6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bd9a101c99e4c7fbc598c0c1e16b304',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:31:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:31:49Z,use_quota=True,user_id='1866f0c8d74748d7b8d9a15447c43656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:31:49 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-01a38ebf-820a-4208-8317-6ef2c97ca2ef tempest-VolumesAdminNegativeTest-2082621984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63446be8-2351-4a19-923d-7c39600166d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:31:49 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-01a38ebf-820a-4208-8317-6ef2c97ca2ef tempest-VolumesAdminNegativeTest-2082621984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63446be8-2351-4a19-923d-7c39600166d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:31:49 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-01a38ebf-820a-4208-8317-6ef2c97ca2ef tempest-VolumesAdminNegativeTest-2082621984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a67dec6b-0a06-49cf-a990-982e6be2d9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:31:49 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-01a38ebf-820a-4208-8317-6ef2c97ca2ef tempest-VolumesAdminNegativeTest-2082621984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a67dec6b-0a06-49cf-a990-982e6be2d9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02689857-9986-4032-b068-22b57dfc7d6a', 'volume_name': 'volume-02689857-9986-4032-b068-22b57dfc7d6a', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:31:49 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-01a38ebf-820a-4208-8317-6ef2c97ca2ef tempest-VolumesAdminNegativeTest-2082621984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb8307bb-a753-4d95-89cb-4b3063931341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:31:49 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-01a38ebf-820a-4208-8317-6ef2c97ca2ef tempest-VolumesAdminNegativeTest-2082621984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb8307bb-a753-4d95-89cb-4b3063931341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:31:49 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-01a38ebf-820a-4208-8317-6ef2c97ca2ef tempest-VolumesAdminNegativeTest-2082621984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e46000e-0fc1-42f9-98de-f977b4e60d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:31:49 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-01a38ebf-820a-4208-8317-6ef2c97ca2ef tempest-VolumesAdminNegativeTest-2082621984 None] Volume 02689857-9986-4032-b068-22b57dfc7d6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02689857-9986-4032-b068-22b57dfc7d6a', 'volume_size': 1} Aug 28 09:31:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-01a38ebf-820a-4208-8317-6ef2c97ca2ef tempest-VolumesAdminNegativeTest-2082621984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:31:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-01a38ebf-820a-4208-8317-6ef2c97ca2ef tempest-VolumesAdminNegativeTest-2082621984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:31:49 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-01a38ebf-820a-4208-8317-6ef2c97ca2ef tempest-VolumesAdminNegativeTest-2082621984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-510935526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02689857-9986-4032-b068-22b57dfc7d6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bd9a101c99e4c7fbc598c0c1e16b304',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:31:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:31:49Z,use_quota=True,user_id='1866f0c8d74748d7b8d9a15447c43656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:31:49 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-01a38ebf-820a-4208-8317-6ef2c97ca2ef tempest-VolumesAdminNegativeTest-2082621984 None] Creating volume 02689857-9986-4032-b068-22b57dfc7d6a {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:31:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-01a38ebf-820a-4208-8317-6ef2c97ca2ef tempest-VolumesAdminNegativeTest-2082621984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:31:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-01a38ebf-820a-4208-8317-6ef2c97ca2ef tempest-VolumesAdminNegativeTest-2082621984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:31:49 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-01a38ebf-820a-4208-8317-6ef2c97ca2ef tempest-VolumesAdminNegativeTest-2082621984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:31:49 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-01a38ebf-820a-4208-8317-6ef2c97ca2ef tempest-VolumesAdminNegativeTest-2082621984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:31:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-01a38ebf-820a-4208-8317-6ef2c97ca2ef tempest-VolumesAdminNegativeTest-2082621984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:31:49 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-01a38ebf-820a-4208-8317-6ef2c97ca2ef tempest-VolumesAdminNegativeTest-2082621984 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:31:49 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-01a38ebf-820a-4208-8317-6ef2c97ca2ef tempest-VolumesAdminNegativeTest-2082621984 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:31:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-01a38ebf-820a-4208-8317-6ef2c97ca2ef tempest-VolumesAdminNegativeTest-2082621984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-02689857-9986-4032-b068-22b57dfc7d6a 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:31:49 devstack sudo[87203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-02689857-9986-4032-b068-22b57dfc7d6a 1073741824 Aug 28 09:31:49 devstack sudo[87203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:31:50 devstack sudo[87203]: pam_unix(sudo:session): session closed for user root Aug 28 09:31:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-01a38ebf-820a-4208-8317-6ef2c97ca2ef tempest-VolumesAdminNegativeTest-2082621984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-02689857-9986-4032-b068-22b57dfc7d6a 1073741824" returned: 0 in 1.030s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:31:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-01a38ebf-820a-4208-8317-6ef2c97ca2ef tempest-VolumesAdminNegativeTest-2082621984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-02689857-9986-4032-b068-22b57dfc7d6a {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:31:50 devstack sudo[87212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-02689857-9986-4032-b068-22b57dfc7d6a Aug 28 09:31:50 devstack sudo[87212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:31:51 devstack sudo[87212]: pam_unix(sudo:session): session closed for user root Aug 28 09:31:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-01a38ebf-820a-4208-8317-6ef2c97ca2ef tempest-VolumesAdminNegativeTest-2082621984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-02689857-9986-4032-b068-22b57dfc7d6a" returned: 0 in 0.773s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:31:51 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-01a38ebf-820a-4208-8317-6ef2c97ca2ef tempest-VolumesAdminNegativeTest-2082621984 None] <== create_volume: return (1934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:31:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-01a38ebf-820a-4208-8317-6ef2c97ca2ef tempest-VolumesAdminNegativeTest-2082621984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.938s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:31:51 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-01a38ebf-820a-4208-8317-6ef2c97ca2ef tempest-VolumesAdminNegativeTest-2082621984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e46000e-0fc1-42f9-98de-f977b4e60d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02689857-9986-4032-b068-22b57dfc7d6a', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:31:51 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-01a38ebf-820a-4208-8317-6ef2c97ca2ef tempest-VolumesAdminNegativeTest-2082621984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21032262-6d3a-4f66-b1d8-cf42cc329c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:31:51 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-01a38ebf-820a-4208-8317-6ef2c97ca2ef tempest-VolumesAdminNegativeTest-2082621984 None] Volume volume-02689857-9986-4032-b068-22b57dfc7d6a (02689857-9986-4032-b068-22b57dfc7d6a): created successfully Aug 28 09:31:51 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-01a38ebf-820a-4208-8317-6ef2c97ca2ef tempest-VolumesAdminNegativeTest-2082621984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21032262-6d3a-4f66-b1d8-cf42cc329c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:31:51 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-01a38ebf-820a-4208-8317-6ef2c97ca2ef tempest-VolumesAdminNegativeTest-2082621984 None] Flow 'volume_create_manager' (5bf65147-1f2b-4a46-b589-41cb8d8fc187) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:31:51 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-01a38ebf-820a-4208-8317-6ef2c97ca2ef tempest-VolumesAdminNegativeTest-2082621984 None] Created volume successfully. Aug 28 09:31:53 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-013ba332-13ce-4da1-8f69-210a69438084 tempest-VolumesAdminNegativeTest-2082621984 None] Acquiring lock "cinder-02689857-9986-4032-b068-22b57dfc7d6a-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:31:53 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-013ba332-13ce-4da1-8f69-210a69438084 tempest-VolumesAdminNegativeTest-2082621984 None] Lock "cinder-02689857-9986-4032-b068-22b57dfc7d6a-delete_volume" acquired by "delete_volume" :: waited 0.114s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:31:53 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-013ba332-13ce-4da1-8f69-210a69438084 tempest-VolumesAdminNegativeTest-2082621984 None] Acquiring lock "cinder-quobyte-02689857-9986-4032-b068-22b57dfc7d6a" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:31:53 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-013ba332-13ce-4da1-8f69-210a69438084 tempest-VolumesAdminNegativeTest-2082621984 None] Lock "cinder-quobyte-02689857-9986-4032-b068-22b57dfc7d6a" acquired by "delete_volume" :: waited 0.043s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:31:53 devstack cinder-volume[86081]: INFO oslo.privsep.daemon [None req-013ba332-13ce-4da1-8f69-210a69438084 tempest-VolumesAdminNegativeTest-2082621984 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp4m54mx27/privsep.sock'] Aug 28 09:31:53 devstack sudo[87216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp4m54mx27/privsep.sock Aug 28 09:31:53 devstack sudo[87216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:31:55 devstack cinder-volume[86081]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Aug 28 09:31:55 devstack cinder-volume[86081]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 28 09:31:55 devstack cinder-volume[86081]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Aug 28 09:31:55 devstack cinder-volume[86081]: WARNING oslo.privsep.daemon [-] privsep log: Aug 28 09:31:55 devstack cinder-volume[86081]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Aug 28 09:31:55 devstack cinder-volume[86081]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Aug 28 09:31:55 devstack cinder-volume[86081]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 28 09:31:55 devstack cinder-volume[86081]: WARNING oslo.privsep.daemon [-] privsep log: Aug 28 09:31:55 devstack cinder-volume[86081]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Aug 28 09:31:55 devstack sudo[87216]: pam_unix(sudo:session): session closed for user root Aug 28 09:31:55 devstack cinder-volume[86081]: INFO oslo.privsep.daemon [None req-013ba332-13ce-4da1-8f69-210a69438084 tempest-VolumesAdminNegativeTest-2082621984 None] Spawned new privsep daemon via rootwrap Aug 28 09:31:55 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [None req-013ba332-13ce-4da1-8f69-210a69438084 tempest-VolumesAdminNegativeTest-2082621984 None] Accepted privsep connection to /tmp/tmp4m54mx27/privsep.sock {{(pid=86081) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Aug 28 09:31:55 devstack cinder-volume[86081]: INFO oslo.privsep.daemon [-] privsep daemon starting Aug 28 09:31:55 devstack cinder-volume[86081]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Aug 28 09:31:55 devstack cinder-volume[86081]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Aug 28 09:31:55 devstack cinder-volume[86081]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87219 Aug 28 09:31:55 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[5072d180-6bd9-4b73-86c6-d73e48386785]: (2,) {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:31:55 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[f014ac92-4d75-4c08-b6f9-fb59c0d3d35b]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:31:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-013ba332-13ce-4da1-8f69-210a69438084 tempest-VolumesAdminNegativeTest-2082621984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-02689857-9986-4032-b068-22b57dfc7d6a {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:31:55 devstack sudo[87223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-02689857-9986-4032-b068-22b57dfc7d6a Aug 28 09:31:55 devstack sudo[87223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:31:56 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb4a456a-bc4e-4e22-9b7a-cd8708b11105 tempest-VolumesTestJSON-1789704692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:31:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-bb4a456a-bc4e-4e22-9b7a-cd8708b11105 tempest-VolumesTestJSON-1789704692 None] Flow 'volume_create_manager' (449d8fe2-017c-4c5d-a405-bb6119851afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:31:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-bb4a456a-bc4e-4e22-9b7a-cd8708b11105 tempest-VolumesTestJSON-1789704692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20f14881-9624-4724-90e4-f1ecb8ee4187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:31:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-bb4a456a-bc4e-4e22-9b7a-cd8708b11105 tempest-VolumesTestJSON-1789704692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20f14881-9624-4724-90e4-f1ecb8ee4187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:31:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2008471244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3400d519-8bc6-4e15-88d8-98bda57fbe0c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0c5a9390e8ff45e6bdabaaf00316daa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:31:56Z,use_quota=True,user_id='1f0fb24903d44d94af25395fc3558091',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:31:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-bb4a456a-bc4e-4e22-9b7a-cd8708b11105 tempest-VolumesTestJSON-1789704692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (806834a2-dff2-4c48-8220-fb97938426c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:31:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-bb4a456a-bc4e-4e22-9b7a-cd8708b11105 tempest-VolumesTestJSON-1789704692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (806834a2-dff2-4c48-8220-fb97938426c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:31:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-bb4a456a-bc4e-4e22-9b7a-cd8708b11105 tempest-VolumesTestJSON-1789704692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c6edf02-46d9-48fe-8567-8483ac561bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:31:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-bb4a456a-bc4e-4e22-9b7a-cd8708b11105 tempest-VolumesTestJSON-1789704692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c6edf02-46d9-48fe-8567-8483ac561bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3400d519-8bc6-4e15-88d8-98bda57fbe0c', 'volume_name': 'volume-3400d519-8bc6-4e15-88d8-98bda57fbe0c', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:31:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-bb4a456a-bc4e-4e22-9b7a-cd8708b11105 tempest-VolumesTestJSON-1789704692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab985e1a-3f2b-41a2-b9c2-83c693d71a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:31:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-bb4a456a-bc4e-4e22-9b7a-cd8708b11105 tempest-VolumesTestJSON-1789704692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab985e1a-3f2b-41a2-b9c2-83c693d71a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:31:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-bb4a456a-bc4e-4e22-9b7a-cd8708b11105 tempest-VolumesTestJSON-1789704692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a6acbfb-6c07-4c76-a7d4-3e7db6f4b1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:31:56 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-bb4a456a-bc4e-4e22-9b7a-cd8708b11105 tempest-VolumesTestJSON-1789704692 None] Volume 3400d519-8bc6-4e15-88d8-98bda57fbe0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3400d519-8bc6-4e15-88d8-98bda57fbe0c', 'volume_size': 1} Aug 28 09:31:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-bb4a456a-bc4e-4e22-9b7a-cd8708b11105 tempest-VolumesTestJSON-1789704692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:31:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-bb4a456a-bc4e-4e22-9b7a-cd8708b11105 tempest-VolumesTestJSON-1789704692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:31:56 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-bb4a456a-bc4e-4e22-9b7a-cd8708b11105 tempest-VolumesTestJSON-1789704692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:31:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2008471244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3400d519-8bc6-4e15-88d8-98bda57fbe0c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0c5a9390e8ff45e6bdabaaf00316daa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:31:56Z,use_quota=True,user_id='1f0fb24903d44d94af25395fc3558091',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:31:56 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-bb4a456a-bc4e-4e22-9b7a-cd8708b11105 tempest-VolumesTestJSON-1789704692 None] Creating volume 3400d519-8bc6-4e15-88d8-98bda57fbe0c {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:31:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-bb4a456a-bc4e-4e22-9b7a-cd8708b11105 tempest-VolumesTestJSON-1789704692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:31:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-bb4a456a-bc4e-4e22-9b7a-cd8708b11105 tempest-VolumesTestJSON-1789704692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:31:56 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-bb4a456a-bc4e-4e22-9b7a-cd8708b11105 tempest-VolumesTestJSON-1789704692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:31:56 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-bb4a456a-bc4e-4e22-9b7a-cd8708b11105 tempest-VolumesTestJSON-1789704692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:31:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-bb4a456a-bc4e-4e22-9b7a-cd8708b11105 tempest-VolumesTestJSON-1789704692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:31:56 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-bb4a456a-bc4e-4e22-9b7a-cd8708b11105 tempest-VolumesTestJSON-1789704692 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:31:56 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-bb4a456a-bc4e-4e22-9b7a-cd8708b11105 tempest-VolumesTestJSON-1789704692 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:31:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bb4a456a-bc4e-4e22-9b7a-cd8708b11105 tempest-VolumesTestJSON-1789704692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3400d519-8bc6-4e15-88d8-98bda57fbe0c 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:31:56 devstack sudo[87228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3400d519-8bc6-4e15-88d8-98bda57fbe0c 1073741824 Aug 28 09:31:56 devstack sudo[87228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:31:56 devstack sudo[87223]: pam_unix(sudo:session): session closed for user root Aug 28 09:31:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-013ba332-13ce-4da1-8f69-210a69438084 tempest-VolumesAdminNegativeTest-2082621984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-02689857-9986-4032-b068-22b57dfc7d6a" returned: 0 in 0.982s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:31:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-013ba332-13ce-4da1-8f69-210a69438084 tempest-VolumesAdminNegativeTest-2082621984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-02689857-9986-4032-b068-22b57dfc7d6a {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:31:56 devstack sudo[87231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-02689857-9986-4032-b068-22b57dfc7d6a Aug 28 09:31:56 devstack sudo[87231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:31:57 devstack sudo[87231]: pam_unix(sudo:session): session closed for user root Aug 28 09:31:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-013ba332-13ce-4da1-8f69-210a69438084 tempest-VolumesAdminNegativeTest-2082621984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-02689857-9986-4032-b068-22b57dfc7d6a" returned: 0 in 0.523s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:31:57 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-013ba332-13ce-4da1-8f69-210a69438084 tempest-VolumesAdminNegativeTest-2082621984 None] Lock "cinder-quobyte-02689857-9986-4032-b068-22b57dfc7d6a" released by "delete_volume" :: held 3.958s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:31:57 devstack sudo[87228]: pam_unix(sudo:session): session closed for user root Aug 28 09:31:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bb4a456a-bc4e-4e22-9b7a-cd8708b11105 tempest-VolumesTestJSON-1789704692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3400d519-8bc6-4e15-88d8-98bda57fbe0c 1073741824" returned: 0 in 0.724s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:31:57 devstack cinder-volume[86081]: WARNING cinder.quota [None req-013ba332-13ce-4da1-8f69-210a69438084 tempest-VolumesAdminNegativeTest-2082621984 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 28 09:31:57 devstack cinder-volume[86081]: WARNING cinder.quota [None req-013ba332-13ce-4da1-8f69-210a69438084 tempest-VolumesAdminNegativeTest-2082621984 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 28 09:31:57 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-013ba332-13ce-4da1-8f69-210a69438084 tempest-VolumesAdminNegativeTest-2082621984 None] Created reservations ['a1ec07be-0ba9-4fe8-8101-c8b24b4ca94f', '61d0bcc2-ef54-4bb7-a80f-0180102d887e', '77b73043-0a5c-439d-a0d9-6be20b567fc7', 'd749a3e8-9102-4399-b4d3-3d2022fde7e5'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:31:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bb4a456a-bc4e-4e22-9b7a-cd8708b11105 tempest-VolumesTestJSON-1789704692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3400d519-8bc6-4e15-88d8-98bda57fbe0c {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:31:57 devstack sudo[87280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3400d519-8bc6-4e15-88d8-98bda57fbe0c Aug 28 09:31:57 devstack sudo[87280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:31:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-013ba332-13ce-4da1-8f69-210a69438084 tempest-VolumesAdminNegativeTest-2082621984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:31:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-013ba332-13ce-4da1-8f69-210a69438084 tempest-VolumesAdminNegativeTest-2082621984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:31:57 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-013ba332-13ce-4da1-8f69-210a69438084 tempest-VolumesAdminNegativeTest-2082621984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:31:57 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-013ba332-13ce-4da1-8f69-210a69438084 tempest-VolumesAdminNegativeTest-2082621984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:31:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-013ba332-13ce-4da1-8f69-210a69438084 tempest-VolumesAdminNegativeTest-2082621984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:31:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-013ba332-13ce-4da1-8f69-210a69438084 tempest-VolumesAdminNegativeTest-2082621984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:31:57 devstack sudo[87309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:31:57 devstack sudo[87309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:31:58 devstack sudo[87280]: pam_unix(sudo:session): session closed for user root Aug 28 09:31:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bb4a456a-bc4e-4e22-9b7a-cd8708b11105 tempest-VolumesTestJSON-1789704692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3400d519-8bc6-4e15-88d8-98bda57fbe0c" returned: 0 in 0.589s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:31:58 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-bb4a456a-bc4e-4e22-9b7a-cd8708b11105 tempest-VolumesTestJSON-1789704692 None] <== create_volume: return (1553ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:31:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-bb4a456a-bc4e-4e22-9b7a-cd8708b11105 tempest-VolumesTestJSON-1789704692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:31:58 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-bb4a456a-bc4e-4e22-9b7a-cd8708b11105 tempest-VolumesTestJSON-1789704692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a6acbfb-6c07-4c76-a7d4-3e7db6f4b1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3400d519-8bc6-4e15-88d8-98bda57fbe0c', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:31:58 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-bb4a456a-bc4e-4e22-9b7a-cd8708b11105 tempest-VolumesTestJSON-1789704692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c4d4488-1c13-4ada-94e0-357ba2e54452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:31:58 devstack sudo[87309]: pam_unix(sudo:session): session closed for user root Aug 28 09:31:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-013ba332-13ce-4da1-8f69-210a69438084 tempest-VolumesAdminNegativeTest-2082621984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.561s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:31:58 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-bb4a456a-bc4e-4e22-9b7a-cd8708b11105 tempest-VolumesTestJSON-1789704692 None] Volume volume-3400d519-8bc6-4e15-88d8-98bda57fbe0c (3400d519-8bc6-4e15-88d8-98bda57fbe0c): created successfully Aug 28 09:31:58 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-bb4a456a-bc4e-4e22-9b7a-cd8708b11105 tempest-VolumesTestJSON-1789704692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c4d4488-1c13-4ada-94e0-357ba2e54452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:31:58 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-bb4a456a-bc4e-4e22-9b7a-cd8708b11105 tempest-VolumesTestJSON-1789704692 None] Flow 'volume_create_manager' (449d8fe2-017c-4c5d-a405-bb6119851afd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:31:58 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-013ba332-13ce-4da1-8f69-210a69438084 tempest-VolumesAdminNegativeTest-2082621984 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:31:58 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-013ba332-13ce-4da1-8f69-210a69438084 tempest-VolumesAdminNegativeTest-2082621984 None] Deleted volume successfully. Aug 28 09:31:58 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-bb4a456a-bc4e-4e22-9b7a-cd8708b11105 tempest-VolumesTestJSON-1789704692 None] Created volume successfully. Aug 28 09:31:58 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-013ba332-13ce-4da1-8f69-210a69438084 tempest-VolumesAdminNegativeTest-2082621984 None] Lock "cinder-02689857-9986-4032-b068-22b57dfc7d6a-delete_volume" released by "delete_volume" :: held 5.235s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:32:00 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b444c12-ab58-409b-a738-9f5ca482f105 tempest-VolumesTestJSON-1789704692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:32:00 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2b444c12-ab58-409b-a738-9f5ca482f105 tempest-VolumesTestJSON-1789704692 None] Flow 'volume_create_manager' (8358331f-396d-48a5-89f7-42beff10225e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:32:00 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2b444c12-ab58-409b-a738-9f5ca482f105 tempest-VolumesTestJSON-1789704692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8800acb-fcaa-46c7-a849-c6d419188348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:32:00 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2b444c12-ab58-409b-a738-9f5ca482f105 tempest-VolumesTestJSON-1789704692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8800acb-fcaa-46c7-a849-c6d419188348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:32:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1603445613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f895f40-c0f5-4c91-b1b0-8cc1af3c1981,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0c5a9390e8ff45e6bdabaaf00316daa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:32:00Z,use_quota=True,user_id='1f0fb24903d44d94af25395fc3558091',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:32:00 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2b444c12-ab58-409b-a738-9f5ca482f105 tempest-VolumesTestJSON-1789704692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb8dc9c5-d72d-4ba5-b102-e32e68f8dda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:32:00 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2b444c12-ab58-409b-a738-9f5ca482f105 tempest-VolumesTestJSON-1789704692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb8dc9c5-d72d-4ba5-b102-e32e68f8dda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:32:00 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2b444c12-ab58-409b-a738-9f5ca482f105 tempest-VolumesTestJSON-1789704692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8cd25a8-836f-4793-bb14-2b0bcd92b741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:32:00 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2b444c12-ab58-409b-a738-9f5ca482f105 tempest-VolumesTestJSON-1789704692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8cd25a8-836f-4793-bb14-2b0bcd92b741) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f895f40-c0f5-4c91-b1b0-8cc1af3c1981', 'volume_name': 'volume-8f895f40-c0f5-4c91-b1b0-8cc1af3c1981', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:32:00 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2b444c12-ab58-409b-a738-9f5ca482f105 tempest-VolumesTestJSON-1789704692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35bbb66f-2825-414e-ad70-e98f5b28a426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:32:00 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2b444c12-ab58-409b-a738-9f5ca482f105 tempest-VolumesTestJSON-1789704692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35bbb66f-2825-414e-ad70-e98f5b28a426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:32:00 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2b444c12-ab58-409b-a738-9f5ca482f105 tempest-VolumesTestJSON-1789704692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4bf2379-36a6-4b0c-a6ff-a0009d24bf35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:32:00 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-2b444c12-ab58-409b-a738-9f5ca482f105 tempest-VolumesTestJSON-1789704692 None] Volume 8f895f40-c0f5-4c91-b1b0-8cc1af3c1981: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f895f40-c0f5-4c91-b1b0-8cc1af3c1981', 'volume_size': 1} Aug 28 09:32:00 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-2b444c12-ab58-409b-a738-9f5ca482f105 tempest-VolumesTestJSON-1789704692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:32:00 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-2b444c12-ab58-409b-a738-9f5ca482f105 tempest-VolumesTestJSON-1789704692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:32:00 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-2b444c12-ab58-409b-a738-9f5ca482f105 tempest-VolumesTestJSON-1789704692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:32:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1603445613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f895f40-c0f5-4c91-b1b0-8cc1af3c1981,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0c5a9390e8ff45e6bdabaaf00316daa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:32:00Z,use_quota=True,user_id='1f0fb24903d44d94af25395fc3558091',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:32:00 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-2b444c12-ab58-409b-a738-9f5ca482f105 tempest-VolumesTestJSON-1789704692 None] Creating volume 8f895f40-c0f5-4c91-b1b0-8cc1af3c1981 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:32:00 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-2b444c12-ab58-409b-a738-9f5ca482f105 tempest-VolumesTestJSON-1789704692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:32:00 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-2b444c12-ab58-409b-a738-9f5ca482f105 tempest-VolumesTestJSON-1789704692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:32:00 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-2b444c12-ab58-409b-a738-9f5ca482f105 tempest-VolumesTestJSON-1789704692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:32:00 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-2b444c12-ab58-409b-a738-9f5ca482f105 tempest-VolumesTestJSON-1789704692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:32:00 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-2b444c12-ab58-409b-a738-9f5ca482f105 tempest-VolumesTestJSON-1789704692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:32:00 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-2b444c12-ab58-409b-a738-9f5ca482f105 tempest-VolumesTestJSON-1789704692 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:32:00 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-2b444c12-ab58-409b-a738-9f5ca482f105 tempest-VolumesTestJSON-1789704692 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:32:00 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2b444c12-ab58-409b-a738-9f5ca482f105 tempest-VolumesTestJSON-1789704692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8f895f40-c0f5-4c91-b1b0-8cc1af3c1981 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:32:00 devstack sudo[87344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8f895f40-c0f5-4c91-b1b0-8cc1af3c1981 1073741824 Aug 28 09:32:00 devstack sudo[87344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:32:00 devstack sudo[87344]: pam_unix(sudo:session): session closed for user root Aug 28 09:32:00 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2b444c12-ab58-409b-a738-9f5ca482f105 tempest-VolumesTestJSON-1789704692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8f895f40-c0f5-4c91-b1b0-8cc1af3c1981 1073741824" returned: 0 in 0.447s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:32:00 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2b444c12-ab58-409b-a738-9f5ca482f105 tempest-VolumesTestJSON-1789704692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8f895f40-c0f5-4c91-b1b0-8cc1af3c1981 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:32:00 devstack sudo[87349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8f895f40-c0f5-4c91-b1b0-8cc1af3c1981 Aug 28 09:32:00 devstack sudo[87349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:32:01 devstack sudo[87349]: pam_unix(sudo:session): session closed for user root Aug 28 09:32:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2b444c12-ab58-409b-a738-9f5ca482f105 tempest-VolumesTestJSON-1789704692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8f895f40-c0f5-4c91-b1b0-8cc1af3c1981" returned: 0 in 0.259s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:32:01 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-2b444c12-ab58-409b-a738-9f5ca482f105 tempest-VolumesTestJSON-1789704692 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:32:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-2b444c12-ab58-409b-a738-9f5ca482f105 tempest-VolumesTestJSON-1789704692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:32:01 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2b444c12-ab58-409b-a738-9f5ca482f105 tempest-VolumesTestJSON-1789704692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4bf2379-36a6-4b0c-a6ff-a0009d24bf35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f895f40-c0f5-4c91-b1b0-8cc1af3c1981', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:32:01 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2b444c12-ab58-409b-a738-9f5ca482f105 tempest-VolumesTestJSON-1789704692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a8927b2-4665-433e-9adb-b483c1b2a223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:32:01 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-2b444c12-ab58-409b-a738-9f5ca482f105 tempest-VolumesTestJSON-1789704692 None] Volume volume-8f895f40-c0f5-4c91-b1b0-8cc1af3c1981 (8f895f40-c0f5-4c91-b1b0-8cc1af3c1981): created successfully Aug 28 09:32:01 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2b444c12-ab58-409b-a738-9f5ca482f105 tempest-VolumesTestJSON-1789704692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a8927b2-4665-433e-9adb-b483c1b2a223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:32:01 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2b444c12-ab58-409b-a738-9f5ca482f105 tempest-VolumesTestJSON-1789704692 None] Flow 'volume_create_manager' (8358331f-396d-48a5-89f7-42beff10225e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:32:01 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-2b444c12-ab58-409b-a738-9f5ca482f105 tempest-VolumesTestJSON-1789704692 None] Created volume successfully. Aug 28 09:32:02 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c7a13e8-e182-437c-8e88-cb9862e87b78 tempest-VolumesTestJSON-1789704692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:32:02 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7c7a13e8-e182-437c-8e88-cb9862e87b78 tempest-VolumesTestJSON-1789704692 None] Flow 'volume_create_manager' (85a0e43d-aa06-45a9-be37-4fad845ffa0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:32:02 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7c7a13e8-e182-437c-8e88-cb9862e87b78 tempest-VolumesTestJSON-1789704692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b88ca35-60e1-4e91-a888-364ba3d95270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:32:02 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7c7a13e8-e182-437c-8e88-cb9862e87b78 tempest-VolumesTestJSON-1789704692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b88ca35-60e1-4e91-a888-364ba3d95270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:32:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-30527729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfdeee22-4cb9-4e6b-9d5b-3cf601aced45,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0c5a9390e8ff45e6bdabaaf00316daa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:32:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:32:02Z,use_quota=True,user_id='1f0fb24903d44d94af25395fc3558091',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:32:02 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7c7a13e8-e182-437c-8e88-cb9862e87b78 tempest-VolumesTestJSON-1789704692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (159aabf4-ebdd-452c-9925-1798ce8b4396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:32:02 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7c7a13e8-e182-437c-8e88-cb9862e87b78 tempest-VolumesTestJSON-1789704692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (159aabf4-ebdd-452c-9925-1798ce8b4396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:32:02 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7c7a13e8-e182-437c-8e88-cb9862e87b78 tempest-VolumesTestJSON-1789704692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2da35d4c-d2ee-49c8-9c93-e1c8d5a9af72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:32:02 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7c7a13e8-e182-437c-8e88-cb9862e87b78 tempest-VolumesTestJSON-1789704692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2da35d4c-d2ee-49c8-9c93-e1c8d5a9af72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfdeee22-4cb9-4e6b-9d5b-3cf601aced45', 'volume_name': 'volume-bfdeee22-4cb9-4e6b-9d5b-3cf601aced45', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:32:02 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7c7a13e8-e182-437c-8e88-cb9862e87b78 tempest-VolumesTestJSON-1789704692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (063ceaaf-ff96-459e-bdde-463fcbaac14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:32:02 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7c7a13e8-e182-437c-8e88-cb9862e87b78 tempest-VolumesTestJSON-1789704692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (063ceaaf-ff96-459e-bdde-463fcbaac14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:32:02 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7c7a13e8-e182-437c-8e88-cb9862e87b78 tempest-VolumesTestJSON-1789704692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ddcaf69-02f9-41da-a33f-aba9a63b43a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:32:02 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-7c7a13e8-e182-437c-8e88-cb9862e87b78 tempest-VolumesTestJSON-1789704692 None] Volume bfdeee22-4cb9-4e6b-9d5b-3cf601aced45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfdeee22-4cb9-4e6b-9d5b-3cf601aced45', 'volume_size': 1} Aug 28 09:32:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-7c7a13e8-e182-437c-8e88-cb9862e87b78 tempest-VolumesTestJSON-1789704692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:32:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-7c7a13e8-e182-437c-8e88-cb9862e87b78 tempest-VolumesTestJSON-1789704692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:32:02 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-7c7a13e8-e182-437c-8e88-cb9862e87b78 tempest-VolumesTestJSON-1789704692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:32:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-30527729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfdeee22-4cb9-4e6b-9d5b-3cf601aced45,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0c5a9390e8ff45e6bdabaaf00316daa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:32:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:32:02Z,use_quota=True,user_id='1f0fb24903d44d94af25395fc3558091',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:32:02 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-7c7a13e8-e182-437c-8e88-cb9862e87b78 tempest-VolumesTestJSON-1789704692 None] Creating volume bfdeee22-4cb9-4e6b-9d5b-3cf601aced45 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:32:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-7c7a13e8-e182-437c-8e88-cb9862e87b78 tempest-VolumesTestJSON-1789704692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:32:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-7c7a13e8-e182-437c-8e88-cb9862e87b78 tempest-VolumesTestJSON-1789704692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:32:02 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-7c7a13e8-e182-437c-8e88-cb9862e87b78 tempest-VolumesTestJSON-1789704692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:32:02 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-7c7a13e8-e182-437c-8e88-cb9862e87b78 tempest-VolumesTestJSON-1789704692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:32:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-7c7a13e8-e182-437c-8e88-cb9862e87b78 tempest-VolumesTestJSON-1789704692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:32:02 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-7c7a13e8-e182-437c-8e88-cb9862e87b78 tempest-VolumesTestJSON-1789704692 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:32:02 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-7c7a13e8-e182-437c-8e88-cb9862e87b78 tempest-VolumesTestJSON-1789704692 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:32:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7c7a13e8-e182-437c-8e88-cb9862e87b78 tempest-VolumesTestJSON-1789704692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bfdeee22-4cb9-4e6b-9d5b-3cf601aced45 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:32:02 devstack sudo[87359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bfdeee22-4cb9-4e6b-9d5b-3cf601aced45 1073741824 Aug 28 09:32:02 devstack sudo[87359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:32:02 devstack sudo[87359]: pam_unix(sudo:session): session closed for user root Aug 28 09:32:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7c7a13e8-e182-437c-8e88-cb9862e87b78 tempest-VolumesTestJSON-1789704692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bfdeee22-4cb9-4e6b-9d5b-3cf601aced45 1073741824" returned: 0 in 0.443s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:32:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7c7a13e8-e182-437c-8e88-cb9862e87b78 tempest-VolumesTestJSON-1789704692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bfdeee22-4cb9-4e6b-9d5b-3cf601aced45 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:32:02 devstack sudo[87364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bfdeee22-4cb9-4e6b-9d5b-3cf601aced45 Aug 28 09:32:02 devstack sudo[87364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:32:03 devstack sudo[87364]: pam_unix(sudo:session): session closed for user root Aug 28 09:32:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7c7a13e8-e182-437c-8e88-cb9862e87b78 tempest-VolumesTestJSON-1789704692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bfdeee22-4cb9-4e6b-9d5b-3cf601aced45" returned: 0 in 0.393s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:32:03 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-7c7a13e8-e182-437c-8e88-cb9862e87b78 tempest-VolumesTestJSON-1789704692 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:32:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-7c7a13e8-e182-437c-8e88-cb9862e87b78 tempest-VolumesTestJSON-1789704692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:32:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7c7a13e8-e182-437c-8e88-cb9862e87b78 tempest-VolumesTestJSON-1789704692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ddcaf69-02f9-41da-a33f-aba9a63b43a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfdeee22-4cb9-4e6b-9d5b-3cf601aced45', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:32:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7c7a13e8-e182-437c-8e88-cb9862e87b78 tempest-VolumesTestJSON-1789704692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f284677-bba2-44d7-9bcc-a8466b349954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:32:03 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-7c7a13e8-e182-437c-8e88-cb9862e87b78 tempest-VolumesTestJSON-1789704692 None] Volume volume-bfdeee22-4cb9-4e6b-9d5b-3cf601aced45 (bfdeee22-4cb9-4e6b-9d5b-3cf601aced45): created successfully Aug 28 09:32:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7c7a13e8-e182-437c-8e88-cb9862e87b78 tempest-VolumesTestJSON-1789704692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f284677-bba2-44d7-9bcc-a8466b349954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:32:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7c7a13e8-e182-437c-8e88-cb9862e87b78 tempest-VolumesTestJSON-1789704692 None] Flow 'volume_create_manager' (85a0e43d-aa06-45a9-be37-4fad845ffa0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:32:03 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-7c7a13e8-e182-437c-8e88-cb9862e87b78 tempest-VolumesTestJSON-1789704692 None] Created volume successfully. Aug 28 09:32:05 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e4ec1de6-952b-4096-ab5b-36ae393895d1 tempest-VolumesTestJSON-1789704692 None] Acquiring lock "cinder-bfdeee22-4cb9-4e6b-9d5b-3cf601aced45-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:32:05 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e4ec1de6-952b-4096-ab5b-36ae393895d1 tempest-VolumesTestJSON-1789704692 None] Lock "cinder-bfdeee22-4cb9-4e6b-9d5b-3cf601aced45-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:32:05 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e4ec1de6-952b-4096-ab5b-36ae393895d1 tempest-VolumesTestJSON-1789704692 None] Acquiring lock "cinder-quobyte-bfdeee22-4cb9-4e6b-9d5b-3cf601aced45" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:32:05 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e4ec1de6-952b-4096-ab5b-36ae393895d1 tempest-VolumesTestJSON-1789704692 None] Lock "cinder-quobyte-bfdeee22-4cb9-4e6b-9d5b-3cf601aced45" acquired by "delete_volume" :: waited 0.043s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:32:05 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec9f925-e784-4c09-a1f4-a96f9f8c457b]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:32:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e4ec1de6-952b-4096-ab5b-36ae393895d1 tempest-VolumesTestJSON-1789704692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bfdeee22-4cb9-4e6b-9d5b-3cf601aced45 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:32:05 devstack sudo[87391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bfdeee22-4cb9-4e6b-9d5b-3cf601aced45 Aug 28 09:32:05 devstack sudo[87391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:32:05 devstack sudo[87391]: pam_unix(sudo:session): session closed for user root Aug 28 09:32:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e4ec1de6-952b-4096-ab5b-36ae393895d1 tempest-VolumesTestJSON-1789704692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bfdeee22-4cb9-4e6b-9d5b-3cf601aced45" returned: 0 in 0.455s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:32:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e4ec1de6-952b-4096-ab5b-36ae393895d1 tempest-VolumesTestJSON-1789704692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bfdeee22-4cb9-4e6b-9d5b-3cf601aced45 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:32:05 devstack sudo[87398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bfdeee22-4cb9-4e6b-9d5b-3cf601aced45 Aug 28 09:32:05 devstack sudo[87398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:32:06 devstack sudo[87398]: pam_unix(sudo:session): session closed for user root Aug 28 09:32:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e4ec1de6-952b-4096-ab5b-36ae393895d1 tempest-VolumesTestJSON-1789704692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bfdeee22-4cb9-4e6b-9d5b-3cf601aced45" returned: 0 in 0.353s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:32:06 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e4ec1de6-952b-4096-ab5b-36ae393895d1 tempest-VolumesTestJSON-1789704692 None] Lock "cinder-quobyte-bfdeee22-4cb9-4e6b-9d5b-3cf601aced45" released by "delete_volume" :: held 0.880s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:32:06 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-e4ec1de6-952b-4096-ab5b-36ae393895d1 tempest-VolumesTestJSON-1789704692 None] Created reservations ['f5518869-2cf6-450a-a2e0-edaedc08bba0', '412081f6-6417-412e-a3e0-bb20aec7d57a', '54f55a87-1bdc-4fd3-ba21-305a41a0a7b7', '69aadbc4-4298-4188-a2ba-807798ba1bfb'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:32:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e4ec1de6-952b-4096-ab5b-36ae393895d1 tempest-VolumesTestJSON-1789704692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:32:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e4ec1de6-952b-4096-ab5b-36ae393895d1 tempest-VolumesTestJSON-1789704692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:32:06 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e4ec1de6-952b-4096-ab5b-36ae393895d1 tempest-VolumesTestJSON-1789704692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:32:06 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e4ec1de6-952b-4096-ab5b-36ae393895d1 tempest-VolumesTestJSON-1789704692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:32:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e4ec1de6-952b-4096-ab5b-36ae393895d1 tempest-VolumesTestJSON-1789704692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:32:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e4ec1de6-952b-4096-ab5b-36ae393895d1 tempest-VolumesTestJSON-1789704692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:32:06 devstack sudo[87402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:32:06 devstack sudo[87402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:32:06 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-97d07dc1-64e3-4417-a43a-5eef6259c736 tempest-VolumesTestJSON-1789704692 None] Acquiring lock "cinder-8f895f40-c0f5-4c91-b1b0-8cc1af3c1981-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:32:06 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-97d07dc1-64e3-4417-a43a-5eef6259c736 tempest-VolumesTestJSON-1789704692 None] Lock "cinder-8f895f40-c0f5-4c91-b1b0-8cc1af3c1981-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:32:06 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-97d07dc1-64e3-4417-a43a-5eef6259c736 tempest-VolumesTestJSON-1789704692 None] Acquiring lock "cinder-quobyte-8f895f40-c0f5-4c91-b1b0-8cc1af3c1981" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:32:06 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-97d07dc1-64e3-4417-a43a-5eef6259c736 tempest-VolumesTestJSON-1789704692 None] Lock "cinder-quobyte-8f895f40-c0f5-4c91-b1b0-8cc1af3c1981" acquired by "delete_volume" :: waited 0.018s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:32:06 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[757f091e-ca94-4b8e-b921-39218f8ea4f7]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:32:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-97d07dc1-64e3-4417-a43a-5eef6259c736 tempest-VolumesTestJSON-1789704692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8f895f40-c0f5-4c91-b1b0-8cc1af3c1981 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:32:06 devstack sudo[87402]: pam_unix(sudo:session): session closed for user root Aug 28 09:32:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e4ec1de6-952b-4096-ab5b-36ae393895d1 tempest-VolumesTestJSON-1789704692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.374s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:32:06 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-e4ec1de6-952b-4096-ab5b-36ae393895d1 tempest-VolumesTestJSON-1789704692 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:32:06 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-e4ec1de6-952b-4096-ab5b-36ae393895d1 tempest-VolumesTestJSON-1789704692 None] Deleted volume successfully. Aug 28 09:32:06 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e4ec1de6-952b-4096-ab5b-36ae393895d1 tempest-VolumesTestJSON-1789704692 None] Lock "cinder-bfdeee22-4cb9-4e6b-9d5b-3cf601aced45-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:32:06 devstack sudo[87404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8f895f40-c0f5-4c91-b1b0-8cc1af3c1981 Aug 28 09:32:06 devstack sudo[87404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:32:07 devstack sudo[87404]: pam_unix(sudo:session): session closed for user root Aug 28 09:32:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-97d07dc1-64e3-4417-a43a-5eef6259c736 tempest-VolumesTestJSON-1789704692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8f895f40-c0f5-4c91-b1b0-8cc1af3c1981" returned: 0 in 0.482s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:32:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-97d07dc1-64e3-4417-a43a-5eef6259c736 tempest-VolumesTestJSON-1789704692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8f895f40-c0f5-4c91-b1b0-8cc1af3c1981 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:32:07 devstack sudo[87410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8f895f40-c0f5-4c91-b1b0-8cc1af3c1981 Aug 28 09:32:07 devstack sudo[87410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:32:07 devstack sudo[87410]: pam_unix(sudo:session): session closed for user root Aug 28 09:32:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-97d07dc1-64e3-4417-a43a-5eef6259c736 tempest-VolumesTestJSON-1789704692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8f895f40-c0f5-4c91-b1b0-8cc1af3c1981" returned: 0 in 0.247s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:32:07 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-97d07dc1-64e3-4417-a43a-5eef6259c736 tempest-VolumesTestJSON-1789704692 None] Lock "cinder-quobyte-8f895f40-c0f5-4c91-b1b0-8cc1af3c1981" released by "delete_volume" :: held 0.782s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:32:07 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-97d07dc1-64e3-4417-a43a-5eef6259c736 tempest-VolumesTestJSON-1789704692 None] Created reservations ['c33096e6-ea9a-4b15-9d60-211704ff4574', '4dfa551d-9494-4aa2-8818-2f721bbe8b55', '86b6b5e2-556a-4847-8ce4-d86163e58805', '698afd3c-3a72-4ccb-8e46-cce03d4cc3dc'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:32:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-97d07dc1-64e3-4417-a43a-5eef6259c736 tempest-VolumesTestJSON-1789704692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:32:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-97d07dc1-64e3-4417-a43a-5eef6259c736 tempest-VolumesTestJSON-1789704692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:32:07 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-97d07dc1-64e3-4417-a43a-5eef6259c736 tempest-VolumesTestJSON-1789704692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:32:07 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-97d07dc1-64e3-4417-a43a-5eef6259c736 tempest-VolumesTestJSON-1789704692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:32:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-97d07dc1-64e3-4417-a43a-5eef6259c736 tempest-VolumesTestJSON-1789704692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:32:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-97d07dc1-64e3-4417-a43a-5eef6259c736 tempest-VolumesTestJSON-1789704692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:32:07 devstack sudo[87413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:32:07 devstack sudo[87413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:32:07 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-decc91f5-756b-45bc-9b80-5b294c4a7836 tempest-VolumesTestJSON-1789704692 None] Acquiring lock "cinder-3400d519-8bc6-4e15-88d8-98bda57fbe0c-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:32:07 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-decc91f5-756b-45bc-9b80-5b294c4a7836 tempest-VolumesTestJSON-1789704692 None] Lock "cinder-3400d519-8bc6-4e15-88d8-98bda57fbe0c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:32:07 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-decc91f5-756b-45bc-9b80-5b294c4a7836 tempest-VolumesTestJSON-1789704692 None] Acquiring lock "cinder-quobyte-3400d519-8bc6-4e15-88d8-98bda57fbe0c" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:32:07 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-decc91f5-756b-45bc-9b80-5b294c4a7836 tempest-VolumesTestJSON-1789704692 None] Lock "cinder-quobyte-3400d519-8bc6-4e15-88d8-98bda57fbe0c" acquired by "delete_volume" :: waited 0.024s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:32:07 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dae931f-dbcb-4174-a8d5-efd3e696dc87]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:32:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-decc91f5-756b-45bc-9b80-5b294c4a7836 tempest-VolumesTestJSON-1789704692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3400d519-8bc6-4e15-88d8-98bda57fbe0c {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:32:07 devstack sudo[87413]: pam_unix(sudo:session): session closed for user root Aug 28 09:32:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-97d07dc1-64e3-4417-a43a-5eef6259c736 tempest-VolumesTestJSON-1789704692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.323s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:32:07 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-97d07dc1-64e3-4417-a43a-5eef6259c736 tempest-VolumesTestJSON-1789704692 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:32:07 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-97d07dc1-64e3-4417-a43a-5eef6259c736 tempest-VolumesTestJSON-1789704692 None] Deleted volume successfully. Aug 28 09:32:07 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-97d07dc1-64e3-4417-a43a-5eef6259c736 tempest-VolumesTestJSON-1789704692 None] Lock "cinder-8f895f40-c0f5-4c91-b1b0-8cc1af3c1981-delete_volume" released by "delete_volume" :: held 1.382s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:32:08 devstack sudo[87417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3400d519-8bc6-4e15-88d8-98bda57fbe0c Aug 28 09:32:08 devstack sudo[87417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:32:08 devstack sudo[87417]: pam_unix(sudo:session): session closed for user root Aug 28 09:32:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-decc91f5-756b-45bc-9b80-5b294c4a7836 tempest-VolumesTestJSON-1789704692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3400d519-8bc6-4e15-88d8-98bda57fbe0c" returned: 0 in 0.390s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:32:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-decc91f5-756b-45bc-9b80-5b294c4a7836 tempest-VolumesTestJSON-1789704692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3400d519-8bc6-4e15-88d8-98bda57fbe0c {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:32:08 devstack sudo[87423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3400d519-8bc6-4e15-88d8-98bda57fbe0c Aug 28 09:32:08 devstack sudo[87423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:32:08 devstack sudo[87423]: pam_unix(sudo:session): session closed for user root Aug 28 09:32:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-decc91f5-756b-45bc-9b80-5b294c4a7836 tempest-VolumesTestJSON-1789704692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3400d519-8bc6-4e15-88d8-98bda57fbe0c" returned: 0 in 0.281s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:32:08 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-decc91f5-756b-45bc-9b80-5b294c4a7836 tempest-VolumesTestJSON-1789704692 None] Lock "cinder-quobyte-3400d519-8bc6-4e15-88d8-98bda57fbe0c" released by "delete_volume" :: held 0.730s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:32:08 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-decc91f5-756b-45bc-9b80-5b294c4a7836 tempest-VolumesTestJSON-1789704692 None] Created reservations ['db8db618-040b-425e-a91e-e85f4b96cc45', '1251cc40-fb60-4ded-ae57-240492c46ba9', '71456b5b-ffe3-459f-8d97-025132fedbbb', 'f4fbe64d-b7a7-4253-ba9f-8424242f1114'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:32:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-decc91f5-756b-45bc-9b80-5b294c4a7836 tempest-VolumesTestJSON-1789704692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:32:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-decc91f5-756b-45bc-9b80-5b294c4a7836 tempest-VolumesTestJSON-1789704692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:32:08 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-decc91f5-756b-45bc-9b80-5b294c4a7836 tempest-VolumesTestJSON-1789704692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:32:08 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-decc91f5-756b-45bc-9b80-5b294c4a7836 tempest-VolumesTestJSON-1789704692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:32:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-decc91f5-756b-45bc-9b80-5b294c4a7836 tempest-VolumesTestJSON-1789704692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:32:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-decc91f5-756b-45bc-9b80-5b294c4a7836 tempest-VolumesTestJSON-1789704692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:32:08 devstack sudo[87428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:32:08 devstack sudo[87428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:32:08 devstack sudo[87428]: pam_unix(sudo:session): session closed for user root Aug 28 09:32:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-decc91f5-756b-45bc-9b80-5b294c4a7836 tempest-VolumesTestJSON-1789704692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.309s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:32:09 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-decc91f5-756b-45bc-9b80-5b294c4a7836 tempest-VolumesTestJSON-1789704692 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:32:09 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-decc91f5-756b-45bc-9b80-5b294c4a7836 tempest-VolumesTestJSON-1789704692 None] Deleted volume successfully. Aug 28 09:32:09 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-decc91f5-756b-45bc-9b80-5b294c4a7836 tempest-VolumesTestJSON-1789704692 None] Lock "cinder-3400d519-8bc6-4e15-88d8-98bda57fbe0c-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:32:09 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-aef08e78-1b29-4584-9ac3-9ac50f1b8783 tempest-ServerActionsTestOtherA-1923649618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:32:09 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-aef08e78-1b29-4584-9ac3-9ac50f1b8783 tempest-ServerActionsTestOtherA-1923649618 None] Flow 'volume_create_manager' (0faa2b80-5f8f-4b84-901b-4038c63ee8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:32:09 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-aef08e78-1b29-4584-9ac3-9ac50f1b8783 tempest-ServerActionsTestOtherA-1923649618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (566c39e0-15d9-4675-baef-91932f2d93fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:32:09 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-aef08e78-1b29-4584-9ac3-9ac50f1b8783 tempest-ServerActionsTestOtherA-1923649618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (566c39e0-15d9-4675-baef-91932f2d93fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1542953218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb63f10b-56e5-41f7-85eb-8408c442a334,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d299059d4774e559e1832d6190fc4c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:32:10Z,use_quota=True,user_id='3828bb185e6e49749767207c36eabe9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:32:09 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-aef08e78-1b29-4584-9ac3-9ac50f1b8783 tempest-ServerActionsTestOtherA-1923649618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e517c77-f31e-4452-b4a8-82ff6e39ee67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:32:09 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-aef08e78-1b29-4584-9ac3-9ac50f1b8783 tempest-ServerActionsTestOtherA-1923649618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e517c77-f31e-4452-b4a8-82ff6e39ee67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:32:09 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-aef08e78-1b29-4584-9ac3-9ac50f1b8783 tempest-ServerActionsTestOtherA-1923649618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd18ddf3-9807-4bf1-8858-daaecf8cb2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:32:09 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-aef08e78-1b29-4584-9ac3-9ac50f1b8783 tempest-ServerActionsTestOtherA-1923649618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd18ddf3-9807-4bf1-8858-daaecf8cb2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb63f10b-56e5-41f7-85eb-8408c442a334', 'volume_name': 'volume-eb63f10b-56e5-41f7-85eb-8408c442a334', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:32:09 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-aef08e78-1b29-4584-9ac3-9ac50f1b8783 tempest-ServerActionsTestOtherA-1923649618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (107d4c7b-ff5a-4915-8fdc-262b231b7f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:32:09 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-aef08e78-1b29-4584-9ac3-9ac50f1b8783 tempest-ServerActionsTestOtherA-1923649618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (107d4c7b-ff5a-4915-8fdc-262b231b7f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:32:09 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-aef08e78-1b29-4584-9ac3-9ac50f1b8783 tempest-ServerActionsTestOtherA-1923649618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45959648-7558-419a-b35d-581adddd03be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:32:09 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-aef08e78-1b29-4584-9ac3-9ac50f1b8783 tempest-ServerActionsTestOtherA-1923649618 None] Volume eb63f10b-56e5-41f7-85eb-8408c442a334: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb63f10b-56e5-41f7-85eb-8408c442a334', 'volume_size': 1} Aug 28 09:32:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-aef08e78-1b29-4584-9ac3-9ac50f1b8783 tempest-ServerActionsTestOtherA-1923649618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:32:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-aef08e78-1b29-4584-9ac3-9ac50f1b8783 tempest-ServerActionsTestOtherA-1923649618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:32:09 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-aef08e78-1b29-4584-9ac3-9ac50f1b8783 tempest-ServerActionsTestOtherA-1923649618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1542953218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb63f10b-56e5-41f7-85eb-8408c442a334,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d299059d4774e559e1832d6190fc4c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:32:10Z,use_quota=True,user_id='3828bb185e6e49749767207c36eabe9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:32:09 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-aef08e78-1b29-4584-9ac3-9ac50f1b8783 tempest-ServerActionsTestOtherA-1923649618 None] Creating volume eb63f10b-56e5-41f7-85eb-8408c442a334 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:32:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-aef08e78-1b29-4584-9ac3-9ac50f1b8783 tempest-ServerActionsTestOtherA-1923649618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:32:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-aef08e78-1b29-4584-9ac3-9ac50f1b8783 tempest-ServerActionsTestOtherA-1923649618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:32:09 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-aef08e78-1b29-4584-9ac3-9ac50f1b8783 tempest-ServerActionsTestOtherA-1923649618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:32:09 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-aef08e78-1b29-4584-9ac3-9ac50f1b8783 tempest-ServerActionsTestOtherA-1923649618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:32:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-aef08e78-1b29-4584-9ac3-9ac50f1b8783 tempest-ServerActionsTestOtherA-1923649618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:32:09 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-aef08e78-1b29-4584-9ac3-9ac50f1b8783 tempest-ServerActionsTestOtherA-1923649618 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:32:09 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-aef08e78-1b29-4584-9ac3-9ac50f1b8783 tempest-ServerActionsTestOtherA-1923649618 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:32:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-aef08e78-1b29-4584-9ac3-9ac50f1b8783 tempest-ServerActionsTestOtherA-1923649618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-eb63f10b-56e5-41f7-85eb-8408c442a334 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:32:09 devstack sudo[87431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-eb63f10b-56e5-41f7-85eb-8408c442a334 1073741824 Aug 28 09:32:09 devstack sudo[87431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:32:10 devstack sudo[87431]: pam_unix(sudo:session): session closed for user root Aug 28 09:32:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-aef08e78-1b29-4584-9ac3-9ac50f1b8783 tempest-ServerActionsTestOtherA-1923649618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-eb63f10b-56e5-41f7-85eb-8408c442a334 1073741824" returned: 0 in 0.569s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:32:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-aef08e78-1b29-4584-9ac3-9ac50f1b8783 tempest-ServerActionsTestOtherA-1923649618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-eb63f10b-56e5-41f7-85eb-8408c442a334 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:32:10 devstack sudo[87437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-eb63f10b-56e5-41f7-85eb-8408c442a334 Aug 28 09:32:10 devstack sudo[87437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:32:10 devstack sudo[87437]: pam_unix(sudo:session): session closed for user root Aug 28 09:32:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-aef08e78-1b29-4584-9ac3-9ac50f1b8783 tempest-ServerActionsTestOtherA-1923649618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-eb63f10b-56e5-41f7-85eb-8408c442a334" returned: 0 in 0.296s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:32:10 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-aef08e78-1b29-4584-9ac3-9ac50f1b8783 tempest-ServerActionsTestOtherA-1923649618 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:32:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-aef08e78-1b29-4584-9ac3-9ac50f1b8783 tempest-ServerActionsTestOtherA-1923649618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:32:10 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-aef08e78-1b29-4584-9ac3-9ac50f1b8783 tempest-ServerActionsTestOtherA-1923649618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45959648-7558-419a-b35d-581adddd03be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb63f10b-56e5-41f7-85eb-8408c442a334', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:32:10 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-aef08e78-1b29-4584-9ac3-9ac50f1b8783 tempest-ServerActionsTestOtherA-1923649618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6064866-6403-4c07-bda5-c22e5f5e8b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:32:10 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-aef08e78-1b29-4584-9ac3-9ac50f1b8783 tempest-ServerActionsTestOtherA-1923649618 None] Volume volume-eb63f10b-56e5-41f7-85eb-8408c442a334 (eb63f10b-56e5-41f7-85eb-8408c442a334): created successfully Aug 28 09:32:10 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-aef08e78-1b29-4584-9ac3-9ac50f1b8783 tempest-ServerActionsTestOtherA-1923649618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6064866-6403-4c07-bda5-c22e5f5e8b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:32:10 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-aef08e78-1b29-4584-9ac3-9ac50f1b8783 tempest-ServerActionsTestOtherA-1923649618 None] Flow 'volume_create_manager' (0faa2b80-5f8f-4b84-901b-4038c63ee8fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:32:10 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-aef08e78-1b29-4584-9ac3-9ac50f1b8783 tempest-ServerActionsTestOtherA-1923649618 None] Created volume successfully. Aug 28 09:32:13 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-0e6d340e-fc06-4a3e-b676-07c8b45a5f4e tempest-GroupSnapshotsTest-783586098 None] Group tempest-GroupSnapshotsTest-Group-77720530: creating Aug 28 09:32:13 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-0e6d340e-fc06-4a3e-b676-07c8b45a5f4e tempest-GroupSnapshotsTest-783586098 None] Group tempest-GroupSnapshotsTest-Group-77720530: created successfully Aug 28 09:32:13 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-0e6d340e-fc06-4a3e-b676-07c8b45a5f4e tempest-GroupSnapshotsTest-783586098 None] Create group completed successfully. Aug 28 09:32:15 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-45f2d89c-42fa-451e-900b-525af4a99c9a tempest-GroupSnapshotsTest-783586098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:32:16 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-45f2d89c-42fa-451e-900b-525af4a99c9a tempest-GroupSnapshotsTest-783586098 None] Flow 'volume_create_manager' (e6967942-87e3-4b8c-bb9c-b6538e110fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:32:16 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-45f2d89c-42fa-451e-900b-525af4a99c9a tempest-GroupSnapshotsTest-783586098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07789818-2a1f-4ac2-afd7-4a688cf55294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:32:16 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-45f2d89c-42fa-451e-900b-525af4a99c9a tempest-GroupSnapshotsTest-783586098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07789818-2a1f-4ac2-afd7-4a688cf55294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1454565849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=96b34daf-d4a9-4612-97b9-fd59b0d08656,host='devstack@QuobyteHD#QuobyteHD',id=f0822bc6-9d48-47ee-a105-fcc2096d07fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ca1454757b54cb1bd6619f17d31e51c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:32:16Z,use_quota=True,user_id='ff70ade6cc2a4cdda5c9d83a8b6b4fcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(25d57c04-c591-408b-bde4-69110d8cdcc0),volume_type_id=25d57c04-c591-408b-bde4-69110d8cdcc0)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:32:16 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-45f2d89c-42fa-451e-900b-525af4a99c9a tempest-GroupSnapshotsTest-783586098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b9e13c6-633b-4efc-aac5-f45fbc84b467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:32:16 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-45f2d89c-42fa-451e-900b-525af4a99c9a tempest-GroupSnapshotsTest-783586098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b9e13c6-633b-4efc-aac5-f45fbc84b467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:32:16 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-45f2d89c-42fa-451e-900b-525af4a99c9a tempest-GroupSnapshotsTest-783586098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93f1d691-e5e5-4ea1-9c4e-911b559aeb44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:32:16 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-45f2d89c-42fa-451e-900b-525af4a99c9a tempest-GroupSnapshotsTest-783586098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93f1d691-e5e5-4ea1-9c4e-911b559aeb44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0822bc6-9d48-47ee-a105-fcc2096d07fc', 'volume_name': 'volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:32:16 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-45f2d89c-42fa-451e-900b-525af4a99c9a tempest-GroupSnapshotsTest-783586098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f24ba352-c81e-401a-a981-a3fcf01bd954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:32:16 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-45f2d89c-42fa-451e-900b-525af4a99c9a tempest-GroupSnapshotsTest-783586098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f24ba352-c81e-401a-a981-a3fcf01bd954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:32:16 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-45f2d89c-42fa-451e-900b-525af4a99c9a tempest-GroupSnapshotsTest-783586098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e79c5d0-0ddb-48e4-834b-947efe64b5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:32:16 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-45f2d89c-42fa-451e-900b-525af4a99c9a tempest-GroupSnapshotsTest-783586098 None] Volume f0822bc6-9d48-47ee-a105-fcc2096d07fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc', 'volume_size': 1} Aug 28 09:32:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-45f2d89c-42fa-451e-900b-525af4a99c9a tempest-GroupSnapshotsTest-783586098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:32:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-45f2d89c-42fa-451e-900b-525af4a99c9a tempest-GroupSnapshotsTest-783586098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:32:16 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-45f2d89c-42fa-451e-900b-525af4a99c9a tempest-GroupSnapshotsTest-783586098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=96b34daf-d4a9-4612-97b9-fd59b0d08656,created_at=2026-08-28T07:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1454565849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=96b34daf-d4a9-4612-97b9-fd59b0d08656,host='devstack@QuobyteHD#QuobyteHD',id=f0822bc6-9d48-47ee-a105-fcc2096d07fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ca1454757b54cb1bd6619f17d31e51c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:32:16Z,use_quota=True,user_id='ff70ade6cc2a4cdda5c9d83a8b6b4fcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(25d57c04-c591-408b-bde4-69110d8cdcc0),volume_type_id=25d57c04-c591-408b-bde4-69110d8cdcc0)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:32:16 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-45f2d89c-42fa-451e-900b-525af4a99c9a tempest-GroupSnapshotsTest-783586098 None] Creating volume f0822bc6-9d48-47ee-a105-fcc2096d07fc {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:32:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-45f2d89c-42fa-451e-900b-525af4a99c9a tempest-GroupSnapshotsTest-783586098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:32:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-45f2d89c-42fa-451e-900b-525af4a99c9a tempest-GroupSnapshotsTest-783586098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:32:16 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-45f2d89c-42fa-451e-900b-525af4a99c9a tempest-GroupSnapshotsTest-783586098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:32:16 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-45f2d89c-42fa-451e-900b-525af4a99c9a tempest-GroupSnapshotsTest-783586098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:32:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-45f2d89c-42fa-451e-900b-525af4a99c9a tempest-GroupSnapshotsTest-783586098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:32:16 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-45f2d89c-42fa-451e-900b-525af4a99c9a tempest-GroupSnapshotsTest-783586098 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:32:16 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-45f2d89c-42fa-451e-900b-525af4a99c9a tempest-GroupSnapshotsTest-783586098 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:32:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-45f2d89c-42fa-451e-900b-525af4a99c9a tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:32:16 devstack sudo[87472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc 1073741824 Aug 28 09:32:16 devstack sudo[87472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:32:16 devstack sudo[87472]: pam_unix(sudo:session): session closed for user root Aug 28 09:32:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-45f2d89c-42fa-451e-900b-525af4a99c9a tempest-GroupSnapshotsTest-783586098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc 1073741824" returned: 0 in 0.499s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:32:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-45f2d89c-42fa-451e-900b-525af4a99c9a tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:32:16 devstack sudo[87481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc Aug 28 09:32:16 devstack sudo[87481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:32:16 devstack sudo[87481]: pam_unix(sudo:session): session closed for user root Aug 28 09:32:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-45f2d89c-42fa-451e-900b-525af4a99c9a tempest-GroupSnapshotsTest-783586098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc" returned: 0 in 0.294s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:32:16 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-45f2d89c-42fa-451e-900b-525af4a99c9a tempest-GroupSnapshotsTest-783586098 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:32:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-45f2d89c-42fa-451e-900b-525af4a99c9a tempest-GroupSnapshotsTest-783586098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:32:16 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-45f2d89c-42fa-451e-900b-525af4a99c9a tempest-GroupSnapshotsTest-783586098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e79c5d0-0ddb-48e4-834b-947efe64b5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:32:17 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-45f2d89c-42fa-451e-900b-525af4a99c9a tempest-GroupSnapshotsTest-783586098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68105a60-ab58-4599-8887-9efb7d90905b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:32:17 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-45f2d89c-42fa-451e-900b-525af4a99c9a tempest-GroupSnapshotsTest-783586098 None] Volume volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc (f0822bc6-9d48-47ee-a105-fcc2096d07fc): created successfully Aug 28 09:32:17 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-45f2d89c-42fa-451e-900b-525af4a99c9a tempest-GroupSnapshotsTest-783586098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68105a60-ab58-4599-8887-9efb7d90905b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:32:17 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-45f2d89c-42fa-451e-900b-525af4a99c9a tempest-GroupSnapshotsTest-783586098 None] Flow 'volume_create_manager' (e6967942-87e3-4b8c-bb9c-b6538e110fdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:32:17 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-45f2d89c-42fa-451e-900b-525af4a99c9a tempest-GroupSnapshotsTest-783586098 None] Created volume successfully. Aug 28 09:32:17 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-7a359c44-0ec7-45fa-88d9-2a245101852b tempest-GroupSnapshotsTest-783586098 None] GroupSnapshot 83bbc58e-5469-4daf-ab35-a5bf0a8dca07: creating. Aug 28 09:32:17 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7a359c44-0ec7-45fa-88d9-2a245101852b tempest-GroupSnapshotsTest-783586098 None] Group snapshot 83bbc58e-5469-4daf-ab35-a5bf0a8dca07: creating. {{(pid=86081) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 28 09:32:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-7a359c44-0ec7-45fa-88d9-2a245101852b tempest-GroupSnapshotsTest-783586098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:32:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-7a359c44-0ec7-45fa-88d9-2a245101852b tempest-GroupSnapshotsTest-783586098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:32:17 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-7a359c44-0ec7-45fa-88d9-2a245101852b tempest-GroupSnapshotsTest-783586098 None] Creating offline snapshot e34467ea-23bb-43ca-952c-2713820b4e99 of volume f0822bc6-9d48-47ee-a105-fcc2096d07fc {{(pid=86081) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:32:17 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c41008-9d20-45f5-a4c7-1e9126562c88]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:32:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7a359c44-0ec7-45fa-88d9-2a245101852b tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:32:18 devstack sudo[87489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc Aug 28 09:32:18 devstack sudo[87489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:32:18 devstack sudo[87489]: pam_unix(sudo:session): session closed for user root Aug 28 09:32:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7a359c44-0ec7-45fa-88d9-2a245101852b tempest-GroupSnapshotsTest-783586098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc" returned: 0 in 0.732s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:32:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7a359c44-0ec7-45fa-88d9-2a245101852b tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc.e34467ea-23bb-43ca-952c-2713820b4e99 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:32:18 devstack sudo[87509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc.e34467ea-23bb-43ca-952c-2713820b4e99 1G Aug 28 09:32:18 devstack sudo[87509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:32:19 devstack sudo[87509]: pam_unix(sudo:session): session closed for user root Aug 28 09:32:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7a359c44-0ec7-45fa-88d9-2a245101852b tempest-GroupSnapshotsTest-783586098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc.e34467ea-23bb-43ca-952c-2713820b4e99 1G" returned: 0 in 0.970s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:32:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7a359c44-0ec7-45fa-88d9-2a245101852b tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc.e34467ea-23bb-43ca-952c-2713820b4e99 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:32:19 devstack sudo[87553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc.e34467ea-23bb-43ca-952c-2713820b4e99 Aug 28 09:32:19 devstack sudo[87553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:32:20 devstack sudo[87553]: pam_unix(sudo:session): session closed for user root Aug 28 09:32:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7a359c44-0ec7-45fa-88d9-2a245101852b tempest-GroupSnapshotsTest-783586098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc.e34467ea-23bb-43ca-952c-2713820b4e99" returned: 0 in 0.629s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:32:20 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-7a359c44-0ec7-45fa-88d9-2a245101852b tempest-GroupSnapshotsTest-783586098 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc.e34467ea-23bb-43ca-952c-2713820b4e99 is being set with open permissions: ugo+rw: NotImplementedError Aug 28 09:32:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7a359c44-0ec7-45fa-88d9-2a245101852b tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc.e34467ea-23bb-43ca-952c-2713820b4e99 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:32:20 devstack sudo[87559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc.e34467ea-23bb-43ca-952c-2713820b4e99 Aug 28 09:32:20 devstack sudo[87559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:32:20 devstack sudo[87559]: pam_unix(sudo:session): session closed for user root Aug 28 09:32:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7a359c44-0ec7-45fa-88d9-2a245101852b tempest-GroupSnapshotsTest-783586098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc.e34467ea-23bb-43ca-952c-2713820b4e99" returned: 0 in 0.524s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:32:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7a359c44-0ec7-45fa-88d9-2a245101852b tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:32:20 devstack sudo[87565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc.info Aug 28 09:32:20 devstack sudo[87565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:32:21 devstack sudo[87565]: pam_unix(sudo:session): session closed for user root Aug 28 09:32:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7a359c44-0ec7-45fa-88d9-2a245101852b tempest-GroupSnapshotsTest-783586098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc.info" returned: 0 in 0.398s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:32:21 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-7a359c44-0ec7-45fa-88d9-2a245101852b tempest-GroupSnapshotsTest-783586098 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc.info is being set with open permissions: ugo+rw: NotImplementedError Aug 28 09:32:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7a359c44-0ec7-45fa-88d9-2a245101852b tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:32:21 devstack sudo[87569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc.info Aug 28 09:32:21 devstack sudo[87569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:32:21 devstack sudo[87569]: pam_unix(sudo:session): session closed for user root Aug 28 09:32:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7a359c44-0ec7-45fa-88d9-2a245101852b tempest-GroupSnapshotsTest-783586098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc.info" returned: 0 in 0.380s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:32:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-7a359c44-0ec7-45fa-88d9-2a245101852b tempest-GroupSnapshotsTest-783586098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.839s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:32:21 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-7a359c44-0ec7-45fa-88d9-2a245101852b tempest-GroupSnapshotsTest-783586098 None] group_snapshot 83bbc58e-5469-4daf-ab35-a5bf0a8dca07: created successfully Aug 28 09:32:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-703fdf9f-4b4f-48e3-a33d-dea39c935000 tempest-GroupSnapshotsTest-783586098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:32:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-703fdf9f-4b4f-48e3-a33d-dea39c935000 tempest-GroupSnapshotsTest-783586098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:32:24 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-703fdf9f-4b4f-48e3-a33d-dea39c935000 tempest-GroupSnapshotsTest-783586098 None] Acquiring lock "cinder-quobyte-e34467ea-23bb-43ca-952c-2713820b4e99-9d36e133-e5f4-42dc-8b9d-398ec4830dba" by "_create_volume_from_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:32:24 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-703fdf9f-4b4f-48e3-a33d-dea39c935000 tempest-GroupSnapshotsTest-783586098 None] Lock "cinder-quobyte-e34467ea-23bb-43ca-952c-2713820b4e99-9d36e133-e5f4-42dc-8b9d-398ec4830dba" acquired by "_create_volume_from_snapshot" :: waited 0.050s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:32:24 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-703fdf9f-4b4f-48e3-a33d-dea39c935000 tempest-GroupSnapshotsTest-783586098 None] Creating volume 9d36e133-e5f4-42dc-8b9d-398ec4830dba from snapshot e34467ea-23bb-43ca-952c-2713820b4e99 {{(pid=86081) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 28 09:32:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-703fdf9f-4b4f-48e3-a33d-dea39c935000 tempest-GroupSnapshotsTest-783586098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:32:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-703fdf9f-4b4f-48e3-a33d-dea39c935000 tempest-GroupSnapshotsTest-783586098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:32:24 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-703fdf9f-4b4f-48e3-a33d-dea39c935000 tempest-GroupSnapshotsTest-783586098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:32:24 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-703fdf9f-4b4f-48e3-a33d-dea39c935000 tempest-GroupSnapshotsTest-783586098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:32:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-703fdf9f-4b4f-48e3-a33d-dea39c935000 tempest-GroupSnapshotsTest-783586098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:32:24 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-703fdf9f-4b4f-48e3-a33d-dea39c935000 tempest-GroupSnapshotsTest-783586098 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:32:24 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-703fdf9f-4b4f-48e3-a33d-dea39c935000 tempest-GroupSnapshotsTest-783586098 None] Acquiring lock "cinder-quobyte-9d36e133-e5f4-42dc-8b9d-398ec4830dba" by "_copy_volume_from_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:32:24 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-703fdf9f-4b4f-48e3-a33d-dea39c935000 tempest-GroupSnapshotsTest-783586098 None] Lock "cinder-quobyte-9d36e133-e5f4-42dc-8b9d-398ec4830dba" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:32:24 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-703fdf9f-4b4f-48e3-a33d-dea39c935000 tempest-GroupSnapshotsTest-783586098 None] snapshot: e34467ea-23bb-43ca-952c-2713820b4e99, volume: 9d36e133-e5f4-42dc-8b9d-398ec4830dba, {{(pid=86081) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 28 09:32:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-703fdf9f-4b4f-48e3-a33d-dea39c935000 tempest-GroupSnapshotsTest-783586098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:32:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-703fdf9f-4b4f-48e3-a33d-dea39c935000 tempest-GroupSnapshotsTest-783586098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:32:25 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-703fdf9f-4b4f-48e3-a33d-dea39c935000 tempest-GroupSnapshotsTest-783586098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:32:25 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-703fdf9f-4b4f-48e3-a33d-dea39c935000 tempest-GroupSnapshotsTest-783586098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:32:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-703fdf9f-4b4f-48e3-a33d-dea39c935000 tempest-GroupSnapshotsTest-783586098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:32:25 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[43710224-2be1-46db-9b3e-d2b3e996e24b]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:32:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-703fdf9f-4b4f-48e3-a33d-dea39c935000 tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc.e34467ea-23bb-43ca-952c-2713820b4e99 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:32:25 devstack sudo[87625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc.e34467ea-23bb-43ca-952c-2713820b4e99 Aug 28 09:32:25 devstack sudo[87625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:32:25 devstack sudo[87625]: pam_unix(sudo:session): session closed for user root Aug 28 09:32:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-703fdf9f-4b4f-48e3-a33d-dea39c935000 tempest-GroupSnapshotsTest-783586098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc.e34467ea-23bb-43ca-952c-2713820b4e99" returned: 0 in 0.821s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:32:25 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-703fdf9f-4b4f-48e3-a33d-dea39c935000 tempest-GroupSnapshotsTest-783586098 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:32:25 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6b68a9-9913-4ce4-a908-9c3395e4b90c]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:32:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-703fdf9f-4b4f-48e3-a33d-dea39c935000 tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:32:26 devstack sudo[87639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc Aug 28 09:32:26 devstack sudo[87639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:32:26 devstack sudo[87639]: pam_unix(sudo:session): session closed for user root Aug 28 09:32:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-703fdf9f-4b4f-48e3-a33d-dea39c935000 tempest-GroupSnapshotsTest-783586098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc" returned: 0 in 0.854s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:32:26 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-703fdf9f-4b4f-48e3-a33d-dea39c935000 tempest-GroupSnapshotsTest-783586098 None] will copy from snapshot at /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc {{(pid=86081) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 28 09:32:26 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-703fdf9f-4b4f-48e3-a33d-dea39c935000 tempest-GroupSnapshotsTest-783586098 None] Creating direct copy from snapshot {{(pid=86081) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 28 09:32:26 devstack cinder-volume[86081]: DEBUG cinder.utils [None req-703fdf9f-4b4f-48e3-a33d-dea39c935000 tempest-GroupSnapshotsTest-783586098 None] Path /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d36e133-e5f4-42dc-8b9d-398ec4830dba not found in is_blk_device check {{(pid=86081) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 28 09:32:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-703fdf9f-4b4f-48e3-a33d-dea39c935000 tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d36e133-e5f4-42dc-8b9d-398ec4830dba {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:32:26 devstack sudo[87646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d36e133-e5f4-42dc-8b9d-398ec4830dba Aug 28 09:32:26 devstack sudo[87646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:32:30 devstack cinder-volume[86081]: WARNING py.warnings [req-f88b0c8d-78f5-4b9e-ba2b-2441b2682df6 req-224e8cba-4d3a-404c-a9d6-a07b1058b7ec tempest-TaggedAttachmentsTest-2146882190 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Aug 28 09:32:30 devstack cinder-volume[86081]: .first() Aug 28 09:32:30 devstack cinder-volume[86081]: Aug 28 09:32:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-f88b0c8d-78f5-4b9e-ba2b-2441b2682df6 req-224e8cba-4d3a-404c-a9d6-a07b1058b7ec tempest-TaggedAttachmentsTest-2146882190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:32:33 devstack sudo[87646]: pam_unix(sudo:session): session closed for user root Aug 28 09:32:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-703fdf9f-4b4f-48e3-a33d-dea39c935000 tempest-GroupSnapshotsTest-783586098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d36e133-e5f4-42dc-8b9d-398ec4830dba" returned: 0 in 7.106s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:32:33 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-703fdf9f-4b4f-48e3-a33d-dea39c935000 tempest-GroupSnapshotsTest-783586098 None] Image conversion details: src /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc, size 1024.00 MB, duration 7.11 sec, destination /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d36e133-e5f4-42dc-8b9d-398ec4830dba {{(pid=86081) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 09:32:33 devstack cinder-volume[86081]: INFO cinder.image.image_utils [None req-703fdf9f-4b4f-48e3-a33d-dea39c935000 tempest-GroupSnapshotsTest-783586098 None] Converted 1024.00 MB image at 144.05 MB/s Aug 28 09:32:33 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-703fdf9f-4b4f-48e3-a33d-dea39c935000 tempest-GroupSnapshotsTest-783586098 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d36e133-e5f4-42dc-8b9d-398ec4830dba is being set with open permissions: ugo+rw: NotImplementedError Aug 28 09:32:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-703fdf9f-4b4f-48e3-a33d-dea39c935000 tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d36e133-e5f4-42dc-8b9d-398ec4830dba {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:32:33 devstack sudo[87691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d36e133-e5f4-42dc-8b9d-398ec4830dba Aug 28 09:32:33 devstack sudo[87691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:32:34 devstack sudo[87691]: pam_unix(sudo:session): session closed for user root Aug 28 09:32:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-703fdf9f-4b4f-48e3-a33d-dea39c935000 tempest-GroupSnapshotsTest-783586098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d36e133-e5f4-42dc-8b9d-398ec4830dba" returned: 0 in 0.273s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:32:34 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-703fdf9f-4b4f-48e3-a33d-dea39c935000 tempest-GroupSnapshotsTest-783586098 None] Lock "cinder-quobyte-9d36e133-e5f4-42dc-8b9d-398ec4830dba" released by "_copy_volume_from_snapshot" :: held 9.290s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:32:34 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-703fdf9f-4b4f-48e3-a33d-dea39c935000 tempest-GroupSnapshotsTest-783586098 None] Lock "cinder-quobyte-e34467ea-23bb-43ca-952c-2713820b4e99-9d36e133-e5f4-42dc-8b9d-398ec4830dba" released by "_create_volume_from_snapshot" :: held 9.408s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:32:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-703fdf9f-4b4f-48e3-a33d-dea39c935000 tempest-GroupSnapshotsTest-783586098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.459s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:32:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-f88b0c8d-78f5-4b9e-ba2b-2441b2682df6 req-224e8cba-4d3a-404c-a9d6-a07b1058b7ec tempest-TaggedAttachmentsTest-2146882190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.587s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:32:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-f88b0c8d-78f5-4b9e-ba2b-2441b2682df6 req-224e8cba-4d3a-404c-a9d6-a07b1058b7ec tempest-TaggedAttachmentsTest-2146882190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:32:34 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-f88b0c8d-78f5-4b9e-ba2b-2441b2682df6 req-224e8cba-4d3a-404c-a9d6-a07b1058b7ec tempest-TaggedAttachmentsTest-2146882190 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b', 'name': 'volume-6e9db77d-c7b7-4b10-85e8-aa2ea17be1ad', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '61992e3a-5f27-4b54-889c-ab7e6f59423a', 'enforce_multipath': True} {{(pid=86081) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 09:32:34 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-703fdf9f-4b4f-48e3-a33d-dea39c935000 tempest-GroupSnapshotsTest-783586098 None] Create group from source-snapshot-83bbc58e-5469-4daf-ab35-a5bf0a8dca07 completed successfully. Aug 28 09:32:34 devstack cinder-volume[86081]: INFO cinder.volume.manager [req-f88b0c8d-78f5-4b9e-ba2b-2441b2682df6 req-224e8cba-4d3a-404c-a9d6-a07b1058b7ec tempest-TaggedAttachmentsTest-2146882190 None] attachment_update completed successfully. Aug 28 09:32:36 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-14fb84b0-a59a-4d1b-ac3b-2b0e1d274b35 tempest-GroupSnapshotsTest-783586098 None] Acquiring lock "cinder-quobyte-9d36e133-e5f4-42dc-8b9d-398ec4830dba" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:32:36 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-14fb84b0-a59a-4d1b-ac3b-2b0e1d274b35 tempest-GroupSnapshotsTest-783586098 None] Lock "cinder-quobyte-9d36e133-e5f4-42dc-8b9d-398ec4830dba" acquired by "delete_volume" :: waited 0.031s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:32:36 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c0cc06-f696-49b8-ab0a-cdf6f9d431cd]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:32:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-14fb84b0-a59a-4d1b-ac3b-2b0e1d274b35 tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d36e133-e5f4-42dc-8b9d-398ec4830dba {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:32:36 devstack sudo[88088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d36e133-e5f4-42dc-8b9d-398ec4830dba Aug 28 09:32:36 devstack sudo[88088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:32:36 devstack sudo[88088]: pam_unix(sudo:session): session closed for user root Aug 28 09:32:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-14fb84b0-a59a-4d1b-ac3b-2b0e1d274b35 tempest-GroupSnapshotsTest-783586098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d36e133-e5f4-42dc-8b9d-398ec4830dba" returned: 0 in 0.550s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:32:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-14fb84b0-a59a-4d1b-ac3b-2b0e1d274b35 tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d36e133-e5f4-42dc-8b9d-398ec4830dba {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:32:36 devstack sudo[88108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d36e133-e5f4-42dc-8b9d-398ec4830dba Aug 28 09:32:36 devstack sudo[88108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:32:37 devstack sudo[88108]: pam_unix(sudo:session): session closed for user root Aug 28 09:32:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-14fb84b0-a59a-4d1b-ac3b-2b0e1d274b35 tempest-GroupSnapshotsTest-783586098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d36e133-e5f4-42dc-8b9d-398ec4830dba" returned: 0 in 0.315s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:32:37 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-14fb84b0-a59a-4d1b-ac3b-2b0e1d274b35 tempest-GroupSnapshotsTest-783586098 None] Lock "cinder-quobyte-9d36e133-e5f4-42dc-8b9d-398ec4830dba" released by "delete_volume" :: held 0.973s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:32:37 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-14fb84b0-a59a-4d1b-ac3b-2b0e1d274b35 tempest-GroupSnapshotsTest-783586098 None] Created reservations ['3a07c7d8-7278-4c6e-b824-9b6007eea289'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:32:37 devstack cinder-volume[86081]: WARNING cinder.quota [None req-14fb84b0-a59a-4d1b-ac3b-2b0e1d274b35 tempest-GroupSnapshotsTest-783586098 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1040309238 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1040309238, it is now deprecated. Please use the default quota class for default quota. Aug 28 09:32:37 devstack cinder-volume[86081]: WARNING cinder.quota [None req-14fb84b0-a59a-4d1b-ac3b-2b0e1d274b35 tempest-GroupSnapshotsTest-783586098 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1040309238 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1040309238, it is now deprecated. Please use the default quota class for default quota. Aug 28 09:32:37 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-14fb84b0-a59a-4d1b-ac3b-2b0e1d274b35 tempest-GroupSnapshotsTest-783586098 None] Created reservations ['03fcfd76-8f9a-4830-906e-f298844601a1', '9a430f99-528e-432b-995a-48ec03f5e328', '60d318c2-2b19-40ba-bf75-0667aa906b75', 'a22aa418-fb85-4600-bb19-c384bf83ae5b'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:32:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-14fb84b0-a59a-4d1b-ac3b-2b0e1d274b35 tempest-GroupSnapshotsTest-783586098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:32:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-14fb84b0-a59a-4d1b-ac3b-2b0e1d274b35 tempest-GroupSnapshotsTest-783586098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:32:37 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-14fb84b0-a59a-4d1b-ac3b-2b0e1d274b35 tempest-GroupSnapshotsTest-783586098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:32:37 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-14fb84b0-a59a-4d1b-ac3b-2b0e1d274b35 tempest-GroupSnapshotsTest-783586098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:32:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-14fb84b0-a59a-4d1b-ac3b-2b0e1d274b35 tempest-GroupSnapshotsTest-783586098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:32:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-14fb84b0-a59a-4d1b-ac3b-2b0e1d274b35 tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:32:37 devstack sudo[88111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:32:37 devstack sudo[88111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:32:37 devstack sudo[88111]: pam_unix(sudo:session): session closed for user root Aug 28 09:32:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-14fb84b0-a59a-4d1b-ac3b-2b0e1d274b35 tempest-GroupSnapshotsTest-783586098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.329s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:32:37 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-14fb84b0-a59a-4d1b-ac3b-2b0e1d274b35 tempest-GroupSnapshotsTest-783586098 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:32:37 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-14fb84b0-a59a-4d1b-ac3b-2b0e1d274b35 tempest-GroupSnapshotsTest-783586098 None] Delete group completed successfully. Aug 28 09:32:38 devstack cinder-volume[86081]: DEBUG oslo_service.periodic_task [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86081) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:32:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:32:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:32:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:32:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:32:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:32:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:32:38 devstack sudo[88115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:32:38 devstack sudo[88115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:32:38 devstack sudo[88115]: pam_unix(sudo:session): session closed for user root Aug 28 09:32:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.325s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:32:38 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:32:38 devstack cinder-volume[86081]: DEBUG oslo_service.periodic_task [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running periodic task VolumeManager._thread_info {{(pid=86081) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:32:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] thread count: 8 {{(pid=86081) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 09:32:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] thread info: [<_MainThread(MainThread, started 129914189705344)>, , , , , , , ] {{(pid=86081) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 09:32:38 devstack cinder-volume[86081]: INFO cinder.volume.manager [req-caf042ac-be4b-48f6-b329-4010bc20a70f req-4cfb5a8d-84d9-49aa-9692-de1dece96b4c tempest-TaggedAttachmentsTest-2146882190 None] Terminate volume connection completed successfully. Aug 28 09:32:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-caf042ac-be4b-48f6-b329-4010bc20a70f req-4cfb5a8d-84d9-49aa-9692-de1dece96b4c tempest-TaggedAttachmentsTest-2146882190 None] Deleting attachment 61992e3a-5f27-4b54-889c-ab7e6f59423a. {{(pid=86081) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 09:32:38 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-24f36dac-1074-4c32-b477-39643001f8be tempest-GroupSnapshotsTest-783586098 None] group_snapshot 83bbc58e-5469-4daf-ab35-a5bf0a8dca07: deleting Aug 28 09:32:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-24f36dac-1074-4c32-b477-39643001f8be tempest-GroupSnapshotsTest-783586098 None] group_snapshot 83bbc58e-5469-4daf-ab35-a5bf0a8dca07: deleting {{(pid=86081) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 28 09:32:38 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-24f36dac-1074-4c32-b477-39643001f8be tempest-GroupSnapshotsTest-783586098 None] Acquiring lock "cinder-quobyte-f0822bc6-9d48-47ee-a105-fcc2096d07fc" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:32:38 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-24f36dac-1074-4c32-b477-39643001f8be tempest-GroupSnapshotsTest-783586098 None] Lock "cinder-quobyte-f0822bc6-9d48-47ee-a105-fcc2096d07fc" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:32:38 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-24f36dac-1074-4c32-b477-39643001f8be tempest-GroupSnapshotsTest-783586098 None] Acquiring lock "cinder-quobyte-e34467ea-23bb-43ca-952c-2713820b4e99" by "_delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:32:38 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-24f36dac-1074-4c32-b477-39643001f8be tempest-GroupSnapshotsTest-783586098 None] Lock "cinder-quobyte-e34467ea-23bb-43ca-952c-2713820b4e99" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:32:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-24f36dac-1074-4c32-b477-39643001f8be tempest-GroupSnapshotsTest-783586098 None] Deleting offline snapshot e34467ea-23bb-43ca-952c-2713820b4e99 of volume f0822bc6-9d48-47ee-a105-fcc2096d07fc {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:32:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-24f36dac-1074-4c32-b477-39643001f8be tempest-GroupSnapshotsTest-783586098 None] snapshot_file for this snap is: volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc.e34467ea-23bb-43ca-952c-2713820b4e99 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:32:38 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef690317-e29a-465c-bd83-6f5ee738454b]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:32:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-24f36dac-1074-4c32-b477-39643001f8be tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc.e34467ea-23bb-43ca-952c-2713820b4e99 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:32:39 devstack sudo[88147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc.e34467ea-23bb-43ca-952c-2713820b4e99 Aug 28 09:32:39 devstack sudo[88147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:32:39 devstack sudo[88147]: pam_unix(sudo:session): session closed for user root Aug 28 09:32:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-24f36dac-1074-4c32-b477-39643001f8be tempest-GroupSnapshotsTest-783586098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc.e34467ea-23bb-43ca-952c-2713820b4e99" returned: 0 in 0.546s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:32:39 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-24f36dac-1074-4c32-b477-39643001f8be tempest-GroupSnapshotsTest-783586098 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:32:39 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2320fec-3cce-42b3-9e7e-3bb2037c1df1]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:32:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-24f36dac-1074-4c32-b477-39643001f8be tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:32:39 devstack sudo[88155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc Aug 28 09:32:39 devstack sudo[88155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:32:40 devstack sudo[88155]: pam_unix(sudo:session): session closed for user root Aug 28 09:32:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-24f36dac-1074-4c32-b477-39643001f8be tempest-GroupSnapshotsTest-783586098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc" returned: 0 in 0.759s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:32:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-24f36dac-1074-4c32-b477-39643001f8be tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc.e34467ea-23bb-43ca-952c-2713820b4e99 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:32:40 devstack sudo[88176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc.e34467ea-23bb-43ca-952c-2713820b4e99 Aug 28 09:32:40 devstack sudo[88176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:32:40 devstack sudo[88176]: pam_unix(sudo:session): session closed for user root Aug 28 09:32:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-24f36dac-1074-4c32-b477-39643001f8be tempest-GroupSnapshotsTest-783586098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc.e34467ea-23bb-43ca-952c-2713820b4e99" returned: 0 in 0.406s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:32:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-24f36dac-1074-4c32-b477-39643001f8be tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc.e34467ea-23bb-43ca-952c-2713820b4e99 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:32:40 devstack sudo[88182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc.e34467ea-23bb-43ca-952c-2713820b4e99 Aug 28 09:32:40 devstack sudo[88182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:32:41 devstack sudo[88182]: pam_unix(sudo:session): session closed for user root Aug 28 09:32:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-24f36dac-1074-4c32-b477-39643001f8be tempest-GroupSnapshotsTest-783586098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc.e34467ea-23bb-43ca-952c-2713820b4e99" returned: 0 in 0.417s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:32:41 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-24f36dac-1074-4c32-b477-39643001f8be tempest-GroupSnapshotsTest-783586098 None] Lock "cinder-quobyte-e34467ea-23bb-43ca-952c-2713820b4e99" released by "_delete_snapshot" :: held 2.289s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:32:41 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-24f36dac-1074-4c32-b477-39643001f8be tempest-GroupSnapshotsTest-783586098 None] Lock "cinder-quobyte-f0822bc6-9d48-47ee-a105-fcc2096d07fc" released by "delete_snapshot" :: held 2.320s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:32:41 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writing DB stats cinder:UPDATE=68,cinder:DELETE=5,cinder:SELECT=54,cinder:INSERT=18 {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:32:41 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writing DB stats cinder:SELECT=73,cinder:UPDATE=70,cinder:INSERT=11,cinder:DELETE=5 {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:32:41 devstack cinder-volume[86081]: WARNING cinder.quota [None req-24f36dac-1074-4c32-b477-39643001f8be tempest-GroupSnapshotsTest-783586098 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1040309238 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1040309238, it is now deprecated. Please use the default quota class for default quota. Aug 28 09:32:41 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-24f36dac-1074-4c32-b477-39643001f8be tempest-GroupSnapshotsTest-783586098 None] Created reservations ['d7e26494-5a17-4eb8-96f1-074b4195e47f', '9bc88286-594b-493b-9544-1bb86e3e59af', '23b1bff9-5cbc-4480-b7df-1ad9ba147bc7', '85e5e8ce-77c2-4246-b139-56653bd70eb3'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:32:41 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-24f36dac-1074-4c32-b477-39643001f8be tempest-GroupSnapshotsTest-783586098 None] group_snapshot 83bbc58e-5469-4daf-ab35-a5bf0a8dca07: deleted successfully Aug 28 09:32:42 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-cb8288bd-09bd-4d28-b968-b31b76d44fd8 tempest-GroupSnapshotsTest-783586098 None] Acquiring lock "cinder-quobyte-f0822bc6-9d48-47ee-a105-fcc2096d07fc" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:32:42 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-cb8288bd-09bd-4d28-b968-b31b76d44fd8 tempest-GroupSnapshotsTest-783586098 None] Lock "cinder-quobyte-f0822bc6-9d48-47ee-a105-fcc2096d07fc" acquired by "delete_volume" :: waited 0.020s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:32:42 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae10a363-22a5-467d-b31b-5db496a6d0ed]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:32:42 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-cb8288bd-09bd-4d28-b968-b31b76d44fd8 tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:32:42 devstack sudo[88190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc Aug 28 09:32:42 devstack sudo[88190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:32:42 devstack sudo[88190]: pam_unix(sudo:session): session closed for user root Aug 28 09:32:42 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-cb8288bd-09bd-4d28-b968-b31b76d44fd8 tempest-GroupSnapshotsTest-783586098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc" returned: 0 in 0.388s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:32:42 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-cb8288bd-09bd-4d28-b968-b31b76d44fd8 tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:32:42 devstack sudo[88199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc Aug 28 09:32:42 devstack sudo[88199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:32:43 devstack sudo[88199]: pam_unix(sudo:session): session closed for user root Aug 28 09:32:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-cb8288bd-09bd-4d28-b968-b31b76d44fd8 tempest-GroupSnapshotsTest-783586098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f0822bc6-9d48-47ee-a105-fcc2096d07fc" returned: 0 in 0.261s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:32:43 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-cb8288bd-09bd-4d28-b968-b31b76d44fd8 tempest-GroupSnapshotsTest-783586098 None] Lock "cinder-quobyte-f0822bc6-9d48-47ee-a105-fcc2096d07fc" released by "delete_volume" :: held 0.716s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:32:43 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-cb8288bd-09bd-4d28-b968-b31b76d44fd8 tempest-GroupSnapshotsTest-783586098 None] Created reservations ['054e8941-1d3d-4740-883a-a4b78e28e3b1'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:32:43 devstack cinder-volume[86081]: WARNING cinder.db.api [None req-cb8288bd-09bd-4d28-b968-b31b76d44fd8 tempest-GroupSnapshotsTest-783586098 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1040309238'] Aug 28 09:32:43 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-cb8288bd-09bd-4d28-b968-b31b76d44fd8 tempest-GroupSnapshotsTest-783586098 None] Created reservations ['37f39f34-e920-4f31-b753-162ebb8d8bab', 'ea52ee8b-526c-450c-bf34-1b3c3d67c21e', '5f8c00db-4669-4deb-b7e3-e2da3a1d145a', '0019efc4-d751-4596-a407-b934dd260625'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:32:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-cb8288bd-09bd-4d28-b968-b31b76d44fd8 tempest-GroupSnapshotsTest-783586098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:32:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-cb8288bd-09bd-4d28-b968-b31b76d44fd8 tempest-GroupSnapshotsTest-783586098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:32:43 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-cb8288bd-09bd-4d28-b968-b31b76d44fd8 tempest-GroupSnapshotsTest-783586098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:32:43 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-cb8288bd-09bd-4d28-b968-b31b76d44fd8 tempest-GroupSnapshotsTest-783586098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:32:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-cb8288bd-09bd-4d28-b968-b31b76d44fd8 tempest-GroupSnapshotsTest-783586098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:32:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-cb8288bd-09bd-4d28-b968-b31b76d44fd8 tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:32:43 devstack sudo[88204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:32:43 devstack sudo[88204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:32:43 devstack sudo[88204]: pam_unix(sudo:session): session closed for user root Aug 28 09:32:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-cb8288bd-09bd-4d28-b968-b31b76d44fd8 tempest-GroupSnapshotsTest-783586098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.444s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:32:43 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-cb8288bd-09bd-4d28-b968-b31b76d44fd8 tempest-GroupSnapshotsTest-783586098 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:32:44 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-cb8288bd-09bd-4d28-b968-b31b76d44fd8 tempest-GroupSnapshotsTest-783586098 None] Delete group completed successfully. Aug 28 09:32:44 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-9fea18ed-8a72-4b52-9e1a-7b7de8baa116 tempest-GroupSnapshotsTest-783586098 None] Group tempest-GroupSnapshotsTest-Group-334534566: creating Aug 28 09:32:44 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-9fea18ed-8a72-4b52-9e1a-7b7de8baa116 tempest-GroupSnapshotsTest-783586098 None] Group tempest-GroupSnapshotsTest-Group-334534566: created successfully Aug 28 09:32:44 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-9fea18ed-8a72-4b52-9e1a-7b7de8baa116 tempest-GroupSnapshotsTest-783586098 None] Create group completed successfully. Aug 28 09:32:46 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-50e165ed-28f6-4ed7-bc83-1ca805a15698 tempest-GroupSnapshotsTest-783586098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:32:46 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-50e165ed-28f6-4ed7-bc83-1ca805a15698 tempest-GroupSnapshotsTest-783586098 None] Flow 'volume_create_manager' (0b98456f-d39c-4e3e-b780-10758ac26301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:32:46 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-50e165ed-28f6-4ed7-bc83-1ca805a15698 tempest-GroupSnapshotsTest-783586098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d506c22-4922-4d38-b25e-2e7fbf35f8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:32:46 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-50e165ed-28f6-4ed7-bc83-1ca805a15698 tempest-GroupSnapshotsTest-783586098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d506c22-4922-4d38-b25e-2e7fbf35f8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1938153672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d91b0cf6-6862-4856-b2d8-bcdca916725b,host='devstack@QuobyteHD#QuobyteHD',id=6b738b3f-9676-42c1-a236-89ee9988fe61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ca1454757b54cb1bd6619f17d31e51c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:32:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:32:47Z,use_quota=True,user_id='ff70ade6cc2a4cdda5c9d83a8b6b4fcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0607626d-0d07-4c9e-a5ae-399112427db9),volume_type_id=0607626d-0d07-4c9e-a5ae-399112427db9)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:32:46 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-50e165ed-28f6-4ed7-bc83-1ca805a15698 tempest-GroupSnapshotsTest-783586098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (602391ac-a9b5-40b6-99b1-cf0894f4560f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:32:46 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-50e165ed-28f6-4ed7-bc83-1ca805a15698 tempest-GroupSnapshotsTest-783586098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (602391ac-a9b5-40b6-99b1-cf0894f4560f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:32:46 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-50e165ed-28f6-4ed7-bc83-1ca805a15698 tempest-GroupSnapshotsTest-783586098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7139003-8759-4fde-818b-f85278a94817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:32:46 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-50e165ed-28f6-4ed7-bc83-1ca805a15698 tempest-GroupSnapshotsTest-783586098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7139003-8759-4fde-818b-f85278a94817) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b738b3f-9676-42c1-a236-89ee9988fe61', 'volume_name': 'volume-6b738b3f-9676-42c1-a236-89ee9988fe61', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:32:46 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-50e165ed-28f6-4ed7-bc83-1ca805a15698 tempest-GroupSnapshotsTest-783586098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1b3768f-26e8-4e1c-aee0-b63f5d7f0881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:32:46 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-50e165ed-28f6-4ed7-bc83-1ca805a15698 tempest-GroupSnapshotsTest-783586098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1b3768f-26e8-4e1c-aee0-b63f5d7f0881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:32:46 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-50e165ed-28f6-4ed7-bc83-1ca805a15698 tempest-GroupSnapshotsTest-783586098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (739306f5-f70a-42d5-a20f-6e72e6ef57fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:32:46 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-50e165ed-28f6-4ed7-bc83-1ca805a15698 tempest-GroupSnapshotsTest-783586098 None] Volume 6b738b3f-9676-42c1-a236-89ee9988fe61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b738b3f-9676-42c1-a236-89ee9988fe61', 'volume_size': 1} Aug 28 09:32:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-50e165ed-28f6-4ed7-bc83-1ca805a15698 tempest-GroupSnapshotsTest-783586098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:32:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-50e165ed-28f6-4ed7-bc83-1ca805a15698 tempest-GroupSnapshotsTest-783586098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:32:46 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-50e165ed-28f6-4ed7-bc83-1ca805a15698 tempest-GroupSnapshotsTest-783586098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d91b0cf6-6862-4856-b2d8-bcdca916725b,created_at=2026-08-28T07:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1938153672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d91b0cf6-6862-4856-b2d8-bcdca916725b,host='devstack@QuobyteHD#QuobyteHD',id=6b738b3f-9676-42c1-a236-89ee9988fe61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ca1454757b54cb1bd6619f17d31e51c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:32:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:32:47Z,use_quota=True,user_id='ff70ade6cc2a4cdda5c9d83a8b6b4fcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0607626d-0d07-4c9e-a5ae-399112427db9),volume_type_id=0607626d-0d07-4c9e-a5ae-399112427db9)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:32:46 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-50e165ed-28f6-4ed7-bc83-1ca805a15698 tempest-GroupSnapshotsTest-783586098 None] Creating volume 6b738b3f-9676-42c1-a236-89ee9988fe61 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:32:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-50e165ed-28f6-4ed7-bc83-1ca805a15698 tempest-GroupSnapshotsTest-783586098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:32:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-50e165ed-28f6-4ed7-bc83-1ca805a15698 tempest-GroupSnapshotsTest-783586098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:32:46 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-50e165ed-28f6-4ed7-bc83-1ca805a15698 tempest-GroupSnapshotsTest-783586098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:32:46 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-50e165ed-28f6-4ed7-bc83-1ca805a15698 tempest-GroupSnapshotsTest-783586098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:32:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-50e165ed-28f6-4ed7-bc83-1ca805a15698 tempest-GroupSnapshotsTest-783586098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:32:46 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-50e165ed-28f6-4ed7-bc83-1ca805a15698 tempest-GroupSnapshotsTest-783586098 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:32:46 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-50e165ed-28f6-4ed7-bc83-1ca805a15698 tempest-GroupSnapshotsTest-783586098 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:32:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-50e165ed-28f6-4ed7-bc83-1ca805a15698 tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6b738b3f-9676-42c1-a236-89ee9988fe61 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:32:46 devstack sudo[88251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6b738b3f-9676-42c1-a236-89ee9988fe61 1073741824 Aug 28 09:32:46 devstack sudo[88251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:32:47 devstack sudo[88251]: pam_unix(sudo:session): session closed for user root Aug 28 09:32:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-50e165ed-28f6-4ed7-bc83-1ca805a15698 tempest-GroupSnapshotsTest-783586098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6b738b3f-9676-42c1-a236-89ee9988fe61 1073741824" returned: 0 in 0.586s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:32:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-50e165ed-28f6-4ed7-bc83-1ca805a15698 tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6b738b3f-9676-42c1-a236-89ee9988fe61 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:32:47 devstack sudo[88260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6b738b3f-9676-42c1-a236-89ee9988fe61 Aug 28 09:32:47 devstack sudo[88260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:32:47 devstack sudo[88260]: pam_unix(sudo:session): session closed for user root Aug 28 09:32:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-50e165ed-28f6-4ed7-bc83-1ca805a15698 tempest-GroupSnapshotsTest-783586098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6b738b3f-9676-42c1-a236-89ee9988fe61" returned: 0 in 0.314s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:32:47 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-50e165ed-28f6-4ed7-bc83-1ca805a15698 tempest-GroupSnapshotsTest-783586098 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:32:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-50e165ed-28f6-4ed7-bc83-1ca805a15698 tempest-GroupSnapshotsTest-783586098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:32:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-50e165ed-28f6-4ed7-bc83-1ca805a15698 tempest-GroupSnapshotsTest-783586098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (739306f5-f70a-42d5-a20f-6e72e6ef57fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b738b3f-9676-42c1-a236-89ee9988fe61', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:32:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-50e165ed-28f6-4ed7-bc83-1ca805a15698 tempest-GroupSnapshotsTest-783586098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (845e758b-62c3-4283-a551-0502106e01fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:32:47 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-50e165ed-28f6-4ed7-bc83-1ca805a15698 tempest-GroupSnapshotsTest-783586098 None] Volume volume-6b738b3f-9676-42c1-a236-89ee9988fe61 (6b738b3f-9676-42c1-a236-89ee9988fe61): created successfully Aug 28 09:32:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-50e165ed-28f6-4ed7-bc83-1ca805a15698 tempest-GroupSnapshotsTest-783586098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (845e758b-62c3-4283-a551-0502106e01fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:32:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-50e165ed-28f6-4ed7-bc83-1ca805a15698 tempest-GroupSnapshotsTest-783586098 None] Flow 'volume_create_manager' (0b98456f-d39c-4e3e-b780-10758ac26301) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:32:47 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-50e165ed-28f6-4ed7-bc83-1ca805a15698 tempest-GroupSnapshotsTest-783586098 None] Created volume successfully. Aug 28 09:32:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-8e4047a9-65e8-4ff4-94b7-ed3644fe1a19 req-60af8b09-97a2-40a0-a569-c0b0eca6b805 tempest-ServerActionsTestOtherA-1923649618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:32:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-8e4047a9-65e8-4ff4-94b7-ed3644fe1a19 req-60af8b09-97a2-40a0-a569-c0b0eca6b805 tempest-ServerActionsTestOtherA-1923649618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:32:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-8e4047a9-65e8-4ff4-94b7-ed3644fe1a19 req-60af8b09-97a2-40a0-a569-c0b0eca6b805 tempest-ServerActionsTestOtherA-1923649618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:32:49 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-8e4047a9-65e8-4ff4-94b7-ed3644fe1a19 req-60af8b09-97a2-40a0-a569-c0b0eca6b805 tempest-ServerActionsTestOtherA-1923649618 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b', 'name': 'volume-eb63f10b-56e5-41f7-85eb-8408c442a334', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '732234d3-ab46-4805-9673-abdab287547b', 'enforce_multipath': True} {{(pid=86081) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 09:32:49 devstack cinder-volume[86081]: INFO cinder.volume.manager [req-8e4047a9-65e8-4ff4-94b7-ed3644fe1a19 req-60af8b09-97a2-40a0-a569-c0b0eca6b805 tempest-ServerActionsTestOtherA-1923649618 None] attachment_update completed successfully. Aug 28 09:32:50 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee61e2eb-e190-44fe-ae78-aae2e54d4ef6 tempest-GroupSnapshotsTest-783586098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:32:50 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ee61e2eb-e190-44fe-ae78-aae2e54d4ef6 tempest-GroupSnapshotsTest-783586098 None] Flow 'volume_create_manager' (57958eca-52e4-4a0c-a038-397b0311d620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:32:50 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ee61e2eb-e190-44fe-ae78-aae2e54d4ef6 tempest-GroupSnapshotsTest-783586098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4a9a0fc-e698-4021-a34e-fee301963afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:32:50 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ee61e2eb-e190-44fe-ae78-aae2e54d4ef6 tempest-GroupSnapshotsTest-783586098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4a9a0fc-e698-4021-a34e-fee301963afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:32:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1893470524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d91b0cf6-6862-4856-b2d8-bcdca916725b,host='devstack@QuobyteHD#QuobyteHD',id=bb2e6a94-1869-4e93-840e-f3bd5c5c4914,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ca1454757b54cb1bd6619f17d31e51c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:32:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:32:51Z,use_quota=True,user_id='ff70ade6cc2a4cdda5c9d83a8b6b4fcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0607626d-0d07-4c9e-a5ae-399112427db9),volume_type_id=0607626d-0d07-4c9e-a5ae-399112427db9)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:32:50 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ee61e2eb-e190-44fe-ae78-aae2e54d4ef6 tempest-GroupSnapshotsTest-783586098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccfd2048-280f-4001-863f-ed1276996020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:32:50 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ee61e2eb-e190-44fe-ae78-aae2e54d4ef6 tempest-GroupSnapshotsTest-783586098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccfd2048-280f-4001-863f-ed1276996020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:32:50 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ee61e2eb-e190-44fe-ae78-aae2e54d4ef6 tempest-GroupSnapshotsTest-783586098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7afaca6d-a505-4494-894e-26c7b6bd22f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:32:50 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ee61e2eb-e190-44fe-ae78-aae2e54d4ef6 tempest-GroupSnapshotsTest-783586098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7afaca6d-a505-4494-894e-26c7b6bd22f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb2e6a94-1869-4e93-840e-f3bd5c5c4914', 'volume_name': 'volume-bb2e6a94-1869-4e93-840e-f3bd5c5c4914', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:32:50 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ee61e2eb-e190-44fe-ae78-aae2e54d4ef6 tempest-GroupSnapshotsTest-783586098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fb87999-7163-40ef-8daf-8267a93cbe9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:32:50 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ee61e2eb-e190-44fe-ae78-aae2e54d4ef6 tempest-GroupSnapshotsTest-783586098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fb87999-7163-40ef-8daf-8267a93cbe9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:32:50 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ee61e2eb-e190-44fe-ae78-aae2e54d4ef6 tempest-GroupSnapshotsTest-783586098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbf85228-ae5c-4125-98fc-3c2c2a34db6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:32:50 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-ee61e2eb-e190-44fe-ae78-aae2e54d4ef6 tempest-GroupSnapshotsTest-783586098 None] Volume bb2e6a94-1869-4e93-840e-f3bd5c5c4914: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb2e6a94-1869-4e93-840e-f3bd5c5c4914', 'volume_size': 1} Aug 28 09:32:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ee61e2eb-e190-44fe-ae78-aae2e54d4ef6 tempest-GroupSnapshotsTest-783586098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:32:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ee61e2eb-e190-44fe-ae78-aae2e54d4ef6 tempest-GroupSnapshotsTest-783586098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:32:50 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ee61e2eb-e190-44fe-ae78-aae2e54d4ef6 tempest-GroupSnapshotsTest-783586098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d91b0cf6-6862-4856-b2d8-bcdca916725b,created_at=2026-08-28T07:32:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1893470524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d91b0cf6-6862-4856-b2d8-bcdca916725b,host='devstack@QuobyteHD#QuobyteHD',id=bb2e6a94-1869-4e93-840e-f3bd5c5c4914,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ca1454757b54cb1bd6619f17d31e51c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:32:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:32:51Z,use_quota=True,user_id='ff70ade6cc2a4cdda5c9d83a8b6b4fcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0607626d-0d07-4c9e-a5ae-399112427db9),volume_type_id=0607626d-0d07-4c9e-a5ae-399112427db9)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:32:50 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-ee61e2eb-e190-44fe-ae78-aae2e54d4ef6 tempest-GroupSnapshotsTest-783586098 None] Creating volume bb2e6a94-1869-4e93-840e-f3bd5c5c4914 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:32:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ee61e2eb-e190-44fe-ae78-aae2e54d4ef6 tempest-GroupSnapshotsTest-783586098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:32:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ee61e2eb-e190-44fe-ae78-aae2e54d4ef6 tempest-GroupSnapshotsTest-783586098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:32:50 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ee61e2eb-e190-44fe-ae78-aae2e54d4ef6 tempest-GroupSnapshotsTest-783586098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:32:50 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ee61e2eb-e190-44fe-ae78-aae2e54d4ef6 tempest-GroupSnapshotsTest-783586098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:32:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ee61e2eb-e190-44fe-ae78-aae2e54d4ef6 tempest-GroupSnapshotsTest-783586098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:32:50 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ee61e2eb-e190-44fe-ae78-aae2e54d4ef6 tempest-GroupSnapshotsTest-783586098 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:32:50 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-ee61e2eb-e190-44fe-ae78-aae2e54d4ef6 tempest-GroupSnapshotsTest-783586098 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:32:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ee61e2eb-e190-44fe-ae78-aae2e54d4ef6 tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bb2e6a94-1869-4e93-840e-f3bd5c5c4914 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:32:50 devstack sudo[88734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bb2e6a94-1869-4e93-840e-f3bd5c5c4914 1073741824 Aug 28 09:32:50 devstack sudo[88734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:32:51 devstack sudo[88734]: pam_unix(sudo:session): session closed for user root Aug 28 09:32:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ee61e2eb-e190-44fe-ae78-aae2e54d4ef6 tempest-GroupSnapshotsTest-783586098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bb2e6a94-1869-4e93-840e-f3bd5c5c4914 1073741824" returned: 0 in 0.677s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:32:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ee61e2eb-e190-44fe-ae78-aae2e54d4ef6 tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bb2e6a94-1869-4e93-840e-f3bd5c5c4914 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:32:51 devstack sudo[88740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bb2e6a94-1869-4e93-840e-f3bd5c5c4914 Aug 28 09:32:51 devstack sudo[88740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:32:51 devstack sudo[88740]: pam_unix(sudo:session): session closed for user root Aug 28 09:32:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ee61e2eb-e190-44fe-ae78-aae2e54d4ef6 tempest-GroupSnapshotsTest-783586098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bb2e6a94-1869-4e93-840e-f3bd5c5c4914" returned: 0 in 0.309s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:32:51 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ee61e2eb-e190-44fe-ae78-aae2e54d4ef6 tempest-GroupSnapshotsTest-783586098 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:32:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ee61e2eb-e190-44fe-ae78-aae2e54d4ef6 tempest-GroupSnapshotsTest-783586098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:32:51 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ee61e2eb-e190-44fe-ae78-aae2e54d4ef6 tempest-GroupSnapshotsTest-783586098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbf85228-ae5c-4125-98fc-3c2c2a34db6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb2e6a94-1869-4e93-840e-f3bd5c5c4914', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:32:51 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ee61e2eb-e190-44fe-ae78-aae2e54d4ef6 tempest-GroupSnapshotsTest-783586098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1523a184-c556-40cf-bc76-24d15afcabd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:32:51 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-ee61e2eb-e190-44fe-ae78-aae2e54d4ef6 tempest-GroupSnapshotsTest-783586098 None] Volume volume-bb2e6a94-1869-4e93-840e-f3bd5c5c4914 (bb2e6a94-1869-4e93-840e-f3bd5c5c4914): created successfully Aug 28 09:32:51 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ee61e2eb-e190-44fe-ae78-aae2e54d4ef6 tempest-GroupSnapshotsTest-783586098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1523a184-c556-40cf-bc76-24d15afcabd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:32:51 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ee61e2eb-e190-44fe-ae78-aae2e54d4ef6 tempest-GroupSnapshotsTest-783586098 None] Flow 'volume_create_manager' (57958eca-52e4-4a0c-a038-397b0311d620) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:32:51 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-ee61e2eb-e190-44fe-ae78-aae2e54d4ef6 tempest-GroupSnapshotsTest-783586098 None] Created volume successfully. Aug 28 09:32:52 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e4a9665f-287e-4885-9e75-fadbd532a2e4 tempest-TaggedAttachmentsTest-2146882190 None] Acquiring lock "cinder-6e9db77d-c7b7-4b10-85e8-aa2ea17be1ad-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:32:52 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e4a9665f-287e-4885-9e75-fadbd532a2e4 tempest-TaggedAttachmentsTest-2146882190 None] Lock "cinder-6e9db77d-c7b7-4b10-85e8-aa2ea17be1ad-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:32:52 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e4a9665f-287e-4885-9e75-fadbd532a2e4 tempest-TaggedAttachmentsTest-2146882190 None] Acquiring lock "cinder-quobyte-6e9db77d-c7b7-4b10-85e8-aa2ea17be1ad" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:32:52 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e4a9665f-287e-4885-9e75-fadbd532a2e4 tempest-TaggedAttachmentsTest-2146882190 None] Lock "cinder-quobyte-6e9db77d-c7b7-4b10-85e8-aa2ea17be1ad" acquired by "delete_volume" :: waited 0.019s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:32:53 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[8076ef21-ae69-47b2-af8b-b8d03d1d9305]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:32:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e4a9665f-287e-4885-9e75-fadbd532a2e4 tempest-TaggedAttachmentsTest-2146882190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6e9db77d-c7b7-4b10-85e8-aa2ea17be1ad {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:32:53 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-4375ca33-1625-4db2-a411-0322accfa8a0 tempest-DeleteServersTestJSON-180782363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:32:53 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-4375ca33-1625-4db2-a411-0322accfa8a0 tempest-DeleteServersTestJSON-180782363 None] Flow 'volume_create_manager' (cecda877-9a9c-4602-a2fc-b745c7584594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:32:53 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-4375ca33-1625-4db2-a411-0322accfa8a0 tempest-DeleteServersTestJSON-180782363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8ad471f-806f-4846-8883-a639f63e025e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:32:53 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-4375ca33-1625-4db2-a411-0322accfa8a0 tempest-DeleteServersTestJSON-180782363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8ad471f-806f-4846-8883-a639f63e025e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1389899669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e65ba20d-3dc7-481b-9e79-2bdd9673588f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='726bfae9024d48359200beb341f738e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:32:53Z,use_quota=True,user_id='ab363fbdea014803ba95871d50a41160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:32:53 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-4375ca33-1625-4db2-a411-0322accfa8a0 tempest-DeleteServersTestJSON-180782363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b987c57-529a-49b6-8d42-d46c41441ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:32:53 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-4375ca33-1625-4db2-a411-0322accfa8a0 tempest-DeleteServersTestJSON-180782363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b987c57-529a-49b6-8d42-d46c41441ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:32:53 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-4375ca33-1625-4db2-a411-0322accfa8a0 tempest-DeleteServersTestJSON-180782363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af2bebe2-3966-4701-a3a5-88ec56b8d41b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:32:53 devstack sudo[88746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6e9db77d-c7b7-4b10-85e8-aa2ea17be1ad Aug 28 09:32:53 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-4375ca33-1625-4db2-a411-0322accfa8a0 tempest-DeleteServersTestJSON-180782363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af2bebe2-3966-4701-a3a5-88ec56b8d41b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e65ba20d-3dc7-481b-9e79-2bdd9673588f', 'volume_name': 'volume-e65ba20d-3dc7-481b-9e79-2bdd9673588f', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:32:53 devstack sudo[88746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:32:53 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-4375ca33-1625-4db2-a411-0322accfa8a0 tempest-DeleteServersTestJSON-180782363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fd725c6-46d7-4d09-8467-150986c251a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:32:53 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-4375ca33-1625-4db2-a411-0322accfa8a0 tempest-DeleteServersTestJSON-180782363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fd725c6-46d7-4d09-8467-150986c251a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:32:53 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-4375ca33-1625-4db2-a411-0322accfa8a0 tempest-DeleteServersTestJSON-180782363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37e5d70e-f925-4711-ae0b-2fc964830e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:32:53 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-4375ca33-1625-4db2-a411-0322accfa8a0 tempest-DeleteServersTestJSON-180782363 None] Volume e65ba20d-3dc7-481b-9e79-2bdd9673588f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e65ba20d-3dc7-481b-9e79-2bdd9673588f', 'volume_size': 1} Aug 28 09:32:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-4375ca33-1625-4db2-a411-0322accfa8a0 tempest-DeleteServersTestJSON-180782363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:32:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-4375ca33-1625-4db2-a411-0322accfa8a0 tempest-DeleteServersTestJSON-180782363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:32:53 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-4375ca33-1625-4db2-a411-0322accfa8a0 tempest-DeleteServersTestJSON-180782363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1389899669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e65ba20d-3dc7-481b-9e79-2bdd9673588f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='726bfae9024d48359200beb341f738e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:32:53Z,use_quota=True,user_id='ab363fbdea014803ba95871d50a41160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:32:53 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-4375ca33-1625-4db2-a411-0322accfa8a0 tempest-DeleteServersTestJSON-180782363 None] Creating volume e65ba20d-3dc7-481b-9e79-2bdd9673588f {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:32:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-4375ca33-1625-4db2-a411-0322accfa8a0 tempest-DeleteServersTestJSON-180782363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:32:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-4375ca33-1625-4db2-a411-0322accfa8a0 tempest-DeleteServersTestJSON-180782363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:32:53 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-4375ca33-1625-4db2-a411-0322accfa8a0 tempest-DeleteServersTestJSON-180782363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:32:53 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-4375ca33-1625-4db2-a411-0322accfa8a0 tempest-DeleteServersTestJSON-180782363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:32:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-4375ca33-1625-4db2-a411-0322accfa8a0 tempest-DeleteServersTestJSON-180782363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:32:53 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-4375ca33-1625-4db2-a411-0322accfa8a0 tempest-DeleteServersTestJSON-180782363 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:32:53 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-4375ca33-1625-4db2-a411-0322accfa8a0 tempest-DeleteServersTestJSON-180782363 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:32:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4375ca33-1625-4db2-a411-0322accfa8a0 tempest-DeleteServersTestJSON-180782363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e65ba20d-3dc7-481b-9e79-2bdd9673588f 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:32:53 devstack sudo[88749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e65ba20d-3dc7-481b-9e79-2bdd9673588f 1073741824 Aug 28 09:32:53 devstack sudo[88749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:32:53 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-ff86a261-c16e-4c37-b73f-cbf69a9dabe1 tempest-GroupSnapshotsTest-783586098 None] Update group completed successfully. Aug 28 09:32:53 devstack sudo[88746]: pam_unix(sudo:session): session closed for user root Aug 28 09:32:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e4a9665f-287e-4885-9e75-fadbd532a2e4 tempest-TaggedAttachmentsTest-2146882190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6e9db77d-c7b7-4b10-85e8-aa2ea17be1ad" returned: 0 in 0.573s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:32:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e4a9665f-287e-4885-9e75-fadbd532a2e4 tempest-TaggedAttachmentsTest-2146882190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6e9db77d-c7b7-4b10-85e8-aa2ea17be1ad {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:32:53 devstack sudo[88755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6e9db77d-c7b7-4b10-85e8-aa2ea17be1ad Aug 28 09:32:53 devstack sudo[88755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:32:53 devstack sudo[88749]: pam_unix(sudo:session): session closed for user root Aug 28 09:32:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4375ca33-1625-4db2-a411-0322accfa8a0 tempest-DeleteServersTestJSON-180782363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e65ba20d-3dc7-481b-9e79-2bdd9673588f 1073741824" returned: 0 in 0.615s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:32:54 devstack sudo[88755]: pam_unix(sudo:session): session closed for user root Aug 28 09:32:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e4a9665f-287e-4885-9e75-fadbd532a2e4 tempest-TaggedAttachmentsTest-2146882190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6e9db77d-c7b7-4b10-85e8-aa2ea17be1ad" returned: 0 in 0.376s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:32:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4375ca33-1625-4db2-a411-0322accfa8a0 tempest-DeleteServersTestJSON-180782363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e65ba20d-3dc7-481b-9e79-2bdd9673588f {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:32:54 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e4a9665f-287e-4885-9e75-fadbd532a2e4 tempest-TaggedAttachmentsTest-2146882190 None] Lock "cinder-quobyte-6e9db77d-c7b7-4b10-85e8-aa2ea17be1ad" released by "delete_volume" :: held 1.079s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:32:54 devstack sudo[88771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e65ba20d-3dc7-481b-9e79-2bdd9673588f Aug 28 09:32:54 devstack sudo[88771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:32:54 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-e4a9665f-287e-4885-9e75-fadbd532a2e4 tempest-TaggedAttachmentsTest-2146882190 None] Created reservations ['aa16e2d7-bdfb-467b-b661-48adf4f99168', '1da61a97-e43b-4fc0-9271-2f3ebfcad892', '56239852-3873-4303-9186-58e32aefc974', '94353082-8662-4819-88d6-e91b0928789a'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:32:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e4a9665f-287e-4885-9e75-fadbd532a2e4 tempest-TaggedAttachmentsTest-2146882190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:32:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e4a9665f-287e-4885-9e75-fadbd532a2e4 tempest-TaggedAttachmentsTest-2146882190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:32:54 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e4a9665f-287e-4885-9e75-fadbd532a2e4 tempest-TaggedAttachmentsTest-2146882190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:32:54 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e4a9665f-287e-4885-9e75-fadbd532a2e4 tempest-TaggedAttachmentsTest-2146882190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:32:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e4a9665f-287e-4885-9e75-fadbd532a2e4 tempest-TaggedAttachmentsTest-2146882190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:32:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e4a9665f-287e-4885-9e75-fadbd532a2e4 tempest-TaggedAttachmentsTest-2146882190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:32:54 devstack sudo[88773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:32:54 devstack sudo[88773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:32:54 devstack cinder-volume[86081]: INFO cinder.volume.manager [req-bf531da5-d79a-405b-b93f-3768512ed59e req-08239e63-0f91-4ad8-8446-0330d7416db1 tempest-ServerActionsTestOtherA-1923649618 None] Terminate volume connection completed successfully. Aug 28 09:32:54 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-bf531da5-d79a-405b-b93f-3768512ed59e req-08239e63-0f91-4ad8-8446-0330d7416db1 tempest-ServerActionsTestOtherA-1923649618 None] Deleting attachment 732234d3-ab46-4805-9673-abdab287547b. {{(pid=86081) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 09:32:54 devstack sudo[88771]: pam_unix(sudo:session): session closed for user root Aug 28 09:32:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4375ca33-1625-4db2-a411-0322accfa8a0 tempest-DeleteServersTestJSON-180782363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e65ba20d-3dc7-481b-9e79-2bdd9673588f" returned: 0 in 0.442s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:32:54 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-4375ca33-1625-4db2-a411-0322accfa8a0 tempest-DeleteServersTestJSON-180782363 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:32:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-4375ca33-1625-4db2-a411-0322accfa8a0 tempest-DeleteServersTestJSON-180782363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:32:54 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-4375ca33-1625-4db2-a411-0322accfa8a0 tempest-DeleteServersTestJSON-180782363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37e5d70e-f925-4711-ae0b-2fc964830e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e65ba20d-3dc7-481b-9e79-2bdd9673588f', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:32:54 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-4375ca33-1625-4db2-a411-0322accfa8a0 tempest-DeleteServersTestJSON-180782363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88f25ec3-597a-42bf-a0ad-6a4d55f61e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:32:54 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-4375ca33-1625-4db2-a411-0322accfa8a0 tempest-DeleteServersTestJSON-180782363 None] Volume volume-e65ba20d-3dc7-481b-9e79-2bdd9673588f (e65ba20d-3dc7-481b-9e79-2bdd9673588f): created successfully Aug 28 09:32:54 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-4375ca33-1625-4db2-a411-0322accfa8a0 tempest-DeleteServersTestJSON-180782363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88f25ec3-597a-42bf-a0ad-6a4d55f61e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:32:54 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-4375ca33-1625-4db2-a411-0322accfa8a0 tempest-DeleteServersTestJSON-180782363 None] Flow 'volume_create_manager' (cecda877-9a9c-4602-a2fc-b745c7584594) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:32:54 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-52c33b43-def2-44de-a3c2-1357c03d44c3 tempest-GroupSnapshotsTest-783586098 None] Update group completed successfully. Aug 28 09:32:54 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-4375ca33-1625-4db2-a411-0322accfa8a0 tempest-DeleteServersTestJSON-180782363 None] Created volume successfully. Aug 28 09:32:54 devstack sudo[88773]: pam_unix(sudo:session): session closed for user root Aug 28 09:32:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e4a9665f-287e-4885-9e75-fadbd532a2e4 tempest-TaggedAttachmentsTest-2146882190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.360s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:32:54 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-e4a9665f-287e-4885-9e75-fadbd532a2e4 tempest-TaggedAttachmentsTest-2146882190 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:32:54 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-e4a9665f-287e-4885-9e75-fadbd532a2e4 tempest-TaggedAttachmentsTest-2146882190 None] Deleted volume successfully. Aug 28 09:32:54 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e4a9665f-287e-4885-9e75-fadbd532a2e4 tempest-TaggedAttachmentsTest-2146882190 None] Lock "cinder-6e9db77d-c7b7-4b10-85e8-aa2ea17be1ad-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:32:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-bf531da5-d79a-405b-b93f-3768512ed59e req-c4666023-c678-4b43-b00e-6f2ecaa84814 tempest-ServerActionsTestOtherA-1923649618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:32:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-bf531da5-d79a-405b-b93f-3768512ed59e req-c4666023-c678-4b43-b00e-6f2ecaa84814 tempest-ServerActionsTestOtherA-1923649618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:32:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-bf531da5-d79a-405b-b93f-3768512ed59e req-c4666023-c678-4b43-b00e-6f2ecaa84814 tempest-ServerActionsTestOtherA-1923649618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:32:55 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-bf531da5-d79a-405b-b93f-3768512ed59e req-c4666023-c678-4b43-b00e-6f2ecaa84814 tempest-ServerActionsTestOtherA-1923649618 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b', 'name': 'volume-eb63f10b-56e5-41f7-85eb-8408c442a334', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bef6b4dd-97cb-4449-8267-acbba4d588ad', 'enforce_multipath': True} {{(pid=86081) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 09:32:55 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-428aba66-ca84-4f92-a18c-fde16764e6b6 tempest-GroupSnapshotsTest-783586098 None] Update group completed successfully. Aug 28 09:32:55 devstack cinder-volume[86081]: INFO cinder.volume.manager [req-bf531da5-d79a-405b-b93f-3768512ed59e req-c4666023-c678-4b43-b00e-6f2ecaa84814 tempest-ServerActionsTestOtherA-1923649618 None] attachment_update completed successfully. Aug 28 09:32:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-404df697-6fe4-4308-a8b0-094e63f027b7 req-6e86a3e9-6bd9-4c9f-b66f-5b7d1f1eda5f tempest-DeleteServersTestJSON-180782363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:32:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-404df697-6fe4-4308-a8b0-094e63f027b7 req-6e86a3e9-6bd9-4c9f-b66f-5b7d1f1eda5f tempest-DeleteServersTestJSON-180782363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:32:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-404df697-6fe4-4308-a8b0-094e63f027b7 req-6e86a3e9-6bd9-4c9f-b66f-5b7d1f1eda5f tempest-DeleteServersTestJSON-180782363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:32:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-404df697-6fe4-4308-a8b0-094e63f027b7 req-6e86a3e9-6bd9-4c9f-b66f-5b7d1f1eda5f tempest-DeleteServersTestJSON-180782363 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b', 'name': 'volume-e65ba20d-3dc7-481b-9e79-2bdd9673588f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '484443e0-f404-4887-823a-f8893e2485f0', 'enforce_multipath': True} {{(pid=86081) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 09:32:56 devstack cinder-volume[86081]: INFO cinder.volume.manager [req-404df697-6fe4-4308-a8b0-094e63f027b7 req-6e86a3e9-6bd9-4c9f-b66f-5b7d1f1eda5f tempest-DeleteServersTestJSON-180782363 None] attachment_update completed successfully. Aug 28 09:32:57 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-0d903f23-0cd3-44c1-a4d9-eeef63dac970 tempest-GroupSnapshotsTest-783586098 None] Update group completed successfully. Aug 28 09:32:59 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-8154950d-ffdc-42f0-944d-b3545953314c tempest-GroupSnapshotsTest-783586098 None] GroupSnapshot a4d6d10d-58cb-456f-9b11-f5715ce51abf: creating. Aug 28 09:32:59 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8154950d-ffdc-42f0-944d-b3545953314c tempest-GroupSnapshotsTest-783586098 None] Group snapshot a4d6d10d-58cb-456f-9b11-f5715ce51abf: creating. {{(pid=86081) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 28 09:32:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8154950d-ffdc-42f0-944d-b3545953314c tempest-GroupSnapshotsTest-783586098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:32:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8154950d-ffdc-42f0-944d-b3545953314c tempest-GroupSnapshotsTest-783586098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:32:59 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-8154950d-ffdc-42f0-944d-b3545953314c tempest-GroupSnapshotsTest-783586098 None] Creating offline snapshot 453c837c-03ec-4b5b-b5d2-bc4eea897ec5 of volume 6b738b3f-9676-42c1-a236-89ee9988fe61 {{(pid=86081) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:32:59 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdb5c91-2953-4b2a-b056-1d0fcef4f6b4]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:32:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8154950d-ffdc-42f0-944d-b3545953314c tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6b738b3f-9676-42c1-a236-89ee9988fe61 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:32:59 devstack sudo[89323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6b738b3f-9676-42c1-a236-89ee9988fe61 Aug 28 09:32:59 devstack sudo[89323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:33:00 devstack sudo[89323]: pam_unix(sudo:session): session closed for user root Aug 28 09:33:00 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8154950d-ffdc-42f0-944d-b3545953314c tempest-GroupSnapshotsTest-783586098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6b738b3f-9676-42c1-a236-89ee9988fe61" returned: 0 in 0.707s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:33:00 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8154950d-ffdc-42f0-944d-b3545953314c tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6b738b3f-9676-42c1-a236-89ee9988fe61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6b738b3f-9676-42c1-a236-89ee9988fe61.453c837c-03ec-4b5b-b5d2-bc4eea897ec5 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:33:00 devstack sudo[89352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6b738b3f-9676-42c1-a236-89ee9988fe61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6b738b3f-9676-42c1-a236-89ee9988fe61.453c837c-03ec-4b5b-b5d2-bc4eea897ec5 1G Aug 28 09:33:00 devstack sudo[89352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:33:01 devstack sudo[89352]: pam_unix(sudo:session): session closed for user root Aug 28 09:33:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8154950d-ffdc-42f0-944d-b3545953314c tempest-GroupSnapshotsTest-783586098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6b738b3f-9676-42c1-a236-89ee9988fe61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6b738b3f-9676-42c1-a236-89ee9988fe61.453c837c-03ec-4b5b-b5d2-bc4eea897ec5 1G" returned: 0 in 0.788s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:33:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8154950d-ffdc-42f0-944d-b3545953314c tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b738b3f-9676-42c1-a236-89ee9988fe61 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6b738b3f-9676-42c1-a236-89ee9988fe61.453c837c-03ec-4b5b-b5d2-bc4eea897ec5 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:33:01 devstack sudo[89363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b738b3f-9676-42c1-a236-89ee9988fe61 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6b738b3f-9676-42c1-a236-89ee9988fe61.453c837c-03ec-4b5b-b5d2-bc4eea897ec5 Aug 28 09:33:01 devstack sudo[89363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:33:01 devstack sudo[89363]: pam_unix(sudo:session): session closed for user root Aug 28 09:33:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8154950d-ffdc-42f0-944d-b3545953314c tempest-GroupSnapshotsTest-783586098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b738b3f-9676-42c1-a236-89ee9988fe61 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6b738b3f-9676-42c1-a236-89ee9988fe61.453c837c-03ec-4b5b-b5d2-bc4eea897ec5" returned: 0 in 0.460s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:33:01 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-8154950d-ffdc-42f0-944d-b3545953314c tempest-GroupSnapshotsTest-783586098 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6b738b3f-9676-42c1-a236-89ee9988fe61.453c837c-03ec-4b5b-b5d2-bc4eea897ec5 is being set with open permissions: ugo+rw: NotImplementedError Aug 28 09:33:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8154950d-ffdc-42f0-944d-b3545953314c tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6b738b3f-9676-42c1-a236-89ee9988fe61.453c837c-03ec-4b5b-b5d2-bc4eea897ec5 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:33:01 devstack sudo[89368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6b738b3f-9676-42c1-a236-89ee9988fe61.453c837c-03ec-4b5b-b5d2-bc4eea897ec5 Aug 28 09:33:01 devstack sudo[89368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:33:01 devstack sudo[89368]: pam_unix(sudo:session): session closed for user root Aug 28 09:33:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8154950d-ffdc-42f0-944d-b3545953314c tempest-GroupSnapshotsTest-783586098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6b738b3f-9676-42c1-a236-89ee9988fe61.453c837c-03ec-4b5b-b5d2-bc4eea897ec5" returned: 0 in 0.355s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:33:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8154950d-ffdc-42f0-944d-b3545953314c tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6b738b3f-9676-42c1-a236-89ee9988fe61.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:33:01 devstack sudo[89372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6b738b3f-9676-42c1-a236-89ee9988fe61.info Aug 28 09:33:01 devstack sudo[89372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:33:02 devstack cinder-volume[86081]: INFO cinder.volume.manager [req-3f01ea9e-564a-4703-a7fa-26086208c10a req-7cfa625a-ae55-4b46-96a6-bf519ef4e236 tempest-DeleteServersTestJSON-180782363 None] Terminate volume connection completed successfully. Aug 28 09:33:02 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-3f01ea9e-564a-4703-a7fa-26086208c10a req-7cfa625a-ae55-4b46-96a6-bf519ef4e236 tempest-DeleteServersTestJSON-180782363 None] Deleting attachment 484443e0-f404-4887-823a-f8893e2485f0. {{(pid=86081) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 09:33:02 devstack sudo[89372]: pam_unix(sudo:session): session closed for user root Aug 28 09:33:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8154950d-ffdc-42f0-944d-b3545953314c tempest-GroupSnapshotsTest-783586098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6b738b3f-9676-42c1-a236-89ee9988fe61.info" returned: 0 in 0.542s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:33:02 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-8154950d-ffdc-42f0-944d-b3545953314c tempest-GroupSnapshotsTest-783586098 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6b738b3f-9676-42c1-a236-89ee9988fe61.info is being set with open permissions: ugo+rw: NotImplementedError Aug 28 09:33:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8154950d-ffdc-42f0-944d-b3545953314c tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6b738b3f-9676-42c1-a236-89ee9988fe61.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:33:02 devstack sudo[89384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6b738b3f-9676-42c1-a236-89ee9988fe61.info Aug 28 09:33:02 devstack sudo[89384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:33:03 devstack sudo[89384]: pam_unix(sudo:session): session closed for user root Aug 28 09:33:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8154950d-ffdc-42f0-944d-b3545953314c tempest-GroupSnapshotsTest-783586098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6b738b3f-9676-42c1-a236-89ee9988fe61.info" returned: 0 in 0.570s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:33:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8154950d-ffdc-42f0-944d-b3545953314c tempest-GroupSnapshotsTest-783586098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.619s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:33:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8154950d-ffdc-42f0-944d-b3545953314c tempest-GroupSnapshotsTest-783586098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:33:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8154950d-ffdc-42f0-944d-b3545953314c tempest-GroupSnapshotsTest-783586098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:33:03 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-8154950d-ffdc-42f0-944d-b3545953314c tempest-GroupSnapshotsTest-783586098 None] Creating offline snapshot 5533b4d4-52e9-4395-8839-57a63457a144 of volume bb2e6a94-1869-4e93-840e-f3bd5c5c4914 {{(pid=86081) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:33:03 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[89669219-f952-481a-add8-51daa82984a8]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:33:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8154950d-ffdc-42f0-944d-b3545953314c tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bb2e6a94-1869-4e93-840e-f3bd5c5c4914 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:33:03 devstack sudo[89387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bb2e6a94-1869-4e93-840e-f3bd5c5c4914 Aug 28 09:33:03 devstack sudo[89387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:33:03 devstack sudo[89387]: pam_unix(sudo:session): session closed for user root Aug 28 09:33:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8154950d-ffdc-42f0-944d-b3545953314c tempest-GroupSnapshotsTest-783586098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bb2e6a94-1869-4e93-840e-f3bd5c5c4914" returned: 0 in 0.462s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:33:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8154950d-ffdc-42f0-944d-b3545953314c tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bb2e6a94-1869-4e93-840e-f3bd5c5c4914,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bb2e6a94-1869-4e93-840e-f3bd5c5c4914.5533b4d4-52e9-4395-8839-57a63457a144 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:33:03 devstack sudo[89392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bb2e6a94-1869-4e93-840e-f3bd5c5c4914,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bb2e6a94-1869-4e93-840e-f3bd5c5c4914.5533b4d4-52e9-4395-8839-57a63457a144 1G Aug 28 09:33:03 devstack sudo[89392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:33:04 devstack sudo[89392]: pam_unix(sudo:session): session closed for user root Aug 28 09:33:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8154950d-ffdc-42f0-944d-b3545953314c tempest-GroupSnapshotsTest-783586098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bb2e6a94-1869-4e93-840e-f3bd5c5c4914,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bb2e6a94-1869-4e93-840e-f3bd5c5c4914.5533b4d4-52e9-4395-8839-57a63457a144 1G" returned: 0 in 0.484s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:33:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8154950d-ffdc-42f0-944d-b3545953314c tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb2e6a94-1869-4e93-840e-f3bd5c5c4914 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bb2e6a94-1869-4e93-840e-f3bd5c5c4914.5533b4d4-52e9-4395-8839-57a63457a144 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:33:04 devstack sudo[89398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb2e6a94-1869-4e93-840e-f3bd5c5c4914 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bb2e6a94-1869-4e93-840e-f3bd5c5c4914.5533b4d4-52e9-4395-8839-57a63457a144 Aug 28 09:33:04 devstack sudo[89398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:33:04 devstack sudo[89398]: pam_unix(sudo:session): session closed for user root Aug 28 09:33:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8154950d-ffdc-42f0-944d-b3545953314c tempest-GroupSnapshotsTest-783586098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb2e6a94-1869-4e93-840e-f3bd5c5c4914 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bb2e6a94-1869-4e93-840e-f3bd5c5c4914.5533b4d4-52e9-4395-8839-57a63457a144" returned: 0 in 0.332s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:33:04 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-8154950d-ffdc-42f0-944d-b3545953314c tempest-GroupSnapshotsTest-783586098 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bb2e6a94-1869-4e93-840e-f3bd5c5c4914.5533b4d4-52e9-4395-8839-57a63457a144 is being set with open permissions: ugo+rw: NotImplementedError Aug 28 09:33:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8154950d-ffdc-42f0-944d-b3545953314c tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bb2e6a94-1869-4e93-840e-f3bd5c5c4914.5533b4d4-52e9-4395-8839-57a63457a144 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:33:04 devstack sudo[89405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bb2e6a94-1869-4e93-840e-f3bd5c5c4914.5533b4d4-52e9-4395-8839-57a63457a144 Aug 28 09:33:04 devstack sudo[89405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:33:04 devstack sudo[89405]: pam_unix(sudo:session): session closed for user root Aug 28 09:33:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8154950d-ffdc-42f0-944d-b3545953314c tempest-GroupSnapshotsTest-783586098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bb2e6a94-1869-4e93-840e-f3bd5c5c4914.5533b4d4-52e9-4395-8839-57a63457a144" returned: 0 in 0.264s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:33:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8154950d-ffdc-42f0-944d-b3545953314c tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bb2e6a94-1869-4e93-840e-f3bd5c5c4914.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:33:04 devstack sudo[89408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bb2e6a94-1869-4e93-840e-f3bd5c5c4914.info Aug 28 09:33:04 devstack sudo[89408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:33:04 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-94c0bc11-0493-4916-a79c-13716564a918 tempest-DeleteServersTestJSON-180782363 None] Acquiring lock "cinder-e65ba20d-3dc7-481b-9e79-2bdd9673588f-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:33:05 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-94c0bc11-0493-4916-a79c-13716564a918 tempest-DeleteServersTestJSON-180782363 None] Lock "cinder-e65ba20d-3dc7-481b-9e79-2bdd9673588f-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:33:05 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-94c0bc11-0493-4916-a79c-13716564a918 tempest-DeleteServersTestJSON-180782363 None] Acquiring lock "cinder-quobyte-e65ba20d-3dc7-481b-9e79-2bdd9673588f" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:33:05 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-94c0bc11-0493-4916-a79c-13716564a918 tempest-DeleteServersTestJSON-180782363 None] Lock "cinder-quobyte-e65ba20d-3dc7-481b-9e79-2bdd9673588f" acquired by "delete_volume" :: waited 0.023s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:33:05 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[2593b3ff-bd22-4d48-bfa9-d53183499a7a]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:33:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-94c0bc11-0493-4916-a79c-13716564a918 tempest-DeleteServersTestJSON-180782363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e65ba20d-3dc7-481b-9e79-2bdd9673588f {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:33:05 devstack sudo[89408]: pam_unix(sudo:session): session closed for user root Aug 28 09:33:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8154950d-ffdc-42f0-944d-b3545953314c tempest-GroupSnapshotsTest-783586098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bb2e6a94-1869-4e93-840e-f3bd5c5c4914.info" returned: 0 in 0.435s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:33:05 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-8154950d-ffdc-42f0-944d-b3545953314c tempest-GroupSnapshotsTest-783586098 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bb2e6a94-1869-4e93-840e-f3bd5c5c4914.info is being set with open permissions: ugo+rw: NotImplementedError Aug 28 09:33:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8154950d-ffdc-42f0-944d-b3545953314c tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bb2e6a94-1869-4e93-840e-f3bd5c5c4914.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:33:05 devstack sudo[89412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bb2e6a94-1869-4e93-840e-f3bd5c5c4914.info Aug 28 09:33:05 devstack sudo[89412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:33:05 devstack sudo[89411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e65ba20d-3dc7-481b-9e79-2bdd9673588f Aug 28 09:33:05 devstack sudo[89411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:33:05 devstack sudo[89412]: pam_unix(sudo:session): session closed for user root Aug 28 09:33:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8154950d-ffdc-42f0-944d-b3545953314c tempest-GroupSnapshotsTest-783586098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bb2e6a94-1869-4e93-840e-f3bd5c5c4914.info" returned: 0 in 0.302s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:33:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8154950d-ffdc-42f0-944d-b3545953314c tempest-GroupSnapshotsTest-783586098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.423s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:33:05 devstack sudo[89411]: pam_unix(sudo:session): session closed for user root Aug 28 09:33:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-94c0bc11-0493-4916-a79c-13716564a918 tempest-DeleteServersTestJSON-180782363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e65ba20d-3dc7-481b-9e79-2bdd9673588f" returned: 0 in 0.452s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:33:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-94c0bc11-0493-4916-a79c-13716564a918 tempest-DeleteServersTestJSON-180782363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e65ba20d-3dc7-481b-9e79-2bdd9673588f {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:33:05 devstack sudo[89420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e65ba20d-3dc7-481b-9e79-2bdd9673588f Aug 28 09:33:05 devstack sudo[89420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:33:05 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-8154950d-ffdc-42f0-944d-b3545953314c tempest-GroupSnapshotsTest-783586098 None] group_snapshot a4d6d10d-58cb-456f-9b11-f5715ce51abf: created successfully Aug 28 09:33:05 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-ba450693-a8f5-466d-b3d5-bcd902c23ea6 tempest-GroupSnapshotsTest-783586098 None] group_snapshot a4d6d10d-58cb-456f-9b11-f5715ce51abf: deleting Aug 28 09:33:05 devstack sudo[89420]: pam_unix(sudo:session): session closed for user root Aug 28 09:33:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-94c0bc11-0493-4916-a79c-13716564a918 tempest-DeleteServersTestJSON-180782363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e65ba20d-3dc7-481b-9e79-2bdd9673588f" returned: 0 in 0.386s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:33:06 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-94c0bc11-0493-4916-a79c-13716564a918 tempest-DeleteServersTestJSON-180782363 None] Lock "cinder-quobyte-e65ba20d-3dc7-481b-9e79-2bdd9673588f" released by "delete_volume" :: held 0.901s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:33:06 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ba450693-a8f5-466d-b3d5-bcd902c23ea6 tempest-GroupSnapshotsTest-783586098 None] group_snapshot a4d6d10d-58cb-456f-9b11-f5715ce51abf: deleting {{(pid=86081) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 28 09:33:06 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ba450693-a8f5-466d-b3d5-bcd902c23ea6 tempest-GroupSnapshotsTest-783586098 None] Acquiring lock "cinder-quobyte-6b738b3f-9676-42c1-a236-89ee9988fe61" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:33:06 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ba450693-a8f5-466d-b3d5-bcd902c23ea6 tempest-GroupSnapshotsTest-783586098 None] Lock "cinder-quobyte-6b738b3f-9676-42c1-a236-89ee9988fe61" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:33:06 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ba450693-a8f5-466d-b3d5-bcd902c23ea6 tempest-GroupSnapshotsTest-783586098 None] Acquiring lock "cinder-quobyte-453c837c-03ec-4b5b-b5d2-bc4eea897ec5" by "_delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:33:06 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ba450693-a8f5-466d-b3d5-bcd902c23ea6 tempest-GroupSnapshotsTest-783586098 None] Lock "cinder-quobyte-453c837c-03ec-4b5b-b5d2-bc4eea897ec5" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:33:06 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-ba450693-a8f5-466d-b3d5-bcd902c23ea6 tempest-GroupSnapshotsTest-783586098 None] Deleting offline snapshot 453c837c-03ec-4b5b-b5d2-bc4eea897ec5 of volume 6b738b3f-9676-42c1-a236-89ee9988fe61 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:33:06 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-ba450693-a8f5-466d-b3d5-bcd902c23ea6 tempest-GroupSnapshotsTest-783586098 None] snapshot_file for this snap is: volume-6b738b3f-9676-42c1-a236-89ee9988fe61.453c837c-03ec-4b5b-b5d2-bc4eea897ec5 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:33:06 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-94c0bc11-0493-4916-a79c-13716564a918 tempest-DeleteServersTestJSON-180782363 None] Created reservations ['710a9701-3623-4f08-a0e1-a53af76cb8f0', '7730c6da-3a56-401a-a921-e58c7c3675ca', '7d2f3f08-b45f-48d5-bc82-c03cad4c0a87', 'ebb7282d-06e0-44f7-a7c8-50f2d7044a47'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:33:06 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[30fee105-ac42-4fb3-a4ab-1ec2fdceef69]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:33:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ba450693-a8f5-466d-b3d5-bcd902c23ea6 tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6b738b3f-9676-42c1-a236-89ee9988fe61.453c837c-03ec-4b5b-b5d2-bc4eea897ec5 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:33:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-94c0bc11-0493-4916-a79c-13716564a918 tempest-DeleteServersTestJSON-180782363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:33:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-94c0bc11-0493-4916-a79c-13716564a918 tempest-DeleteServersTestJSON-180782363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:33:06 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-94c0bc11-0493-4916-a79c-13716564a918 tempest-DeleteServersTestJSON-180782363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:33:06 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-94c0bc11-0493-4916-a79c-13716564a918 tempest-DeleteServersTestJSON-180782363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:33:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-94c0bc11-0493-4916-a79c-13716564a918 tempest-DeleteServersTestJSON-180782363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:33:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-94c0bc11-0493-4916-a79c-13716564a918 tempest-DeleteServersTestJSON-180782363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:33:06 devstack sudo[89425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:33:06 devstack sudo[89425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:33:06 devstack sudo[89424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6b738b3f-9676-42c1-a236-89ee9988fe61.453c837c-03ec-4b5b-b5d2-bc4eea897ec5 Aug 28 09:33:06 devstack sudo[89424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:33:06 devstack sudo[89425]: pam_unix(sudo:session): session closed for user root Aug 28 09:33:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-94c0bc11-0493-4916-a79c-13716564a918 tempest-DeleteServersTestJSON-180782363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.292s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:33:06 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-94c0bc11-0493-4916-a79c-13716564a918 tempest-DeleteServersTestJSON-180782363 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:33:06 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-94c0bc11-0493-4916-a79c-13716564a918 tempest-DeleteServersTestJSON-180782363 None] Deleted volume successfully. Aug 28 09:33:06 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-94c0bc11-0493-4916-a79c-13716564a918 tempest-DeleteServersTestJSON-180782363 None] Lock "cinder-e65ba20d-3dc7-481b-9e79-2bdd9673588f-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:33:06 devstack sudo[89424]: pam_unix(sudo:session): session closed for user root Aug 28 09:33:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ba450693-a8f5-466d-b3d5-bcd902c23ea6 tempest-GroupSnapshotsTest-783586098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6b738b3f-9676-42c1-a236-89ee9988fe61.453c837c-03ec-4b5b-b5d2-bc4eea897ec5" returned: 0 in 0.573s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:33:06 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-ba450693-a8f5-466d-b3d5-bcd902c23ea6 tempest-GroupSnapshotsTest-783586098 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b738b3f-9676-42c1-a236-89ee9988fe61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:33:06 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[a912daa5-a4fe-41e9-bad7-01f3d6550b1a]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:33:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ba450693-a8f5-466d-b3d5-bcd902c23ea6 tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6b738b3f-9676-42c1-a236-89ee9988fe61 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:33:06 devstack sudo[89432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6b738b3f-9676-42c1-a236-89ee9988fe61 Aug 28 09:33:06 devstack sudo[89432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:33:07 devstack sudo[89432]: pam_unix(sudo:session): session closed for user root Aug 28 09:33:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ba450693-a8f5-466d-b3d5-bcd902c23ea6 tempest-GroupSnapshotsTest-783586098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6b738b3f-9676-42c1-a236-89ee9988fe61" returned: 0 in 0.455s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:33:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ba450693-a8f5-466d-b3d5-bcd902c23ea6 tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6b738b3f-9676-42c1-a236-89ee9988fe61.453c837c-03ec-4b5b-b5d2-bc4eea897ec5 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:33:07 devstack sudo[89437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6b738b3f-9676-42c1-a236-89ee9988fe61.453c837c-03ec-4b5b-b5d2-bc4eea897ec5 Aug 28 09:33:07 devstack sudo[89437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:33:07 devstack sudo[89437]: pam_unix(sudo:session): session closed for user root Aug 28 09:33:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ba450693-a8f5-466d-b3d5-bcd902c23ea6 tempest-GroupSnapshotsTest-783586098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6b738b3f-9676-42c1-a236-89ee9988fe61.453c837c-03ec-4b5b-b5d2-bc4eea897ec5" returned: 0 in 0.383s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:33:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ba450693-a8f5-466d-b3d5-bcd902c23ea6 tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6b738b3f-9676-42c1-a236-89ee9988fe61.453c837c-03ec-4b5b-b5d2-bc4eea897ec5 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:33:07 devstack sudo[89443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6b738b3f-9676-42c1-a236-89ee9988fe61.453c837c-03ec-4b5b-b5d2-bc4eea897ec5 Aug 28 09:33:07 devstack sudo[89443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:33:07 devstack sudo[89443]: pam_unix(sudo:session): session closed for user root Aug 28 09:33:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ba450693-a8f5-466d-b3d5-bcd902c23ea6 tempest-GroupSnapshotsTest-783586098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6b738b3f-9676-42c1-a236-89ee9988fe61.453c837c-03ec-4b5b-b5d2-bc4eea897ec5" returned: 0 in 0.250s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:33:07 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ba450693-a8f5-466d-b3d5-bcd902c23ea6 tempest-GroupSnapshotsTest-783586098 None] Lock "cinder-quobyte-453c837c-03ec-4b5b-b5d2-bc4eea897ec5" released by "_delete_snapshot" :: held 1.814s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:33:07 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ba450693-a8f5-466d-b3d5-bcd902c23ea6 tempest-GroupSnapshotsTest-783586098 None] Lock "cinder-quobyte-6b738b3f-9676-42c1-a236-89ee9988fe61" released by "delete_snapshot" :: held 1.860s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:33:07 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ba450693-a8f5-466d-b3d5-bcd902c23ea6 tempest-GroupSnapshotsTest-783586098 None] Acquiring lock "cinder-quobyte-bb2e6a94-1869-4e93-840e-f3bd5c5c4914" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:33:08 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ba450693-a8f5-466d-b3d5-bcd902c23ea6 tempest-GroupSnapshotsTest-783586098 None] Lock "cinder-quobyte-bb2e6a94-1869-4e93-840e-f3bd5c5c4914" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:33:08 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ba450693-a8f5-466d-b3d5-bcd902c23ea6 tempest-GroupSnapshotsTest-783586098 None] Acquiring lock "cinder-quobyte-5533b4d4-52e9-4395-8839-57a63457a144" by "_delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:33:08 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ba450693-a8f5-466d-b3d5-bcd902c23ea6 tempest-GroupSnapshotsTest-783586098 None] Lock "cinder-quobyte-5533b4d4-52e9-4395-8839-57a63457a144" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:33:08 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-ba450693-a8f5-466d-b3d5-bcd902c23ea6 tempest-GroupSnapshotsTest-783586098 None] Deleting offline snapshot 5533b4d4-52e9-4395-8839-57a63457a144 of volume bb2e6a94-1869-4e93-840e-f3bd5c5c4914 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:33:08 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-ba450693-a8f5-466d-b3d5-bcd902c23ea6 tempest-GroupSnapshotsTest-783586098 None] snapshot_file for this snap is: volume-bb2e6a94-1869-4e93-840e-f3bd5c5c4914.5533b4d4-52e9-4395-8839-57a63457a144 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:33:08 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a248d6-04d6-44e2-b989-17afa623d6ae]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:33:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ba450693-a8f5-466d-b3d5-bcd902c23ea6 tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bb2e6a94-1869-4e93-840e-f3bd5c5c4914.5533b4d4-52e9-4395-8839-57a63457a144 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:33:08 devstack sudo[89446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bb2e6a94-1869-4e93-840e-f3bd5c5c4914.5533b4d4-52e9-4395-8839-57a63457a144 Aug 28 09:33:08 devstack sudo[89446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:33:08 devstack sudo[89446]: pam_unix(sudo:session): session closed for user root Aug 28 09:33:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ba450693-a8f5-466d-b3d5-bcd902c23ea6 tempest-GroupSnapshotsTest-783586098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bb2e6a94-1869-4e93-840e-f3bd5c5c4914.5533b4d4-52e9-4395-8839-57a63457a144" returned: 0 in 0.687s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:33:08 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-ba450693-a8f5-466d-b3d5-bcd902c23ea6 tempest-GroupSnapshotsTest-783586098 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb2e6a94-1869-4e93-840e-f3bd5c5c4914(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:33:08 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[afdeda9b-674a-42dc-be1c-94118770b753]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:33:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ba450693-a8f5-466d-b3d5-bcd902c23ea6 tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bb2e6a94-1869-4e93-840e-f3bd5c5c4914 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:33:08 devstack sudo[89452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bb2e6a94-1869-4e93-840e-f3bd5c5c4914 Aug 28 09:33:08 devstack sudo[89452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:33:09 devstack sudo[89452]: pam_unix(sudo:session): session closed for user root Aug 28 09:33:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ba450693-a8f5-466d-b3d5-bcd902c23ea6 tempest-GroupSnapshotsTest-783586098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bb2e6a94-1869-4e93-840e-f3bd5c5c4914" returned: 0 in 0.535s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:33:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ba450693-a8f5-466d-b3d5-bcd902c23ea6 tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bb2e6a94-1869-4e93-840e-f3bd5c5c4914.5533b4d4-52e9-4395-8839-57a63457a144 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:33:09 devstack sudo[89458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bb2e6a94-1869-4e93-840e-f3bd5c5c4914.5533b4d4-52e9-4395-8839-57a63457a144 Aug 28 09:33:09 devstack sudo[89458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:33:09 devstack sudo[89458]: pam_unix(sudo:session): session closed for user root Aug 28 09:33:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ba450693-a8f5-466d-b3d5-bcd902c23ea6 tempest-GroupSnapshotsTest-783586098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bb2e6a94-1869-4e93-840e-f3bd5c5c4914.5533b4d4-52e9-4395-8839-57a63457a144" returned: 0 in 0.504s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:33:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ba450693-a8f5-466d-b3d5-bcd902c23ea6 tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bb2e6a94-1869-4e93-840e-f3bd5c5c4914.5533b4d4-52e9-4395-8839-57a63457a144 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:33:09 devstack sudo[89464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bb2e6a94-1869-4e93-840e-f3bd5c5c4914.5533b4d4-52e9-4395-8839-57a63457a144 Aug 28 09:33:09 devstack sudo[89464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:33:10 devstack sudo[89464]: pam_unix(sudo:session): session closed for user root Aug 28 09:33:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ba450693-a8f5-466d-b3d5-bcd902c23ea6 tempest-GroupSnapshotsTest-783586098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bb2e6a94-1869-4e93-840e-f3bd5c5c4914.5533b4d4-52e9-4395-8839-57a63457a144" returned: 0 in 0.340s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:33:10 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ba450693-a8f5-466d-b3d5-bcd902c23ea6 tempest-GroupSnapshotsTest-783586098 None] Lock "cinder-quobyte-5533b4d4-52e9-4395-8839-57a63457a144" released by "_delete_snapshot" :: held 2.176s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:33:10 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ba450693-a8f5-466d-b3d5-bcd902c23ea6 tempest-GroupSnapshotsTest-783586098 None] Lock "cinder-quobyte-bb2e6a94-1869-4e93-840e-f3bd5c5c4914" released by "delete_snapshot" :: held 2.218s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:33:10 devstack cinder-volume[86081]: WARNING cinder.quota [None req-ba450693-a8f5-466d-b3d5-bcd902c23ea6 tempest-GroupSnapshotsTest-783586098 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-229743566 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-229743566, it is now deprecated. Please use the default quota class for default quota. Aug 28 09:33:10 devstack cinder-volume[86081]: WARNING cinder.quota [None req-ba450693-a8f5-466d-b3d5-bcd902c23ea6 tempest-GroupSnapshotsTest-783586098 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-229743566 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-229743566, it is now deprecated. Please use the default quota class for default quota. Aug 28 09:33:10 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-ba450693-a8f5-466d-b3d5-bcd902c23ea6 tempest-GroupSnapshotsTest-783586098 None] Created reservations ['21f69702-81fe-4b4d-a7d8-fa5ddf954856', 'bd1140dc-f555-4946-aeab-5b6adadb73f4', '86a49b65-8c07-4b85-b80e-d85957899f21', '14681fa7-754f-48b5-8bc5-61083cb6a27d'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:33:10 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-ba450693-a8f5-466d-b3d5-bcd902c23ea6 tempest-GroupSnapshotsTest-783586098 None] Created reservations ['25da2b74-6e57-4fc3-96de-aad2ddd7478b', '7eba1378-84fb-4018-99e0-6b6020f71651', 'a899a24c-f852-4460-970c-644a9b058e6c', 'b031bb2b-5f37-416c-8eeb-353d93dff23b'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:33:10 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-ba450693-a8f5-466d-b3d5-bcd902c23ea6 tempest-GroupSnapshotsTest-783586098 None] group_snapshot a4d6d10d-58cb-456f-9b11-f5715ce51abf: deleted successfully Aug 28 09:33:11 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-5502498b-81e7-452b-ad59-3172c4140a30 tempest-GroupSnapshotsTest-783586098 None] Acquiring lock "cinder-quobyte-6b738b3f-9676-42c1-a236-89ee9988fe61" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:33:11 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-5502498b-81e7-452b-ad59-3172c4140a30 tempest-GroupSnapshotsTest-783586098 None] Lock "cinder-quobyte-6b738b3f-9676-42c1-a236-89ee9988fe61" acquired by "delete_volume" :: waited 0.026s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:33:11 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[06149736-555c-4719-9f8e-e007cf1ceda2]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:33:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5502498b-81e7-452b-ad59-3172c4140a30 tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6b738b3f-9676-42c1-a236-89ee9988fe61 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:33:11 devstack sudo[89467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6b738b3f-9676-42c1-a236-89ee9988fe61 Aug 28 09:33:11 devstack sudo[89467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:33:11 devstack sudo[89467]: pam_unix(sudo:session): session closed for user root Aug 28 09:33:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5502498b-81e7-452b-ad59-3172c4140a30 tempest-GroupSnapshotsTest-783586098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6b738b3f-9676-42c1-a236-89ee9988fe61" returned: 0 in 0.638s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:33:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5502498b-81e7-452b-ad59-3172c4140a30 tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6b738b3f-9676-42c1-a236-89ee9988fe61 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:33:11 devstack sudo[89473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6b738b3f-9676-42c1-a236-89ee9988fe61 Aug 28 09:33:11 devstack sudo[89473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:33:12 devstack sudo[89473]: pam_unix(sudo:session): session closed for user root Aug 28 09:33:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5502498b-81e7-452b-ad59-3172c4140a30 tempest-GroupSnapshotsTest-783586098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6b738b3f-9676-42c1-a236-89ee9988fe61" returned: 0 in 0.379s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:33:12 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-5502498b-81e7-452b-ad59-3172c4140a30 tempest-GroupSnapshotsTest-783586098 None] Lock "cinder-quobyte-6b738b3f-9676-42c1-a236-89ee9988fe61" released by "delete_volume" :: held 1.109s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:33:12 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-5502498b-81e7-452b-ad59-3172c4140a30 tempest-GroupSnapshotsTest-783586098 None] Acquiring lock "cinder-quobyte-bb2e6a94-1869-4e93-840e-f3bd5c5c4914" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:33:12 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-5502498b-81e7-452b-ad59-3172c4140a30 tempest-GroupSnapshotsTest-783586098 None] Lock "cinder-quobyte-bb2e6a94-1869-4e93-840e-f3bd5c5c4914" acquired by "delete_volume" :: waited 0.031s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:33:12 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4127abe-9744-4afe-bb2e-9e92743451e7]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:33:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5502498b-81e7-452b-ad59-3172c4140a30 tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bb2e6a94-1869-4e93-840e-f3bd5c5c4914 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:33:12 devstack sudo[89476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bb2e6a94-1869-4e93-840e-f3bd5c5c4914 Aug 28 09:33:12 devstack sudo[89476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:33:13 devstack sudo[89476]: pam_unix(sudo:session): session closed for user root Aug 28 09:33:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5502498b-81e7-452b-ad59-3172c4140a30 tempest-GroupSnapshotsTest-783586098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bb2e6a94-1869-4e93-840e-f3bd5c5c4914" returned: 0 in 0.687s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:33:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5502498b-81e7-452b-ad59-3172c4140a30 tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bb2e6a94-1869-4e93-840e-f3bd5c5c4914 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:33:13 devstack sudo[89503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bb2e6a94-1869-4e93-840e-f3bd5c5c4914 Aug 28 09:33:13 devstack sudo[89503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:33:13 devstack sudo[89503]: pam_unix(sudo:session): session closed for user root Aug 28 09:33:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5502498b-81e7-452b-ad59-3172c4140a30 tempest-GroupSnapshotsTest-783586098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-bb2e6a94-1869-4e93-840e-f3bd5c5c4914" returned: 0 in 0.305s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:33:13 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-5502498b-81e7-452b-ad59-3172c4140a30 tempest-GroupSnapshotsTest-783586098 None] Lock "cinder-quobyte-bb2e6a94-1869-4e93-840e-f3bd5c5c4914" released by "delete_volume" :: held 1.078s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:33:13 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-5502498b-81e7-452b-ad59-3172c4140a30 tempest-GroupSnapshotsTest-783586098 None] Created reservations ['c78939ef-51e7-4517-874c-9e17991d4ecc'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:33:13 devstack cinder-volume[86081]: WARNING cinder.quota [None req-5502498b-81e7-452b-ad59-3172c4140a30 tempest-GroupSnapshotsTest-783586098 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-229743566 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-229743566, it is now deprecated. Please use the default quota class for default quota. Aug 28 09:33:13 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-5502498b-81e7-452b-ad59-3172c4140a30 tempest-GroupSnapshotsTest-783586098 None] Created reservations ['6112e616-1250-4b31-858a-16fd45f754c7', '9d2db060-b717-4ca1-8ccf-9d92b1aa3b29', '14990ac8-77fb-4bae-bbfa-7b1d8452b871', '167679a3-629a-414e-8454-0959da972625'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:33:13 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-5502498b-81e7-452b-ad59-3172c4140a30 tempest-GroupSnapshotsTest-783586098 None] Created reservations ['5e1f7853-a63a-4f36-be3c-d6fe941af298', 'a46749be-32a4-4eeb-b87f-d7a34fdded06', '27eedcab-b88d-49fb-9542-c15a352de8f2', '4d3dc59f-1c11-4028-9ea5-00d26f3ae4a9'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:33:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-5502498b-81e7-452b-ad59-3172c4140a30 tempest-GroupSnapshotsTest-783586098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:33:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-5502498b-81e7-452b-ad59-3172c4140a30 tempest-GroupSnapshotsTest-783586098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:33:13 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-5502498b-81e7-452b-ad59-3172c4140a30 tempest-GroupSnapshotsTest-783586098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:33:13 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-5502498b-81e7-452b-ad59-3172c4140a30 tempest-GroupSnapshotsTest-783586098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:33:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-5502498b-81e7-452b-ad59-3172c4140a30 tempest-GroupSnapshotsTest-783586098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:33:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5502498b-81e7-452b-ad59-3172c4140a30 tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:33:13 devstack sudo[89506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:33:13 devstack sudo[89506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:33:14 devstack sudo[89506]: pam_unix(sudo:session): session closed for user root Aug 28 09:33:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5502498b-81e7-452b-ad59-3172c4140a30 tempest-GroupSnapshotsTest-783586098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.281s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:33:14 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-5502498b-81e7-452b-ad59-3172c4140a30 tempest-GroupSnapshotsTest-783586098 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:33:14 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-5502498b-81e7-452b-ad59-3172c4140a30 tempest-GroupSnapshotsTest-783586098 None] Delete group completed successfully. Aug 28 09:33:15 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-192edd1e-158d-4c62-a999-1502c5e63144 tempest-GroupSnapshotsTest-783586098 None] Group tempest-GroupSnapshotsTest-Group-815027167: creating Aug 28 09:33:15 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-192edd1e-158d-4c62-a999-1502c5e63144 tempest-GroupSnapshotsTest-783586098 None] Group tempest-GroupSnapshotsTest-Group-815027167: created successfully Aug 28 09:33:15 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-192edd1e-158d-4c62-a999-1502c5e63144 tempest-GroupSnapshotsTest-783586098 None] Create group completed successfully. Aug 28 09:33:17 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fa63a9c-6ff0-47b8-a9e4-f877bb4f49c3 tempest-GroupSnapshotsTest-783586098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:33:17 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6fa63a9c-6ff0-47b8-a9e4-f877bb4f49c3 tempest-GroupSnapshotsTest-783586098 None] Flow 'volume_create_manager' (dea54259-5fcb-4533-a933-73ecd0c1dab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:33:17 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6fa63a9c-6ff0-47b8-a9e4-f877bb4f49c3 tempest-GroupSnapshotsTest-783586098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe8ed019-599c-4bcd-96c4-a71ee177e75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:33:17 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6fa63a9c-6ff0-47b8-a9e4-f877bb4f49c3 tempest-GroupSnapshotsTest-783586098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe8ed019-599c-4bcd-96c4-a71ee177e75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:33:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1356067994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7c981334-d4c7-402a-9ab7-e0f5186b1997,host='devstack@QuobyteHD#QuobyteHD',id=889032eb-75dd-4c8d-ae55-352855603717,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ca1454757b54cb1bd6619f17d31e51c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:33:17Z,use_quota=True,user_id='ff70ade6cc2a4cdda5c9d83a8b6b4fcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14982276-46c1-43c9-aeb1-d59f9ff3ad53),volume_type_id=14982276-46c1-43c9-aeb1-d59f9ff3ad53)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:33:17 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6fa63a9c-6ff0-47b8-a9e4-f877bb4f49c3 tempest-GroupSnapshotsTest-783586098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc70e573-67f4-4856-a52a-f6e372406cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:33:17 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6fa63a9c-6ff0-47b8-a9e4-f877bb4f49c3 tempest-GroupSnapshotsTest-783586098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc70e573-67f4-4856-a52a-f6e372406cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:33:17 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6fa63a9c-6ff0-47b8-a9e4-f877bb4f49c3 tempest-GroupSnapshotsTest-783586098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8b7b7f8-c905-4988-9b80-08ad4dcdac52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:33:17 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6fa63a9c-6ff0-47b8-a9e4-f877bb4f49c3 tempest-GroupSnapshotsTest-783586098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8b7b7f8-c905-4988-9b80-08ad4dcdac52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '889032eb-75dd-4c8d-ae55-352855603717', 'volume_name': 'volume-889032eb-75dd-4c8d-ae55-352855603717', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:33:17 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6fa63a9c-6ff0-47b8-a9e4-f877bb4f49c3 tempest-GroupSnapshotsTest-783586098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b944abfc-5579-44df-b784-d6f0f4839ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:33:17 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6fa63a9c-6ff0-47b8-a9e4-f877bb4f49c3 tempest-GroupSnapshotsTest-783586098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b944abfc-5579-44df-b784-d6f0f4839ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:33:17 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6fa63a9c-6ff0-47b8-a9e4-f877bb4f49c3 tempest-GroupSnapshotsTest-783586098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50619f51-34ad-4954-ac83-4f2493ed289c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:33:17 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-6fa63a9c-6ff0-47b8-a9e4-f877bb4f49c3 tempest-GroupSnapshotsTest-783586098 None] Volume 889032eb-75dd-4c8d-ae55-352855603717: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-889032eb-75dd-4c8d-ae55-352855603717', 'volume_size': 1} Aug 28 09:33:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-6fa63a9c-6ff0-47b8-a9e4-f877bb4f49c3 tempest-GroupSnapshotsTest-783586098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:33:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-6fa63a9c-6ff0-47b8-a9e4-f877bb4f49c3 tempest-GroupSnapshotsTest-783586098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:33:17 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-6fa63a9c-6ff0-47b8-a9e4-f877bb4f49c3 tempest-GroupSnapshotsTest-783586098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7c981334-d4c7-402a-9ab7-e0f5186b1997,created_at=2026-08-28T07:33:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1356067994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7c981334-d4c7-402a-9ab7-e0f5186b1997,host='devstack@QuobyteHD#QuobyteHD',id=889032eb-75dd-4c8d-ae55-352855603717,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ca1454757b54cb1bd6619f17d31e51c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:33:17Z,use_quota=True,user_id='ff70ade6cc2a4cdda5c9d83a8b6b4fcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14982276-46c1-43c9-aeb1-d59f9ff3ad53),volume_type_id=14982276-46c1-43c9-aeb1-d59f9ff3ad53)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:33:17 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-6fa63a9c-6ff0-47b8-a9e4-f877bb4f49c3 tempest-GroupSnapshotsTest-783586098 None] Creating volume 889032eb-75dd-4c8d-ae55-352855603717 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:33:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-6fa63a9c-6ff0-47b8-a9e4-f877bb4f49c3 tempest-GroupSnapshotsTest-783586098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:33:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-6fa63a9c-6ff0-47b8-a9e4-f877bb4f49c3 tempest-GroupSnapshotsTest-783586098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:33:17 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-6fa63a9c-6ff0-47b8-a9e4-f877bb4f49c3 tempest-GroupSnapshotsTest-783586098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:33:17 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-6fa63a9c-6ff0-47b8-a9e4-f877bb4f49c3 tempest-GroupSnapshotsTest-783586098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:33:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-6fa63a9c-6ff0-47b8-a9e4-f877bb4f49c3 tempest-GroupSnapshotsTest-783586098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:33:17 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-6fa63a9c-6ff0-47b8-a9e4-f877bb4f49c3 tempest-GroupSnapshotsTest-783586098 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:33:17 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-6fa63a9c-6ff0-47b8-a9e4-f877bb4f49c3 tempest-GroupSnapshotsTest-783586098 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:33:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6fa63a9c-6ff0-47b8-a9e4-f877bb4f49c3 tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-889032eb-75dd-4c8d-ae55-352855603717 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:33:17 devstack sudo[89535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-889032eb-75dd-4c8d-ae55-352855603717 1073741824 Aug 28 09:33:17 devstack sudo[89535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:33:18 devstack sudo[89535]: pam_unix(sudo:session): session closed for user root Aug 28 09:33:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6fa63a9c-6ff0-47b8-a9e4-f877bb4f49c3 tempest-GroupSnapshotsTest-783586098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-889032eb-75dd-4c8d-ae55-352855603717 1073741824" returned: 0 in 0.548s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:33:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6fa63a9c-6ff0-47b8-a9e4-f877bb4f49c3 tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-889032eb-75dd-4c8d-ae55-352855603717 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:33:18 devstack sudo[89541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-889032eb-75dd-4c8d-ae55-352855603717 Aug 28 09:33:18 devstack sudo[89541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:33:18 devstack sudo[89541]: pam_unix(sudo:session): session closed for user root Aug 28 09:33:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6fa63a9c-6ff0-47b8-a9e4-f877bb4f49c3 tempest-GroupSnapshotsTest-783586098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-889032eb-75dd-4c8d-ae55-352855603717" returned: 0 in 0.295s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:33:18 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-6fa63a9c-6ff0-47b8-a9e4-f877bb4f49c3 tempest-GroupSnapshotsTest-783586098 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:33:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-6fa63a9c-6ff0-47b8-a9e4-f877bb4f49c3 tempest-GroupSnapshotsTest-783586098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:33:18 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6fa63a9c-6ff0-47b8-a9e4-f877bb4f49c3 tempest-GroupSnapshotsTest-783586098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50619f51-34ad-4954-ac83-4f2493ed289c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-889032eb-75dd-4c8d-ae55-352855603717', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:33:18 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6fa63a9c-6ff0-47b8-a9e4-f877bb4f49c3 tempest-GroupSnapshotsTest-783586098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1f33744-b615-4fd9-ac9c-88ef30df968b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:33:18 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-6fa63a9c-6ff0-47b8-a9e4-f877bb4f49c3 tempest-GroupSnapshotsTest-783586098 None] Volume volume-889032eb-75dd-4c8d-ae55-352855603717 (889032eb-75dd-4c8d-ae55-352855603717): created successfully Aug 28 09:33:18 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6fa63a9c-6ff0-47b8-a9e4-f877bb4f49c3 tempest-GroupSnapshotsTest-783586098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1f33744-b615-4fd9-ac9c-88ef30df968b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:33:18 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6fa63a9c-6ff0-47b8-a9e4-f877bb4f49c3 tempest-GroupSnapshotsTest-783586098 None] Flow 'volume_create_manager' (dea54259-5fcb-4533-a933-73ecd0c1dab4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:33:18 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-6fa63a9c-6ff0-47b8-a9e4-f877bb4f49c3 tempest-GroupSnapshotsTest-783586098 None] Created volume successfully. Aug 28 09:33:18 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-3470ec9c-cd7e-4f6d-a21b-ac6fdfdc298b tempest-GroupSnapshotsTest-783586098 None] GroupSnapshot b1780089-a1a3-4dc1-ac96-c46d1d314b7a: creating. Aug 28 09:33:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-3470ec9c-cd7e-4f6d-a21b-ac6fdfdc298b tempest-GroupSnapshotsTest-783586098 None] Group snapshot b1780089-a1a3-4dc1-ac96-c46d1d314b7a: creating. {{(pid=86081) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 28 09:33:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-3470ec9c-cd7e-4f6d-a21b-ac6fdfdc298b tempest-GroupSnapshotsTest-783586098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:33:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-3470ec9c-cd7e-4f6d-a21b-ac6fdfdc298b tempest-GroupSnapshotsTest-783586098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:33:19 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-3470ec9c-cd7e-4f6d-a21b-ac6fdfdc298b tempest-GroupSnapshotsTest-783586098 None] Creating offline snapshot 88213c0d-ca19-4323-b544-5c896d62f350 of volume 889032eb-75dd-4c8d-ae55-352855603717 {{(pid=86081) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:33:19 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[195a5c94-6288-4caa-9402-940b400b87ad]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:33:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3470ec9c-cd7e-4f6d-a21b-ac6fdfdc298b tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-889032eb-75dd-4c8d-ae55-352855603717 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:33:19 devstack sudo[89555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-889032eb-75dd-4c8d-ae55-352855603717 Aug 28 09:33:19 devstack sudo[89555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:33:19 devstack sudo[89555]: pam_unix(sudo:session): session closed for user root Aug 28 09:33:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3470ec9c-cd7e-4f6d-a21b-ac6fdfdc298b tempest-GroupSnapshotsTest-783586098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-889032eb-75dd-4c8d-ae55-352855603717" returned: 0 in 0.615s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:33:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3470ec9c-cd7e-4f6d-a21b-ac6fdfdc298b tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-889032eb-75dd-4c8d-ae55-352855603717,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-889032eb-75dd-4c8d-ae55-352855603717.88213c0d-ca19-4323-b544-5c896d62f350 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:33:19 devstack sudo[89569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-889032eb-75dd-4c8d-ae55-352855603717,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-889032eb-75dd-4c8d-ae55-352855603717.88213c0d-ca19-4323-b544-5c896d62f350 1G Aug 28 09:33:19 devstack sudo[89569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:33:20 devstack sudo[89569]: pam_unix(sudo:session): session closed for user root Aug 28 09:33:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3470ec9c-cd7e-4f6d-a21b-ac6fdfdc298b tempest-GroupSnapshotsTest-783586098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-889032eb-75dd-4c8d-ae55-352855603717,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-889032eb-75dd-4c8d-ae55-352855603717.88213c0d-ca19-4323-b544-5c896d62f350 1G" returned: 0 in 0.567s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:33:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3470ec9c-cd7e-4f6d-a21b-ac6fdfdc298b tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-889032eb-75dd-4c8d-ae55-352855603717 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-889032eb-75dd-4c8d-ae55-352855603717.88213c0d-ca19-4323-b544-5c896d62f350 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:33:20 devstack sudo[89575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-889032eb-75dd-4c8d-ae55-352855603717 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-889032eb-75dd-4c8d-ae55-352855603717.88213c0d-ca19-4323-b544-5c896d62f350 Aug 28 09:33:20 devstack sudo[89575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:33:20 devstack sudo[89575]: pam_unix(sudo:session): session closed for user root Aug 28 09:33:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3470ec9c-cd7e-4f6d-a21b-ac6fdfdc298b tempest-GroupSnapshotsTest-783586098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-889032eb-75dd-4c8d-ae55-352855603717 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-889032eb-75dd-4c8d-ae55-352855603717.88213c0d-ca19-4323-b544-5c896d62f350" returned: 0 in 0.342s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:33:20 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-3470ec9c-cd7e-4f6d-a21b-ac6fdfdc298b tempest-GroupSnapshotsTest-783586098 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-889032eb-75dd-4c8d-ae55-352855603717.88213c0d-ca19-4323-b544-5c896d62f350 is being set with open permissions: ugo+rw: NotImplementedError Aug 28 09:33:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3470ec9c-cd7e-4f6d-a21b-ac6fdfdc298b tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-889032eb-75dd-4c8d-ae55-352855603717.88213c0d-ca19-4323-b544-5c896d62f350 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:33:20 devstack sudo[89581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-889032eb-75dd-4c8d-ae55-352855603717.88213c0d-ca19-4323-b544-5c896d62f350 Aug 28 09:33:20 devstack sudo[89581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:33:20 devstack sudo[89581]: pam_unix(sudo:session): session closed for user root Aug 28 09:33:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3470ec9c-cd7e-4f6d-a21b-ac6fdfdc298b tempest-GroupSnapshotsTest-783586098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-889032eb-75dd-4c8d-ae55-352855603717.88213c0d-ca19-4323-b544-5c896d62f350" returned: 0 in 0.263s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:33:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3470ec9c-cd7e-4f6d-a21b-ac6fdfdc298b tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-889032eb-75dd-4c8d-ae55-352855603717.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:33:20 devstack sudo[89584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-889032eb-75dd-4c8d-ae55-352855603717.info Aug 28 09:33:20 devstack sudo[89584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:33:21 devstack sudo[89584]: pam_unix(sudo:session): session closed for user root Aug 28 09:33:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3470ec9c-cd7e-4f6d-a21b-ac6fdfdc298b tempest-GroupSnapshotsTest-783586098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-889032eb-75dd-4c8d-ae55-352855603717.info" returned: 0 in 0.320s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:33:21 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-3470ec9c-cd7e-4f6d-a21b-ac6fdfdc298b tempest-GroupSnapshotsTest-783586098 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-889032eb-75dd-4c8d-ae55-352855603717.info is being set with open permissions: ugo+rw: NotImplementedError Aug 28 09:33:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3470ec9c-cd7e-4f6d-a21b-ac6fdfdc298b tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-889032eb-75dd-4c8d-ae55-352855603717.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:33:21 devstack sudo[89587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-889032eb-75dd-4c8d-ae55-352855603717.info Aug 28 09:33:21 devstack sudo[89587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:33:21 devstack sudo[89587]: pam_unix(sudo:session): session closed for user root Aug 28 09:33:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3470ec9c-cd7e-4f6d-a21b-ac6fdfdc298b tempest-GroupSnapshotsTest-783586098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-889032eb-75dd-4c8d-ae55-352855603717.info" returned: 0 in 0.255s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:33:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-3470ec9c-cd7e-4f6d-a21b-ac6fdfdc298b tempest-GroupSnapshotsTest-783586098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.477s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:33:21 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-3470ec9c-cd7e-4f6d-a21b-ac6fdfdc298b tempest-GroupSnapshotsTest-783586098 None] group_snapshot b1780089-a1a3-4dc1-ac96-c46d1d314b7a: created successfully Aug 28 09:33:22 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-b3d61976-4c97-46b2-95a3-d5ec0f4c5455 tempest-GroupSnapshotsTest-783586098 None] group_snapshot b1780089-a1a3-4dc1-ac96-c46d1d314b7a: deleting Aug 28 09:33:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b3d61976-4c97-46b2-95a3-d5ec0f4c5455 tempest-GroupSnapshotsTest-783586098 None] group_snapshot b1780089-a1a3-4dc1-ac96-c46d1d314b7a: deleting {{(pid=86081) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 28 09:33:22 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-b3d61976-4c97-46b2-95a3-d5ec0f4c5455 tempest-GroupSnapshotsTest-783586098 None] Acquiring lock "cinder-quobyte-889032eb-75dd-4c8d-ae55-352855603717" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:33:22 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-b3d61976-4c97-46b2-95a3-d5ec0f4c5455 tempest-GroupSnapshotsTest-783586098 None] Lock "cinder-quobyte-889032eb-75dd-4c8d-ae55-352855603717" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:33:22 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-b3d61976-4c97-46b2-95a3-d5ec0f4c5455 tempest-GroupSnapshotsTest-783586098 None] Acquiring lock "cinder-quobyte-88213c0d-ca19-4323-b544-5c896d62f350" by "_delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:33:22 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-b3d61976-4c97-46b2-95a3-d5ec0f4c5455 tempest-GroupSnapshotsTest-783586098 None] Lock "cinder-quobyte-88213c0d-ca19-4323-b544-5c896d62f350" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:33:22 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-b3d61976-4c97-46b2-95a3-d5ec0f4c5455 tempest-GroupSnapshotsTest-783586098 None] Deleting offline snapshot 88213c0d-ca19-4323-b544-5c896d62f350 of volume 889032eb-75dd-4c8d-ae55-352855603717 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:33:22 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-b3d61976-4c97-46b2-95a3-d5ec0f4c5455 tempest-GroupSnapshotsTest-783586098 None] snapshot_file for this snap is: volume-889032eb-75dd-4c8d-ae55-352855603717.88213c0d-ca19-4323-b544-5c896d62f350 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:33:22 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[5584702c-7b9a-4591-899a-64f7e342cce5]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:33:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b3d61976-4c97-46b2-95a3-d5ec0f4c5455 tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-889032eb-75dd-4c8d-ae55-352855603717.88213c0d-ca19-4323-b544-5c896d62f350 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:33:22 devstack sudo[89590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-889032eb-75dd-4c8d-ae55-352855603717.88213c0d-ca19-4323-b544-5c896d62f350 Aug 28 09:33:22 devstack sudo[89590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:33:23 devstack sudo[89590]: pam_unix(sudo:session): session closed for user root Aug 28 09:33:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b3d61976-4c97-46b2-95a3-d5ec0f4c5455 tempest-GroupSnapshotsTest-783586098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-889032eb-75dd-4c8d-ae55-352855603717.88213c0d-ca19-4323-b544-5c896d62f350" returned: 0 in 0.491s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:33:23 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-b3d61976-4c97-46b2-95a3-d5ec0f4c5455 tempest-GroupSnapshotsTest-783586098 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-889032eb-75dd-4c8d-ae55-352855603717(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:33:23 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[addc1bce-3445-4ff4-adc4-31878441c597]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:33:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b3d61976-4c97-46b2-95a3-d5ec0f4c5455 tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-889032eb-75dd-4c8d-ae55-352855603717 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:33:23 devstack sudo[89596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-889032eb-75dd-4c8d-ae55-352855603717 Aug 28 09:33:23 devstack sudo[89596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:33:23 devstack sudo[89596]: pam_unix(sudo:session): session closed for user root Aug 28 09:33:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b3d61976-4c97-46b2-95a3-d5ec0f4c5455 tempest-GroupSnapshotsTest-783586098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-889032eb-75dd-4c8d-ae55-352855603717" returned: 0 in 0.487s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:33:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b3d61976-4c97-46b2-95a3-d5ec0f4c5455 tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-889032eb-75dd-4c8d-ae55-352855603717.88213c0d-ca19-4323-b544-5c896d62f350 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:33:23 devstack sudo[89601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-889032eb-75dd-4c8d-ae55-352855603717.88213c0d-ca19-4323-b544-5c896d62f350 Aug 28 09:33:23 devstack sudo[89601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:33:24 devstack sudo[89601]: pam_unix(sudo:session): session closed for user root Aug 28 09:33:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b3d61976-4c97-46b2-95a3-d5ec0f4c5455 tempest-GroupSnapshotsTest-783586098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-889032eb-75dd-4c8d-ae55-352855603717.88213c0d-ca19-4323-b544-5c896d62f350" returned: 0 in 0.478s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:33:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b3d61976-4c97-46b2-95a3-d5ec0f4c5455 tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-889032eb-75dd-4c8d-ae55-352855603717.88213c0d-ca19-4323-b544-5c896d62f350 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:33:24 devstack sudo[89606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-889032eb-75dd-4c8d-ae55-352855603717.88213c0d-ca19-4323-b544-5c896d62f350 Aug 28 09:33:24 devstack sudo[89606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:33:24 devstack sudo[89606]: pam_unix(sudo:session): session closed for user root Aug 28 09:33:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b3d61976-4c97-46b2-95a3-d5ec0f4c5455 tempest-GroupSnapshotsTest-783586098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-889032eb-75dd-4c8d-ae55-352855603717.88213c0d-ca19-4323-b544-5c896d62f350" returned: 0 in 0.446s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:33:24 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-b3d61976-4c97-46b2-95a3-d5ec0f4c5455 tempest-GroupSnapshotsTest-783586098 None] Lock "cinder-quobyte-88213c0d-ca19-4323-b544-5c896d62f350" released by "_delete_snapshot" :: held 2.081s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:33:24 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-b3d61976-4c97-46b2-95a3-d5ec0f4c5455 tempest-GroupSnapshotsTest-783586098 None] Lock "cinder-quobyte-889032eb-75dd-4c8d-ae55-352855603717" released by "delete_snapshot" :: held 2.123s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:33:24 devstack cinder-volume[86081]: WARNING cinder.quota [None req-b3d61976-4c97-46b2-95a3-d5ec0f4c5455 tempest-GroupSnapshotsTest-783586098 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1670982000 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1670982000, it is now deprecated. Please use the default quota class for default quota. Aug 28 09:33:24 devstack cinder-volume[86081]: WARNING cinder.quota [None req-b3d61976-4c97-46b2-95a3-d5ec0f4c5455 tempest-GroupSnapshotsTest-783586098 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1670982000 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1670982000, it is now deprecated. Please use the default quota class for default quota. Aug 28 09:33:24 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-b3d61976-4c97-46b2-95a3-d5ec0f4c5455 tempest-GroupSnapshotsTest-783586098 None] Created reservations ['f37b9d00-e45c-46d0-8e96-7c3eaf5f772b', 'efddf30d-8ae7-467d-9d36-c0a829a65465', '2fd61160-c7d6-43ec-967f-326c47bc92d8', 'd3ede1bf-8893-4f1f-8344-321c96108046'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:33:25 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-b3d61976-4c97-46b2-95a3-d5ec0f4c5455 tempest-GroupSnapshotsTest-783586098 None] group_snapshot b1780089-a1a3-4dc1-ac96-c46d1d314b7a: deleted successfully Aug 28 09:33:26 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-098c356b-9681-499c-9a45-6fd1f4271da8 tempest-GroupSnapshotsTest-783586098 None] Acquiring lock "cinder-quobyte-889032eb-75dd-4c8d-ae55-352855603717" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:33:26 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-098c356b-9681-499c-9a45-6fd1f4271da8 tempest-GroupSnapshotsTest-783586098 None] Lock "cinder-quobyte-889032eb-75dd-4c8d-ae55-352855603717" acquired by "delete_volume" :: waited 0.034s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:33:26 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ab0db2-f260-47d9-bc17-22a285b46064]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:33:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-098c356b-9681-499c-9a45-6fd1f4271da8 tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-889032eb-75dd-4c8d-ae55-352855603717 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:33:26 devstack sudo[89611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-889032eb-75dd-4c8d-ae55-352855603717 Aug 28 09:33:26 devstack sudo[89611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:33:27 devstack sudo[89611]: pam_unix(sudo:session): session closed for user root Aug 28 09:33:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-098c356b-9681-499c-9a45-6fd1f4271da8 tempest-GroupSnapshotsTest-783586098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-889032eb-75dd-4c8d-ae55-352855603717" returned: 0 in 0.712s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:33:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-098c356b-9681-499c-9a45-6fd1f4271da8 tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-889032eb-75dd-4c8d-ae55-352855603717 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:33:27 devstack cinder-volume[86081]: INFO cinder.volume.manager [req-c4fd352a-6b30-40b5-a26b-5d8a424389a0 req-294545ef-2061-49fe-9462-7018d7bf1e3e tempest-ServerActionsTestOtherA-1923649618 None] Terminate volume connection completed successfully. Aug 28 09:33:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-c4fd352a-6b30-40b5-a26b-5d8a424389a0 req-294545ef-2061-49fe-9462-7018d7bf1e3e tempest-ServerActionsTestOtherA-1923649618 None] Deleting attachment bef6b4dd-97cb-4449-8267-acbba4d588ad. {{(pid=86081) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 09:33:27 devstack sudo[89623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-889032eb-75dd-4c8d-ae55-352855603717 Aug 28 09:33:27 devstack sudo[89623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:33:27 devstack sudo[89623]: pam_unix(sudo:session): session closed for user root Aug 28 09:33:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-098c356b-9681-499c-9a45-6fd1f4271da8 tempest-GroupSnapshotsTest-783586098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-889032eb-75dd-4c8d-ae55-352855603717" returned: 0 in 0.450s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:33:27 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-098c356b-9681-499c-9a45-6fd1f4271da8 tempest-GroupSnapshotsTest-783586098 None] Lock "cinder-quobyte-889032eb-75dd-4c8d-ae55-352855603717" released by "delete_volume" :: held 1.292s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:33:27 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-098c356b-9681-499c-9a45-6fd1f4271da8 tempest-GroupSnapshotsTest-783586098 None] Created reservations ['7ace748d-48bd-4d9d-b171-0676e870a713'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:33:27 devstack cinder-volume[86081]: WARNING cinder.quota [None req-098c356b-9681-499c-9a45-6fd1f4271da8 tempest-GroupSnapshotsTest-783586098 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1670982000 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1670982000, it is now deprecated. Please use the default quota class for default quota. Aug 28 09:33:27 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-098c356b-9681-499c-9a45-6fd1f4271da8 tempest-GroupSnapshotsTest-783586098 None] Created reservations ['477790ad-2433-4f78-a694-6eca785132e5', '4ced898e-0c57-4ffa-9800-1698a33b38bc', 'b467d5c9-e771-4336-8bb9-57fd39118553', 'b5537ed5-8a7a-4031-b330-2ef7411f0b43'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:33:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-098c356b-9681-499c-9a45-6fd1f4271da8 tempest-GroupSnapshotsTest-783586098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:33:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-098c356b-9681-499c-9a45-6fd1f4271da8 tempest-GroupSnapshotsTest-783586098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:33:28 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-098c356b-9681-499c-9a45-6fd1f4271da8 tempest-GroupSnapshotsTest-783586098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:33:28 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-098c356b-9681-499c-9a45-6fd1f4271da8 tempest-GroupSnapshotsTest-783586098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:33:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-098c356b-9681-499c-9a45-6fd1f4271da8 tempest-GroupSnapshotsTest-783586098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:33:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-098c356b-9681-499c-9a45-6fd1f4271da8 tempest-GroupSnapshotsTest-783586098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:33:28 devstack sudo[89628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:33:28 devstack sudo[89628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:33:28 devstack sudo[89628]: pam_unix(sudo:session): session closed for user root Aug 28 09:33:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-098c356b-9681-499c-9a45-6fd1f4271da8 tempest-GroupSnapshotsTest-783586098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.429s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:33:28 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-098c356b-9681-499c-9a45-6fd1f4271da8 tempest-GroupSnapshotsTest-783586098 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:33:28 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-098c356b-9681-499c-9a45-6fd1f4271da8 tempest-GroupSnapshotsTest-783586098 None] Delete group completed successfully. Aug 28 09:33:38 devstack cinder-volume[86081]: DEBUG oslo_service.periodic_task [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86081) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:33:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:33:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:33:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:33:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:33:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:33:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:33:38 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writing DB stats cinder:SELECT=125,cinder:INSERT=33,cinder:UPDATE=107,cinder:DELETE=3 {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:33:38 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writing DB stats cinder:UPDATE=108,cinder:SELECT=112,cinder:INSERT=17,cinder:DELETE=3 {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:33:38 devstack sudo[89759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:33:38 devstack sudo[89759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:33:38 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:33:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] Flow 'volume_create_manager' (d640ec0b-a15d-4cbe-b6b2-173f69fcb503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:33:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbe7ad68-630a-4c29-a2ed-06062026a955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:33:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbe7ad68-630a-4c29-a2ed-06062026a955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:33:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-14840172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e827f2c-b669-440f-9625-91c66beaa717,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d299059d4774e559e1832d6190fc4c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:33:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:33:39Z,use_quota=True,user_id='3828bb185e6e49749767207c36eabe9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:33:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b959369-c1e8-4fa7-a13c-22f4a750f065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:33:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b959369-c1e8-4fa7-a13c-22f4a750f065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:33:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (477843e4-b579-429a-8606-2aa2719bb8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:33:38 devstack cinder-volume[86081]: DEBUG cinder.image.glance [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] Creating Keystone auth plugin from conf {{(pid=86081) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 28 09:33:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.779s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:33:38 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:33:38 devstack sudo[89759]: pam_unix(sudo:session): session closed for user root Aug 28 09:33:41 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (477843e4-b579-429a-8606-2aa2719bb8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2e827f2c-b669-440f-9625-91c66beaa717', 'volume_name': 'volume-2e827f2c-b669-440f-9625-91c66beaa717', 'volume_size': 1, 'image_id': '4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b980c3c37cfa4760ad4846d0fd4baffc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'created_at': datetime.datetime(2026, 8, 28, 7, 25, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 7, 25, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:33:41 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9546192-9eb2-46a4-884c-aa7e933858b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:33:41 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9546192-9eb2-46a4-884c-aa7e933858b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:33:41 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fad8e1e-37de-4c72-a228-d2e1a75fd17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:33:41 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] Volume 2e827f2c-b669-440f-9625-91c66beaa717: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2e827f2c-b669-440f-9625-91c66beaa717', 'volume_size': 1, 'image_id': '4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b980c3c37cfa4760ad4846d0fd4baffc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'created_at': datetime.datetime(2026, 8, 28, 7, 25, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 7, 25, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 28 09:33:41 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] Trying to clone 2e827f2c-b669-440f-9625-91c66beaa717 from image 4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'metadata': {}}]). {{(pid=86081) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 28 09:33:42 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_35jsz2wtdevstack@QuobyteHD, size 20.69 MB, duration 1.09 sec {{(pid=86081) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 28 09:33:42 devstack cinder-volume[86081]: INFO cinder.image.image_utils [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] Image download 20.69 MB at 18.93 MB/s Aug 28 09:33:42 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a05399-cc81-4647-b4bd-f2265a7144cf]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:33:42 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_35jsz2wtdevstack@QuobyteHD {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:33:42 devstack sudo[89812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_35jsz2wtdevstack@QuobyteHD Aug 28 09:33:42 devstack sudo[89812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:33:43 devstack sudo[89812]: pam_unix(sudo:session): session closed for user root Aug 28 09:33:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_35jsz2wtdevstack@QuobyteHD" returned: 0 in 0.535s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:33:43 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] Temporary image 4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0 is fetched for user 3828bb185e6e49749767207c36eabe9c. {{(pid=86081) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 28 09:33:43 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0dcee32-4f3e-4d6d-8105-8e87fe85a810]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:33:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_35jsz2wtdevstack@QuobyteHD {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:33:43 devstack sudo[89829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_35jsz2wtdevstack@QuobyteHD Aug 28 09:33:43 devstack sudo[89829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:33:43 devstack sudo[89829]: pam_unix(sudo:session): session closed for user root Aug 28 09:33:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_35jsz2wtdevstack@QuobyteHD" returned: 0 in 0.546s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:33:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:33:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:33:43 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:33:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-14840172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e827f2c-b669-440f-9625-91c66beaa717,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d299059d4774e559e1832d6190fc4c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:33:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:33:39Z,use_quota=True,user_id='3828bb185e6e49749767207c36eabe9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:33:43 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] Creating volume 2e827f2c-b669-440f-9625-91c66beaa717 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:33:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:33:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:33:43 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:33:43 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:33:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:33:43 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:33:43 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:33:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e827f2c-b669-440f-9625-91c66beaa717 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:33:43 devstack sudo[89842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e827f2c-b669-440f-9625-91c66beaa717 1073741824 Aug 28 09:33:43 devstack sudo[89842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:33:44 devstack sudo[89842]: pam_unix(sudo:session): session closed for user root Aug 28 09:33:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e827f2c-b669-440f-9625-91c66beaa717 1073741824" returned: 0 in 0.661s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:33:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e827f2c-b669-440f-9625-91c66beaa717 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:33:44 devstack sudo[89851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e827f2c-b669-440f-9625-91c66beaa717 Aug 28 09:33:44 devstack sudo[89851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:33:44 devstack sudo[89851]: pam_unix(sudo:session): session closed for user root Aug 28 09:33:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e827f2c-b669-440f-9625-91c66beaa717" returned: 0 in 0.345s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:33:44 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:33:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:33:44 devstack cinder-volume[86081]: DEBUG cinder.volume.volume_utils [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] Attempting download of 4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0 ((None, [{'url': 'file:///opt/stack/data/glance/images/4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'metadata': {}}])) to volume 2e827f2c-b669-440f-9625-91c66beaa717. {{(pid=86081) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 28 09:33:45 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb799522-00c7-41a9-a38b-6761d07267e3]: (4, 'raw') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:33:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_30mbxgse {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:33:45 devstack sudo[89863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_30mbxgse Aug 28 09:33:45 devstack sudo[89863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:33:45 devstack sudo[89863]: pam_unix(sudo:session): session closed for user root Aug 28 09:33:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_30mbxgse" returned: 0 in 0.487s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:33:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_30mbxgse {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:33:45 devstack sudo[89872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_30mbxgse Aug 28 09:33:45 devstack sudo[89872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:33:45 devstack sudo[89872]: pam_unix(sudo:session): session closed for user root Aug 28 09:33:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_30mbxgse" returned: 1 in 0.429s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:33:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_30mbxgse' failed. Not Retrying. {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 09:33:45 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d108ef5-d414-4de9-b844-3dca3ebfdd93]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:33:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_35jsz2wtdevstack@QuobyteHD {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:33:46 devstack sudo[89876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_35jsz2wtdevstack@QuobyteHD Aug 28 09:33:46 devstack sudo[89876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:33:46 devstack sudo[89876]: pam_unix(sudo:session): session closed for user root Aug 28 09:33:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_35jsz2wtdevstack@QuobyteHD" returned: 0 in 0.543s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:33:46 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] 4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0 was qcow2, converting to qcow2 {{(pid=86081) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 28 09:33:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_35jsz2wtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e827f2c-b669-440f-9625-91c66beaa717 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:33:46 devstack sudo[89884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_35jsz2wtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e827f2c-b669-440f-9625-91c66beaa717 Aug 28 09:33:46 devstack sudo[89884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:33:49 devstack sudo[89884]: pam_unix(sudo:session): session closed for user root Aug 28 09:33:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_35jsz2wtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e827f2c-b669-440f-9625-91c66beaa717" returned: 0 in 2.729s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:33:49 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_35jsz2wtdevstack@QuobyteHD, size 112.00 MB, duration 2.73 sec, destination /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e827f2c-b669-440f-9625-91c66beaa717 {{(pid=86081) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 09:33:49 devstack cinder-volume[86081]: INFO cinder.image.image_utils [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] Converted 112.00 MB image at 41.02 MB/s Aug 28 09:33:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e827f2c-b669-440f-9625-91c66beaa717 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:33:49 devstack sudo[89913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e827f2c-b669-440f-9625-91c66beaa717 1G Aug 28 09:33:49 devstack sudo[89913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:33:49 devstack sudo[89913]: pam_unix(sudo:session): session closed for user root Aug 28 09:33:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e827f2c-b669-440f-9625-91c66beaa717 1G" returned: 0 in 0.546s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:33:49 devstack cinder-volume[86081]: DEBUG cinder.volume.volume_utils [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] Downloaded image 4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0 ((None, [{'url': 'file:///opt/stack/data/glance/images/4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'metadata': {}}])) to volume 2e827f2c-b669-440f-9625-91c66beaa717 successfully. {{(pid=86081) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 28 09:33:49 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] Temporary image 4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0 for user 3828bb185e6e49749767207c36eabe9c is deleted. {{(pid=86081) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 28 09:33:49 devstack cinder-volume[86081]: DEBUG cinder.volume.volume_utils [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] Marking volume 2e827f2c-b669-440f-9625-91c66beaa717 as bootable. {{(pid=86081) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 28 09:33:49 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] Copying metadata from image 4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0 to 2e827f2c-b669-440f-9625-91c66beaa717. {{(pid=86081) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 28 09:33:49 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] Creating volume glance metadata for volume 2e827f2c-b669-440f-9625-91c66beaa717 backed by image 4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86081) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 28 09:33:50 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fad8e1e-37de-4c72-a228-d2e1a75fd17f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e827f2c-b669-440f-9625-91c66beaa717', 'volume_size': 1, 'image_id': '4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b980c3c37cfa4760ad4846d0fd4baffc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'created_at': datetime.datetime(2026, 8, 28, 7, 25, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 7, 25, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:33:50 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24f71bee-2c44-4368-b4d1-b88e64d45410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:33:50 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] Volume volume-2e827f2c-b669-440f-9625-91c66beaa717 (2e827f2c-b669-440f-9625-91c66beaa717): created successfully Aug 28 09:33:50 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24f71bee-2c44-4368-b4d1-b88e64d45410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:33:50 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] Flow 'volume_create_manager' (d640ec0b-a15d-4cbe-b6b2-173f69fcb503) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:33:50 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-e3669dc8-6d79-4cbc-b0d9-4bf14ed3121d tempest-ServerActionsTestOtherA-1923649618 None] Created volume successfully. Aug 28 09:33:54 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-630b37cf-e5e8-4a67-9439-b97947d4b3e4 tempest-GroupsV320Test-2098041626 None] Group tempest-GroupsV320Test-Group-2046217861: creating Aug 28 09:33:54 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-630b37cf-e5e8-4a67-9439-b97947d4b3e4 tempest-GroupsV320Test-2098041626 None] Group tempest-GroupsV320Test-Group-2046217861: created successfully Aug 28 09:33:54 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-630b37cf-e5e8-4a67-9439-b97947d4b3e4 tempest-GroupsV320Test-2098041626 None] Create group completed successfully. Aug 28 09:33:57 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-ff9a64d3-05a2-40c5-9b32-dfa62d893398 tempest-GroupsV320Test-2098041626 None] Created reservations ['7e04d13c-2509-4ac0-8b6b-05ac48084c3e'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:33:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ff9a64d3-05a2-40c5-9b32-dfa62d893398 tempest-GroupsV320Test-2098041626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:33:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ff9a64d3-05a2-40c5-9b32-dfa62d893398 tempest-GroupsV320Test-2098041626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:33:57 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ff9a64d3-05a2-40c5-9b32-dfa62d893398 tempest-GroupsV320Test-2098041626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:33:57 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ff9a64d3-05a2-40c5-9b32-dfa62d893398 tempest-GroupsV320Test-2098041626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:33:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ff9a64d3-05a2-40c5-9b32-dfa62d893398 tempest-GroupsV320Test-2098041626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:33:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ff9a64d3-05a2-40c5-9b32-dfa62d893398 tempest-GroupsV320Test-2098041626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:33:57 devstack sudo[90081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:33:57 devstack sudo[90081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:33:58 devstack sudo[90081]: pam_unix(sudo:session): session closed for user root Aug 28 09:33:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ff9a64d3-05a2-40c5-9b32-dfa62d893398 tempest-GroupsV320Test-2098041626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.652s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:33:58 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-ff9a64d3-05a2-40c5-9b32-dfa62d893398 tempest-GroupsV320Test-2098041626 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:33:58 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-ff9a64d3-05a2-40c5-9b32-dfa62d893398 tempest-GroupsV320Test-2098041626 None] Delete group completed successfully. Aug 28 09:33:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-5050b1aa-ddeb-42ce-a638-de151287173b req-0cb20f98-9737-4234-a1f0-6ef0302e5438 tempest-ServerActionsTestOtherA-1923649618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:33:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-5050b1aa-ddeb-42ce-a638-de151287173b req-0cb20f98-9737-4234-a1f0-6ef0302e5438 tempest-ServerActionsTestOtherA-1923649618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:33:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-5050b1aa-ddeb-42ce-a638-de151287173b req-0cb20f98-9737-4234-a1f0-6ef0302e5438 tempest-ServerActionsTestOtherA-1923649618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:33:59 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-5050b1aa-ddeb-42ce-a638-de151287173b req-0cb20f98-9737-4234-a1f0-6ef0302e5438 tempest-ServerActionsTestOtherA-1923649618 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b', 'name': 'volume-2e827f2c-b669-440f-9625-91c66beaa717', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f05378f7-3733-41eb-a236-3b5227fc3d2e', 'enforce_multipath': True} {{(pid=86081) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 09:34:00 devstack cinder-volume[86081]: INFO cinder.volume.manager [req-5050b1aa-ddeb-42ce-a638-de151287173b req-0cb20f98-9737-4234-a1f0-6ef0302e5438 tempest-ServerActionsTestOtherA-1923649618 None] attachment_update completed successfully. Aug 28 09:34:10 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writing DB stats cinder:UPDATE=10,cinder:SELECT=17,cinder:INSERT=11,cinder:DELETE=1 {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:34:10 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writing DB stats cinder:SELECT=28,cinder:UPDATE=9,cinder:INSERT=4 {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:34:11 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-05fb4c4d-c4e1-490a-921d-bbea42f38c66 tempest-ServersNegativeTestJSON-1490479110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:34:11 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-05fb4c4d-c4e1-490a-921d-bbea42f38c66 tempest-ServersNegativeTestJSON-1490479110 None] Flow 'volume_create_manager' (eae0e4ac-604e-4e6b-b27c-d8a0bf32a239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:34:11 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-05fb4c4d-c4e1-490a-921d-bbea42f38c66 tempest-ServersNegativeTestJSON-1490479110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb8125f8-4700-404f-90ce-b64fbcbc53f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:34:11 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-05fb4c4d-c4e1-490a-921d-bbea42f38c66 tempest-ServersNegativeTestJSON-1490479110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb8125f8-4700-404f-90ce-b64fbcbc53f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1397234776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6df37e7-77e1-42ac-9b70-c365649096eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2820e2fabce54a31a2f5e3cdc0a8674c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:34:11Z,use_quota=True,user_id='2da10892b628415f80916eb766960fc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:34:11 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-05fb4c4d-c4e1-490a-921d-bbea42f38c66 tempest-ServersNegativeTestJSON-1490479110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec7026ed-e013-48eb-adb3-ca5767cfb963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:34:11 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-05fb4c4d-c4e1-490a-921d-bbea42f38c66 tempest-ServersNegativeTestJSON-1490479110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec7026ed-e013-48eb-adb3-ca5767cfb963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:34:11 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-05fb4c4d-c4e1-490a-921d-bbea42f38c66 tempest-ServersNegativeTestJSON-1490479110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d20ce71b-3dab-409d-a6e7-e89a377d88d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:34:11 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-05fb4c4d-c4e1-490a-921d-bbea42f38c66 tempest-ServersNegativeTestJSON-1490479110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d20ce71b-3dab-409d-a6e7-e89a377d88d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6df37e7-77e1-42ac-9b70-c365649096eb', 'volume_name': 'volume-f6df37e7-77e1-42ac-9b70-c365649096eb', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:34:11 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-05fb4c4d-c4e1-490a-921d-bbea42f38c66 tempest-ServersNegativeTestJSON-1490479110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a774019c-6be7-4ebb-b8ea-81ccca3ca356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:34:11 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-05fb4c4d-c4e1-490a-921d-bbea42f38c66 tempest-ServersNegativeTestJSON-1490479110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a774019c-6be7-4ebb-b8ea-81ccca3ca356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:34:11 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-05fb4c4d-c4e1-490a-921d-bbea42f38c66 tempest-ServersNegativeTestJSON-1490479110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40240978-fe92-473f-96b7-2ad86ccd1551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:34:11 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-05fb4c4d-c4e1-490a-921d-bbea42f38c66 tempest-ServersNegativeTestJSON-1490479110 None] Volume f6df37e7-77e1-42ac-9b70-c365649096eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6df37e7-77e1-42ac-9b70-c365649096eb', 'volume_size': 1} Aug 28 09:34:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-05fb4c4d-c4e1-490a-921d-bbea42f38c66 tempest-ServersNegativeTestJSON-1490479110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:34:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-05fb4c4d-c4e1-490a-921d-bbea42f38c66 tempest-ServersNegativeTestJSON-1490479110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:34:11 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-05fb4c4d-c4e1-490a-921d-bbea42f38c66 tempest-ServersNegativeTestJSON-1490479110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1397234776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6df37e7-77e1-42ac-9b70-c365649096eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2820e2fabce54a31a2f5e3cdc0a8674c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:34:11Z,use_quota=True,user_id='2da10892b628415f80916eb766960fc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:34:11 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-05fb4c4d-c4e1-490a-921d-bbea42f38c66 tempest-ServersNegativeTestJSON-1490479110 None] Creating volume f6df37e7-77e1-42ac-9b70-c365649096eb {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:34:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-05fb4c4d-c4e1-490a-921d-bbea42f38c66 tempest-ServersNegativeTestJSON-1490479110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:34:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-05fb4c4d-c4e1-490a-921d-bbea42f38c66 tempest-ServersNegativeTestJSON-1490479110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:34:11 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-05fb4c4d-c4e1-490a-921d-bbea42f38c66 tempest-ServersNegativeTestJSON-1490479110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:34:11 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-05fb4c4d-c4e1-490a-921d-bbea42f38c66 tempest-ServersNegativeTestJSON-1490479110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:34:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-05fb4c4d-c4e1-490a-921d-bbea42f38c66 tempest-ServersNegativeTestJSON-1490479110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:34:11 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-05fb4c4d-c4e1-490a-921d-bbea42f38c66 tempest-ServersNegativeTestJSON-1490479110 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:34:11 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-05fb4c4d-c4e1-490a-921d-bbea42f38c66 tempest-ServersNegativeTestJSON-1490479110 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:34:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-05fb4c4d-c4e1-490a-921d-bbea42f38c66 tempest-ServersNegativeTestJSON-1490479110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f6df37e7-77e1-42ac-9b70-c365649096eb 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:34:11 devstack sudo[90648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f6df37e7-77e1-42ac-9b70-c365649096eb 1073741824 Aug 28 09:34:11 devstack sudo[90648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:34:12 devstack sudo[90648]: pam_unix(sudo:session): session closed for user root Aug 28 09:34:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-05fb4c4d-c4e1-490a-921d-bbea42f38c66 tempest-ServersNegativeTestJSON-1490479110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f6df37e7-77e1-42ac-9b70-c365649096eb 1073741824" returned: 0 in 1.016s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:34:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-05fb4c4d-c4e1-490a-921d-bbea42f38c66 tempest-ServersNegativeTestJSON-1490479110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f6df37e7-77e1-42ac-9b70-c365649096eb {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:34:12 devstack sudo[90655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f6df37e7-77e1-42ac-9b70-c365649096eb Aug 28 09:34:12 devstack sudo[90655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:34:13 devstack sudo[90655]: pam_unix(sudo:session): session closed for user root Aug 28 09:34:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-05fb4c4d-c4e1-490a-921d-bbea42f38c66 tempest-ServersNegativeTestJSON-1490479110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f6df37e7-77e1-42ac-9b70-c365649096eb" returned: 0 in 0.560s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:34:13 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-05fb4c4d-c4e1-490a-921d-bbea42f38c66 tempest-ServersNegativeTestJSON-1490479110 None] <== create_volume: return (1733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:34:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-05fb4c4d-c4e1-490a-921d-bbea42f38c66 tempest-ServersNegativeTestJSON-1490479110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.742s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:34:13 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-05fb4c4d-c4e1-490a-921d-bbea42f38c66 tempest-ServersNegativeTestJSON-1490479110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40240978-fe92-473f-96b7-2ad86ccd1551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6df37e7-77e1-42ac-9b70-c365649096eb', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:34:13 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-05fb4c4d-c4e1-490a-921d-bbea42f38c66 tempest-ServersNegativeTestJSON-1490479110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cd78217-3ee4-4e10-923b-ae4ba5ba0ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:34:13 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-05fb4c4d-c4e1-490a-921d-bbea42f38c66 tempest-ServersNegativeTestJSON-1490479110 None] Volume volume-f6df37e7-77e1-42ac-9b70-c365649096eb (f6df37e7-77e1-42ac-9b70-c365649096eb): created successfully Aug 28 09:34:13 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-05fb4c4d-c4e1-490a-921d-bbea42f38c66 tempest-ServersNegativeTestJSON-1490479110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cd78217-3ee4-4e10-923b-ae4ba5ba0ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:34:13 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-05fb4c4d-c4e1-490a-921d-bbea42f38c66 tempest-ServersNegativeTestJSON-1490479110 None] Flow 'volume_create_manager' (eae0e4ac-604e-4e6b-b27c-d8a0bf32a239) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:34:13 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-05fb4c4d-c4e1-490a-921d-bbea42f38c66 tempest-ServersNegativeTestJSON-1490479110 None] Created volume successfully. Aug 28 09:34:14 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac9be67c-8c37-412b-93e1-d37c04f4ca1d tempest-ServerRescueNegativeTestJSON-1663044983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:34:14 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ac9be67c-8c37-412b-93e1-d37c04f4ca1d tempest-ServerRescueNegativeTestJSON-1663044983 None] Flow 'volume_create_manager' (d42ee68d-ba4d-4ad6-b1a6-30fb87138a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:34:14 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ac9be67c-8c37-412b-93e1-d37c04f4ca1d tempest-ServerRescueNegativeTestJSON-1663044983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (870d22bd-514d-4e00-91be-f16781df676c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:34:14 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ac9be67c-8c37-412b-93e1-d37c04f4ca1d tempest-ServerRescueNegativeTestJSON-1663044983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (870d22bd-514d-4e00-91be-f16781df676c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1314614731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=685ab113-4811-4589-9234-659335ad08bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96a2843d7b2d4d2aa7aa1b35ca6cdf58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:34:14Z,use_quota=True,user_id='b2af8431d8a547ab9a704cc05d786e38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:34:14 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ac9be67c-8c37-412b-93e1-d37c04f4ca1d tempest-ServerRescueNegativeTestJSON-1663044983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08661cc3-10e9-42a5-abb8-5cc6547c5013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:34:14 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ac9be67c-8c37-412b-93e1-d37c04f4ca1d tempest-ServerRescueNegativeTestJSON-1663044983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08661cc3-10e9-42a5-abb8-5cc6547c5013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:34:14 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ac9be67c-8c37-412b-93e1-d37c04f4ca1d tempest-ServerRescueNegativeTestJSON-1663044983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3eedde0-83d5-49d3-9066-6dcb87a91fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:34:14 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ac9be67c-8c37-412b-93e1-d37c04f4ca1d tempest-ServerRescueNegativeTestJSON-1663044983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3eedde0-83d5-49d3-9066-6dcb87a91fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '685ab113-4811-4589-9234-659335ad08bf', 'volume_name': 'volume-685ab113-4811-4589-9234-659335ad08bf', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:34:14 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ac9be67c-8c37-412b-93e1-d37c04f4ca1d tempest-ServerRescueNegativeTestJSON-1663044983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb6a67a2-2452-466c-af73-196bc04705ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:34:14 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ac9be67c-8c37-412b-93e1-d37c04f4ca1d tempest-ServerRescueNegativeTestJSON-1663044983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb6a67a2-2452-466c-af73-196bc04705ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:34:14 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ac9be67c-8c37-412b-93e1-d37c04f4ca1d tempest-ServerRescueNegativeTestJSON-1663044983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52783f15-e8cc-49f1-90e7-3f3b89863c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:34:14 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-ac9be67c-8c37-412b-93e1-d37c04f4ca1d tempest-ServerRescueNegativeTestJSON-1663044983 None] Volume 685ab113-4811-4589-9234-659335ad08bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-685ab113-4811-4589-9234-659335ad08bf', 'volume_size': 1} Aug 28 09:34:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ac9be67c-8c37-412b-93e1-d37c04f4ca1d tempest-ServerRescueNegativeTestJSON-1663044983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:34:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ac9be67c-8c37-412b-93e1-d37c04f4ca1d tempest-ServerRescueNegativeTestJSON-1663044983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:34:14 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ac9be67c-8c37-412b-93e1-d37c04f4ca1d tempest-ServerRescueNegativeTestJSON-1663044983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1314614731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=685ab113-4811-4589-9234-659335ad08bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96a2843d7b2d4d2aa7aa1b35ca6cdf58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:34:14Z,use_quota=True,user_id='b2af8431d8a547ab9a704cc05d786e38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:34:14 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-ac9be67c-8c37-412b-93e1-d37c04f4ca1d tempest-ServerRescueNegativeTestJSON-1663044983 None] Creating volume 685ab113-4811-4589-9234-659335ad08bf {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:34:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ac9be67c-8c37-412b-93e1-d37c04f4ca1d tempest-ServerRescueNegativeTestJSON-1663044983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:34:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ac9be67c-8c37-412b-93e1-d37c04f4ca1d tempest-ServerRescueNegativeTestJSON-1663044983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:34:14 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ac9be67c-8c37-412b-93e1-d37c04f4ca1d tempest-ServerRescueNegativeTestJSON-1663044983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:34:14 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ac9be67c-8c37-412b-93e1-d37c04f4ca1d tempest-ServerRescueNegativeTestJSON-1663044983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:34:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ac9be67c-8c37-412b-93e1-d37c04f4ca1d tempest-ServerRescueNegativeTestJSON-1663044983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:34:14 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ac9be67c-8c37-412b-93e1-d37c04f4ca1d tempest-ServerRescueNegativeTestJSON-1663044983 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:34:14 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-ac9be67c-8c37-412b-93e1-d37c04f4ca1d tempest-ServerRescueNegativeTestJSON-1663044983 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:34:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ac9be67c-8c37-412b-93e1-d37c04f4ca1d tempest-ServerRescueNegativeTestJSON-1663044983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-685ab113-4811-4589-9234-659335ad08bf 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:34:14 devstack sudo[90661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-685ab113-4811-4589-9234-659335ad08bf 1073741824 Aug 28 09:34:14 devstack sudo[90661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:34:15 devstack sudo[90661]: pam_unix(sudo:session): session closed for user root Aug 28 09:34:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ac9be67c-8c37-412b-93e1-d37c04f4ca1d tempest-ServerRescueNegativeTestJSON-1663044983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-685ab113-4811-4589-9234-659335ad08bf 1073741824" returned: 0 in 1.159s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:34:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ac9be67c-8c37-412b-93e1-d37c04f4ca1d tempest-ServerRescueNegativeTestJSON-1663044983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-685ab113-4811-4589-9234-659335ad08bf {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:34:15 devstack sudo[90672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-685ab113-4811-4589-9234-659335ad08bf Aug 28 09:34:15 devstack sudo[90672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:34:16 devstack sudo[90672]: pam_unix(sudo:session): session closed for user root Aug 28 09:34:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ac9be67c-8c37-412b-93e1-d37c04f4ca1d tempest-ServerRescueNegativeTestJSON-1663044983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-685ab113-4811-4589-9234-659335ad08bf" returned: 0 in 0.908s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:34:16 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ac9be67c-8c37-412b-93e1-d37c04f4ca1d tempest-ServerRescueNegativeTestJSON-1663044983 None] <== create_volume: return (2231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:34:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ac9be67c-8c37-412b-93e1-d37c04f4ca1d tempest-ServerRescueNegativeTestJSON-1663044983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.234s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:34:16 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ac9be67c-8c37-412b-93e1-d37c04f4ca1d tempest-ServerRescueNegativeTestJSON-1663044983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52783f15-e8cc-49f1-90e7-3f3b89863c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-685ab113-4811-4589-9234-659335ad08bf', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:34:16 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ac9be67c-8c37-412b-93e1-d37c04f4ca1d tempest-ServerRescueNegativeTestJSON-1663044983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2658f15-25e2-4527-80ca-d677678eebed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:34:16 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-ac9be67c-8c37-412b-93e1-d37c04f4ca1d tempest-ServerRescueNegativeTestJSON-1663044983 None] Volume volume-685ab113-4811-4589-9234-659335ad08bf (685ab113-4811-4589-9234-659335ad08bf): created successfully Aug 28 09:34:16 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ac9be67c-8c37-412b-93e1-d37c04f4ca1d tempest-ServerRescueNegativeTestJSON-1663044983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2658f15-25e2-4527-80ca-d677678eebed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:34:16 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ac9be67c-8c37-412b-93e1-d37c04f4ca1d tempest-ServerRescueNegativeTestJSON-1663044983 None] Flow 'volume_create_manager' (d42ee68d-ba4d-4ad6-b1a6-30fb87138a7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:34:16 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-ac9be67c-8c37-412b-93e1-d37c04f4ca1d tempest-ServerRescueNegativeTestJSON-1663044983 None] Created volume successfully. Aug 28 09:34:17 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-09c3e7bb-9819-4206-bf1d-7a3c87ac492d tempest-ServersNegativeTestJSON-1490479110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:34:17 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-09c3e7bb-9819-4206-bf1d-7a3c87ac492d tempest-ServersNegativeTestJSON-1490479110 None] Flow 'volume_create_manager' (77d27273-d79b-4779-98b6-740966ae141f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:34:17 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-09c3e7bb-9819-4206-bf1d-7a3c87ac492d tempest-ServersNegativeTestJSON-1490479110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8510a73-6879-4e4b-95b5-19993a86cfbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:34:17 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-09c3e7bb-9819-4206-bf1d-7a3c87ac492d tempest-ServersNegativeTestJSON-1490479110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8510a73-6879-4e4b-95b5-19993a86cfbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:34:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-474097476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1daee65-4843-4eee-834f-ef10eb7ba491,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2820e2fabce54a31a2f5e3cdc0a8674c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:34:17Z,use_quota=True,user_id='2da10892b628415f80916eb766960fc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:34:17 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-09c3e7bb-9819-4206-bf1d-7a3c87ac492d tempest-ServersNegativeTestJSON-1490479110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00f270fe-8c16-42c9-a03d-69d44537eb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:34:17 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-09c3e7bb-9819-4206-bf1d-7a3c87ac492d tempest-ServersNegativeTestJSON-1490479110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00f270fe-8c16-42c9-a03d-69d44537eb6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:34:17 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-09c3e7bb-9819-4206-bf1d-7a3c87ac492d tempest-ServersNegativeTestJSON-1490479110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35efc37a-817b-4f7a-a2e4-8692ac34cc15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:34:17 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-09c3e7bb-9819-4206-bf1d-7a3c87ac492d tempest-ServersNegativeTestJSON-1490479110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35efc37a-817b-4f7a-a2e4-8692ac34cc15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1daee65-4843-4eee-834f-ef10eb7ba491', 'volume_name': 'volume-c1daee65-4843-4eee-834f-ef10eb7ba491', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:34:17 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-09c3e7bb-9819-4206-bf1d-7a3c87ac492d tempest-ServersNegativeTestJSON-1490479110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (269bab47-2045-4771-804f-255a41153ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:34:17 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-09c3e7bb-9819-4206-bf1d-7a3c87ac492d tempest-ServersNegativeTestJSON-1490479110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (269bab47-2045-4771-804f-255a41153ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:34:17 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-09c3e7bb-9819-4206-bf1d-7a3c87ac492d tempest-ServersNegativeTestJSON-1490479110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b77054fc-9f36-490d-8b82-3580b3328070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:34:17 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-09c3e7bb-9819-4206-bf1d-7a3c87ac492d tempest-ServersNegativeTestJSON-1490479110 None] Volume c1daee65-4843-4eee-834f-ef10eb7ba491: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1daee65-4843-4eee-834f-ef10eb7ba491', 'volume_size': 1} Aug 28 09:34:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-09c3e7bb-9819-4206-bf1d-7a3c87ac492d tempest-ServersNegativeTestJSON-1490479110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:34:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-09c3e7bb-9819-4206-bf1d-7a3c87ac492d tempest-ServersNegativeTestJSON-1490479110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:34:17 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-09c3e7bb-9819-4206-bf1d-7a3c87ac492d tempest-ServersNegativeTestJSON-1490479110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:34:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-474097476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1daee65-4843-4eee-834f-ef10eb7ba491,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2820e2fabce54a31a2f5e3cdc0a8674c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:34:17Z,use_quota=True,user_id='2da10892b628415f80916eb766960fc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:34:17 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-09c3e7bb-9819-4206-bf1d-7a3c87ac492d tempest-ServersNegativeTestJSON-1490479110 None] Creating volume c1daee65-4843-4eee-834f-ef10eb7ba491 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:34:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-09c3e7bb-9819-4206-bf1d-7a3c87ac492d tempest-ServersNegativeTestJSON-1490479110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:34:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-09c3e7bb-9819-4206-bf1d-7a3c87ac492d tempest-ServersNegativeTestJSON-1490479110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:34:17 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-09c3e7bb-9819-4206-bf1d-7a3c87ac492d tempest-ServersNegativeTestJSON-1490479110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:34:17 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-09c3e7bb-9819-4206-bf1d-7a3c87ac492d tempest-ServersNegativeTestJSON-1490479110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:34:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-09c3e7bb-9819-4206-bf1d-7a3c87ac492d tempest-ServersNegativeTestJSON-1490479110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:34:17 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-09c3e7bb-9819-4206-bf1d-7a3c87ac492d tempest-ServersNegativeTestJSON-1490479110 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:34:17 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-09c3e7bb-9819-4206-bf1d-7a3c87ac492d tempest-ServersNegativeTestJSON-1490479110 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:34:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-09c3e7bb-9819-4206-bf1d-7a3c87ac492d tempest-ServersNegativeTestJSON-1490479110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c1daee65-4843-4eee-834f-ef10eb7ba491 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:34:17 devstack sudo[90677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c1daee65-4843-4eee-834f-ef10eb7ba491 1073741824 Aug 28 09:34:17 devstack sudo[90677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:34:18 devstack sudo[90677]: pam_unix(sudo:session): session closed for user root Aug 28 09:34:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-09c3e7bb-9819-4206-bf1d-7a3c87ac492d tempest-ServersNegativeTestJSON-1490479110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c1daee65-4843-4eee-834f-ef10eb7ba491 1073741824" returned: 0 in 1.378s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:34:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-09c3e7bb-9819-4206-bf1d-7a3c87ac492d tempest-ServersNegativeTestJSON-1490479110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c1daee65-4843-4eee-834f-ef10eb7ba491 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:34:19 devstack sudo[90688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c1daee65-4843-4eee-834f-ef10eb7ba491 Aug 28 09:34:19 devstack sudo[90688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:34:19 devstack sudo[90688]: pam_unix(sudo:session): session closed for user root Aug 28 09:34:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-09c3e7bb-9819-4206-bf1d-7a3c87ac492d tempest-ServersNegativeTestJSON-1490479110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c1daee65-4843-4eee-834f-ef10eb7ba491" returned: 0 in 0.846s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:34:19 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-09c3e7bb-9819-4206-bf1d-7a3c87ac492d tempest-ServersNegativeTestJSON-1490479110 None] <== create_volume: return (2386ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:34:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-09c3e7bb-9819-4206-bf1d-7a3c87ac492d tempest-ServersNegativeTestJSON-1490479110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.398s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:34:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-09c3e7bb-9819-4206-bf1d-7a3c87ac492d tempest-ServersNegativeTestJSON-1490479110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b77054fc-9f36-490d-8b82-3580b3328070) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1daee65-4843-4eee-834f-ef10eb7ba491', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:34:20 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-09c3e7bb-9819-4206-bf1d-7a3c87ac492d tempest-ServersNegativeTestJSON-1490479110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0b629eb-4940-4199-89ce-765cbf2b6208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:34:20 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-09c3e7bb-9819-4206-bf1d-7a3c87ac492d tempest-ServersNegativeTestJSON-1490479110 None] Volume volume-c1daee65-4843-4eee-834f-ef10eb7ba491 (c1daee65-4843-4eee-834f-ef10eb7ba491): created successfully Aug 28 09:34:20 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-09c3e7bb-9819-4206-bf1d-7a3c87ac492d tempest-ServersNegativeTestJSON-1490479110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0b629eb-4940-4199-89ce-765cbf2b6208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:34:20 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-09c3e7bb-9819-4206-bf1d-7a3c87ac492d tempest-ServersNegativeTestJSON-1490479110 None] Flow 'volume_create_manager' (77d27273-d79b-4779-98b6-740966ae141f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:34:20 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-09c3e7bb-9819-4206-bf1d-7a3c87ac492d tempest-ServersNegativeTestJSON-1490479110 None] Created volume successfully. Aug 28 09:34:23 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c5665e4d-a10a-4376-ac26-6433c1c681cb tempest-ServersNegativeTestJSON-1490479110 None] Acquiring lock "cinder-c1daee65-4843-4eee-834f-ef10eb7ba491-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:34:23 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c5665e4d-a10a-4376-ac26-6433c1c681cb tempest-ServersNegativeTestJSON-1490479110 None] Lock "cinder-c1daee65-4843-4eee-834f-ef10eb7ba491-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:34:23 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c5665e4d-a10a-4376-ac26-6433c1c681cb tempest-ServersNegativeTestJSON-1490479110 None] Acquiring lock "cinder-quobyte-c1daee65-4843-4eee-834f-ef10eb7ba491" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:34:23 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c5665e4d-a10a-4376-ac26-6433c1c681cb tempest-ServersNegativeTestJSON-1490479110 None] Lock "cinder-quobyte-c1daee65-4843-4eee-834f-ef10eb7ba491" acquired by "delete_volume" :: waited 0.048s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:34:23 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[803c8540-2785-40ad-afc0-76aba15ae1d0]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:34:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c5665e4d-a10a-4376-ac26-6433c1c681cb tempest-ServersNegativeTestJSON-1490479110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c1daee65-4843-4eee-834f-ef10eb7ba491 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:34:23 devstack sudo[90765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c1daee65-4843-4eee-834f-ef10eb7ba491 Aug 28 09:34:23 devstack sudo[90765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:34:24 devstack sudo[90765]: pam_unix(sudo:session): session closed for user root Aug 28 09:34:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c5665e4d-a10a-4376-ac26-6433c1c681cb tempest-ServersNegativeTestJSON-1490479110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c1daee65-4843-4eee-834f-ef10eb7ba491" returned: 0 in 0.922s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:34:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c5665e4d-a10a-4376-ac26-6433c1c681cb tempest-ServersNegativeTestJSON-1490479110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c1daee65-4843-4eee-834f-ef10eb7ba491 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:34:24 devstack sudo[90777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c1daee65-4843-4eee-834f-ef10eb7ba491 Aug 28 09:34:24 devstack sudo[90777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:34:24 devstack sudo[90777]: pam_unix(sudo:session): session closed for user root Aug 28 09:34:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c5665e4d-a10a-4376-ac26-6433c1c681cb tempest-ServersNegativeTestJSON-1490479110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c1daee65-4843-4eee-834f-ef10eb7ba491" returned: 0 in 0.680s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:34:24 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c5665e4d-a10a-4376-ac26-6433c1c681cb tempest-ServersNegativeTestJSON-1490479110 None] Lock "cinder-quobyte-c1daee65-4843-4eee-834f-ef10eb7ba491" released by "delete_volume" :: held 1.716s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:34:25 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-c5665e4d-a10a-4376-ac26-6433c1c681cb tempest-ServersNegativeTestJSON-1490479110 None] Created reservations ['f5a7e930-c697-4271-9eed-9a4c48d70d1d', 'fcd9abe9-4709-4f89-b54b-b252262a9ad7', 'd0f1e13f-692a-4f57-a9b1-6c95a75b72a4', '74bba6ca-edaf-4854-bb79-a73fa1ea8844'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:34:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-c5665e4d-a10a-4376-ac26-6433c1c681cb tempest-ServersNegativeTestJSON-1490479110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:34:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-c5665e4d-a10a-4376-ac26-6433c1c681cb tempest-ServersNegativeTestJSON-1490479110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:34:25 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-c5665e4d-a10a-4376-ac26-6433c1c681cb tempest-ServersNegativeTestJSON-1490479110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:34:25 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-c5665e4d-a10a-4376-ac26-6433c1c681cb tempest-ServersNegativeTestJSON-1490479110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:34:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-c5665e4d-a10a-4376-ac26-6433c1c681cb tempest-ServersNegativeTestJSON-1490479110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:34:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c5665e4d-a10a-4376-ac26-6433c1c681cb tempest-ServersNegativeTestJSON-1490479110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:34:25 devstack sudo[90780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:34:25 devstack sudo[90780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:34:25 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a8e4cb6b-942b-49b1-a7f2-e645e183a36e tempest-ServersNegativeTestJSON-1490479110 None] Acquiring lock "cinder-f6df37e7-77e1-42ac-9b70-c365649096eb-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:34:25 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a8e4cb6b-942b-49b1-a7f2-e645e183a36e tempest-ServersNegativeTestJSON-1490479110 None] Lock "cinder-f6df37e7-77e1-42ac-9b70-c365649096eb-delete_volume" acquired by "delete_volume" :: waited 0.121s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:34:26 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a8e4cb6b-942b-49b1-a7f2-e645e183a36e tempest-ServersNegativeTestJSON-1490479110 None] Acquiring lock "cinder-quobyte-f6df37e7-77e1-42ac-9b70-c365649096eb" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:34:26 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a8e4cb6b-942b-49b1-a7f2-e645e183a36e tempest-ServersNegativeTestJSON-1490479110 None] Lock "cinder-quobyte-f6df37e7-77e1-42ac-9b70-c365649096eb" acquired by "delete_volume" :: waited 0.025s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:34:26 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[4625067e-8542-4b63-8aaa-71d907877b8b]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:34:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a8e4cb6b-942b-49b1-a7f2-e645e183a36e tempest-ServersNegativeTestJSON-1490479110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f6df37e7-77e1-42ac-9b70-c365649096eb {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:34:26 devstack sudo[90783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f6df37e7-77e1-42ac-9b70-c365649096eb Aug 28 09:34:26 devstack sudo[90783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:34:26 devstack sudo[90780]: pam_unix(sudo:session): session closed for user root Aug 28 09:34:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c5665e4d-a10a-4376-ac26-6433c1c681cb tempest-ServersNegativeTestJSON-1490479110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 1.420s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:34:26 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-c5665e4d-a10a-4376-ac26-6433c1c681cb tempest-ServersNegativeTestJSON-1490479110 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:34:26 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-c5665e4d-a10a-4376-ac26-6433c1c681cb tempest-ServersNegativeTestJSON-1490479110 None] Deleted volume successfully. Aug 28 09:34:26 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c5665e4d-a10a-4376-ac26-6433c1c681cb tempest-ServersNegativeTestJSON-1490479110 None] Lock "cinder-c1daee65-4843-4eee-834f-ef10eb7ba491-delete_volume" released by "delete_volume" :: held 3.830s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:34:27 devstack sudo[90783]: pam_unix(sudo:session): session closed for user root Aug 28 09:34:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a8e4cb6b-942b-49b1-a7f2-e645e183a36e tempest-ServersNegativeTestJSON-1490479110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f6df37e7-77e1-42ac-9b70-c365649096eb" returned: 0 in 1.432s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:34:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a8e4cb6b-942b-49b1-a7f2-e645e183a36e tempest-ServersNegativeTestJSON-1490479110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f6df37e7-77e1-42ac-9b70-c365649096eb {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:34:27 devstack sudo[90860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f6df37e7-77e1-42ac-9b70-c365649096eb Aug 28 09:34:27 devstack sudo[90860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:34:28 devstack sudo[90860]: pam_unix(sudo:session): session closed for user root Aug 28 09:34:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a8e4cb6b-942b-49b1-a7f2-e645e183a36e tempest-ServersNegativeTestJSON-1490479110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f6df37e7-77e1-42ac-9b70-c365649096eb" returned: 0 in 0.571s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:34:28 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a8e4cb6b-942b-49b1-a7f2-e645e183a36e tempest-ServersNegativeTestJSON-1490479110 None] Lock "cinder-quobyte-f6df37e7-77e1-42ac-9b70-c365649096eb" released by "delete_volume" :: held 2.170s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:34:28 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-a8e4cb6b-942b-49b1-a7f2-e645e183a36e tempest-ServersNegativeTestJSON-1490479110 None] Created reservations ['e82f7ac9-7536-4505-b5b3-c8054f7ab343', 'd4d61aad-03c7-4611-826b-393e7e62b4c7', 'cf152166-69d3-4082-8d36-205963994438', '36dc4d50-ef37-467d-b6e6-f5d35faf26ea'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:34:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a8e4cb6b-942b-49b1-a7f2-e645e183a36e tempest-ServersNegativeTestJSON-1490479110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:34:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a8e4cb6b-942b-49b1-a7f2-e645e183a36e tempest-ServersNegativeTestJSON-1490479110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:34:28 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-a8e4cb6b-942b-49b1-a7f2-e645e183a36e tempest-ServersNegativeTestJSON-1490479110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:34:28 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-a8e4cb6b-942b-49b1-a7f2-e645e183a36e tempest-ServersNegativeTestJSON-1490479110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:34:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a8e4cb6b-942b-49b1-a7f2-e645e183a36e tempest-ServersNegativeTestJSON-1490479110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:34:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a8e4cb6b-942b-49b1-a7f2-e645e183a36e tempest-ServersNegativeTestJSON-1490479110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:34:28 devstack sudo[90864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:34:28 devstack sudo[90864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:34:28 devstack sudo[90864]: pam_unix(sudo:session): session closed for user root Aug 28 09:34:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a8e4cb6b-942b-49b1-a7f2-e645e183a36e tempest-ServersNegativeTestJSON-1490479110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.360s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:34:28 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-a8e4cb6b-942b-49b1-a7f2-e645e183a36e tempest-ServersNegativeTestJSON-1490479110 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:34:28 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-a8e4cb6b-942b-49b1-a7f2-e645e183a36e tempest-ServersNegativeTestJSON-1490479110 None] Deleted volume successfully. Aug 28 09:34:29 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a8e4cb6b-942b-49b1-a7f2-e645e183a36e tempest-ServersNegativeTestJSON-1490479110 None] Lock "cinder-f6df37e7-77e1-42ac-9b70-c365649096eb-delete_volume" released by "delete_volume" :: held 3.046s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:34:30 devstack cinder-volume[86081]: INFO cinder.volume.manager [req-fd873697-50cd-4d1e-9fb8-10c7faa47c66 req-2aa15f1c-07b2-4460-b418-54d707422756 tempest-ServerActionsTestOtherA-1923649618 None] Terminate volume connection completed successfully. Aug 28 09:34:30 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-fd873697-50cd-4d1e-9fb8-10c7faa47c66 req-2aa15f1c-07b2-4460-b418-54d707422756 tempest-ServerActionsTestOtherA-1923649618 None] Deleting attachment f05378f7-3733-41eb-a236-3b5227fc3d2e. {{(pid=86081) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 09:34:33 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-914be525-f808-4a17-8aa3-e9ae9607da4b tempest-ServerRescueNegativeTestJSON-1663044983 None] Acquiring lock "cinder-685ab113-4811-4589-9234-659335ad08bf-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:34:33 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-914be525-f808-4a17-8aa3-e9ae9607da4b tempest-ServerRescueNegativeTestJSON-1663044983 None] Lock "cinder-685ab113-4811-4589-9234-659335ad08bf-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:34:33 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-914be525-f808-4a17-8aa3-e9ae9607da4b tempest-ServerRescueNegativeTestJSON-1663044983 None] Acquiring lock "cinder-quobyte-685ab113-4811-4589-9234-659335ad08bf" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:34:33 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-914be525-f808-4a17-8aa3-e9ae9607da4b tempest-ServerRescueNegativeTestJSON-1663044983 None] Lock "cinder-quobyte-685ab113-4811-4589-9234-659335ad08bf" acquired by "delete_volume" :: waited 0.029s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:34:33 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37848d2-cfb3-4177-bf92-376ff91aa734]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:34:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-914be525-f808-4a17-8aa3-e9ae9607da4b tempest-ServerRescueNegativeTestJSON-1663044983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-685ab113-4811-4589-9234-659335ad08bf {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:34:33 devstack sudo[90951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-685ab113-4811-4589-9234-659335ad08bf Aug 28 09:34:33 devstack sudo[90951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:34:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-fd873697-50cd-4d1e-9fb8-10c7faa47c66 req-13d25c1e-dad2-4df2-8bff-96eb7f80c33c tempest-ServerActionsTestOtherA-1923649618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:34:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-fd873697-50cd-4d1e-9fb8-10c7faa47c66 req-13d25c1e-dad2-4df2-8bff-96eb7f80c33c tempest-ServerActionsTestOtherA-1923649618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:34:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-fd873697-50cd-4d1e-9fb8-10c7faa47c66 req-13d25c1e-dad2-4df2-8bff-96eb7f80c33c tempest-ServerActionsTestOtherA-1923649618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.051s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:34:34 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-fd873697-50cd-4d1e-9fb8-10c7faa47c66 req-13d25c1e-dad2-4df2-8bff-96eb7f80c33c tempest-ServerActionsTestOtherA-1923649618 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b', 'name': 'volume-2e827f2c-b669-440f-9625-91c66beaa717', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '574a5058-6315-4756-9e70-b9be421575a2', 'enforce_multipath': True} {{(pid=86081) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 09:34:34 devstack cinder-volume[86081]: INFO cinder.volume.manager [req-fd873697-50cd-4d1e-9fb8-10c7faa47c66 req-13d25c1e-dad2-4df2-8bff-96eb7f80c33c tempest-ServerActionsTestOtherA-1923649618 None] attachment_update completed successfully. Aug 28 09:34:34 devstack sudo[90951]: pam_unix(sudo:session): session closed for user root Aug 28 09:34:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-914be525-f808-4a17-8aa3-e9ae9607da4b tempest-ServerRescueNegativeTestJSON-1663044983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-685ab113-4811-4589-9234-659335ad08bf" returned: 0 in 0.665s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:34:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-914be525-f808-4a17-8aa3-e9ae9607da4b tempest-ServerRescueNegativeTestJSON-1663044983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-685ab113-4811-4589-9234-659335ad08bf {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:34:34 devstack sudo[90958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-685ab113-4811-4589-9234-659335ad08bf Aug 28 09:34:34 devstack sudo[90958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:34:34 devstack sudo[90958]: pam_unix(sudo:session): session closed for user root Aug 28 09:34:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-914be525-f808-4a17-8aa3-e9ae9607da4b tempest-ServerRescueNegativeTestJSON-1663044983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-685ab113-4811-4589-9234-659335ad08bf" returned: 0 in 0.346s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:34:34 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-914be525-f808-4a17-8aa3-e9ae9607da4b tempest-ServerRescueNegativeTestJSON-1663044983 None] Lock "cinder-quobyte-685ab113-4811-4589-9234-659335ad08bf" released by "delete_volume" :: held 1.110s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:34:34 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-914be525-f808-4a17-8aa3-e9ae9607da4b tempest-ServerRescueNegativeTestJSON-1663044983 None] Created reservations ['6f7a1b6c-ad52-4e27-8105-5c51affed2b5', '4b57c16c-b1e7-4cce-8b41-f46051b04039', '0cc76975-1db5-47cd-943c-63e346a75d0a', '2ad570ae-578b-4a95-a10f-fa932acdd261'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:34:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-914be525-f808-4a17-8aa3-e9ae9607da4b tempest-ServerRescueNegativeTestJSON-1663044983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:34:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-914be525-f808-4a17-8aa3-e9ae9607da4b tempest-ServerRescueNegativeTestJSON-1663044983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:34:34 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-914be525-f808-4a17-8aa3-e9ae9607da4b tempest-ServerRescueNegativeTestJSON-1663044983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:34:34 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-914be525-f808-4a17-8aa3-e9ae9607da4b tempest-ServerRescueNegativeTestJSON-1663044983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:34:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-914be525-f808-4a17-8aa3-e9ae9607da4b tempest-ServerRescueNegativeTestJSON-1663044983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:34:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-914be525-f808-4a17-8aa3-e9ae9607da4b tempest-ServerRescueNegativeTestJSON-1663044983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:34:34 devstack sudo[91006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:34:34 devstack sudo[91006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:34:35 devstack sudo[91006]: pam_unix(sudo:session): session closed for user root Aug 28 09:34:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-914be525-f808-4a17-8aa3-e9ae9607da4b tempest-ServerRescueNegativeTestJSON-1663044983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.595s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:34:35 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-914be525-f808-4a17-8aa3-e9ae9607da4b tempest-ServerRescueNegativeTestJSON-1663044983 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:34:35 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-914be525-f808-4a17-8aa3-e9ae9607da4b tempest-ServerRescueNegativeTestJSON-1663044983 None] Deleted volume successfully. Aug 28 09:34:35 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-914be525-f808-4a17-8aa3-e9ae9607da4b tempest-ServerRescueNegativeTestJSON-1663044983 None] Lock "cinder-685ab113-4811-4589-9234-659335ad08bf-delete_volume" released by "delete_volume" :: held 2.070s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:34:36 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-8daf65f8-465c-42c5-b724-eb751f7197de tempest-VolumeTypesAccessTest-1292855997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:34:36 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8daf65f8-465c-42c5-b724-eb751f7197de tempest-VolumeTypesAccessTest-1292855997 None] Flow 'volume_create_manager' (8e5ca0f1-362a-4560-bf6f-8e0ffb5f0306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:34:36 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8daf65f8-465c-42c5-b724-eb751f7197de tempest-VolumeTypesAccessTest-1292855997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2100e3f9-bcaa-45f3-a179-a2af7057ef2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:34:36 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8daf65f8-465c-42c5-b724-eb751f7197de tempest-VolumeTypesAccessTest-1292855997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2100e3f9-bcaa-45f3-a179-a2af7057ef2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:34:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-104713518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f64cd2c5-83d9-47f3-af32-5dfb475fb704,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3dcde7f5ed34c21bfde2f3ab06e62de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:34:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:34:36Z,use_quota=True,user_id='52f0bef581d04414b09d109531a54fcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(647905b6-e5f1-4b85-addf-300533baf671),volume_type_id=647905b6-e5f1-4b85-addf-300533baf671)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:34:36 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8daf65f8-465c-42c5-b724-eb751f7197de tempest-VolumeTypesAccessTest-1292855997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b844306-7005-4c94-8cb3-d2cf1229d295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:34:36 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8daf65f8-465c-42c5-b724-eb751f7197de tempest-VolumeTypesAccessTest-1292855997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b844306-7005-4c94-8cb3-d2cf1229d295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:34:36 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8daf65f8-465c-42c5-b724-eb751f7197de tempest-VolumeTypesAccessTest-1292855997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (098618de-f910-46fc-8493-a19bfb7e11f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:34:36 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8daf65f8-465c-42c5-b724-eb751f7197de tempest-VolumeTypesAccessTest-1292855997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (098618de-f910-46fc-8493-a19bfb7e11f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f64cd2c5-83d9-47f3-af32-5dfb475fb704', 'volume_name': 'volume-f64cd2c5-83d9-47f3-af32-5dfb475fb704', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:34:36 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8daf65f8-465c-42c5-b724-eb751f7197de tempest-VolumeTypesAccessTest-1292855997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49119ab0-ffa3-4f74-a6f8-42d1a61b316c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:34:36 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8daf65f8-465c-42c5-b724-eb751f7197de tempest-VolumeTypesAccessTest-1292855997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49119ab0-ffa3-4f74-a6f8-42d1a61b316c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:34:36 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8daf65f8-465c-42c5-b724-eb751f7197de tempest-VolumeTypesAccessTest-1292855997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d19eead-619e-4078-8140-8a73a187698b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:34:36 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-8daf65f8-465c-42c5-b724-eb751f7197de tempest-VolumeTypesAccessTest-1292855997 None] Volume f64cd2c5-83d9-47f3-af32-5dfb475fb704: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f64cd2c5-83d9-47f3-af32-5dfb475fb704', 'volume_size': 1} Aug 28 09:34:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8daf65f8-465c-42c5-b724-eb751f7197de tempest-VolumeTypesAccessTest-1292855997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:34:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8daf65f8-465c-42c5-b724-eb751f7197de tempest-VolumeTypesAccessTest-1292855997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:34:36 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-8daf65f8-465c-42c5-b724-eb751f7197de tempest-VolumeTypesAccessTest-1292855997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:34:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-104713518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f64cd2c5-83d9-47f3-af32-5dfb475fb704,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3dcde7f5ed34c21bfde2f3ab06e62de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:34:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:34:36Z,use_quota=True,user_id='52f0bef581d04414b09d109531a54fcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(647905b6-e5f1-4b85-addf-300533baf671),volume_type_id=647905b6-e5f1-4b85-addf-300533baf671)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:34:36 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-8daf65f8-465c-42c5-b724-eb751f7197de tempest-VolumeTypesAccessTest-1292855997 None] Creating volume f64cd2c5-83d9-47f3-af32-5dfb475fb704 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:34:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8daf65f8-465c-42c5-b724-eb751f7197de tempest-VolumeTypesAccessTest-1292855997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:34:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8daf65f8-465c-42c5-b724-eb751f7197de tempest-VolumeTypesAccessTest-1292855997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:34:36 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-8daf65f8-465c-42c5-b724-eb751f7197de tempest-VolumeTypesAccessTest-1292855997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:34:36 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-8daf65f8-465c-42c5-b724-eb751f7197de tempest-VolumeTypesAccessTest-1292855997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:34:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8daf65f8-465c-42c5-b724-eb751f7197de tempest-VolumeTypesAccessTest-1292855997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:34:36 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-8daf65f8-465c-42c5-b724-eb751f7197de tempest-VolumeTypesAccessTest-1292855997 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:34:36 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-8daf65f8-465c-42c5-b724-eb751f7197de tempest-VolumeTypesAccessTest-1292855997 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:34:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8daf65f8-465c-42c5-b724-eb751f7197de tempest-VolumeTypesAccessTest-1292855997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f64cd2c5-83d9-47f3-af32-5dfb475fb704 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:34:36 devstack sudo[91378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f64cd2c5-83d9-47f3-af32-5dfb475fb704 1073741824 Aug 28 09:34:36 devstack sudo[91378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:34:37 devstack sudo[91378]: pam_unix(sudo:session): session closed for user root Aug 28 09:34:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8daf65f8-465c-42c5-b724-eb751f7197de tempest-VolumeTypesAccessTest-1292855997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f64cd2c5-83d9-47f3-af32-5dfb475fb704 1073741824" returned: 0 in 1.139s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:34:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8daf65f8-465c-42c5-b724-eb751f7197de tempest-VolumeTypesAccessTest-1292855997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f64cd2c5-83d9-47f3-af32-5dfb475fb704 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:34:37 devstack sudo[91412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f64cd2c5-83d9-47f3-af32-5dfb475fb704 Aug 28 09:34:37 devstack sudo[91412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:34:38 devstack cinder-volume[86081]: DEBUG oslo_service.periodic_task [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86081) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:34:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:34:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:34:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:34:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:34:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:34:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:34:38 devstack sudo[91412]: pam_unix(sudo:session): session closed for user root Aug 28 09:34:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8daf65f8-465c-42c5-b724-eb751f7197de tempest-VolumeTypesAccessTest-1292855997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f64cd2c5-83d9-47f3-af32-5dfb475fb704" returned: 0 in 0.530s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:34:38 devstack sudo[91418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:34:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-8daf65f8-465c-42c5-b724-eb751f7197de tempest-VolumeTypesAccessTest-1292855997 None] <== create_volume: return (1762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:34:38 devstack sudo[91418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:34:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8daf65f8-465c-42c5-b724-eb751f7197de tempest-VolumeTypesAccessTest-1292855997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.768s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:34:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8daf65f8-465c-42c5-b724-eb751f7197de tempest-VolumeTypesAccessTest-1292855997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d19eead-619e-4078-8140-8a73a187698b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f64cd2c5-83d9-47f3-af32-5dfb475fb704', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:34:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8daf65f8-465c-42c5-b724-eb751f7197de tempest-VolumeTypesAccessTest-1292855997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a67f030e-a29c-450c-86d5-116397f5f353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:34:38 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-8daf65f8-465c-42c5-b724-eb751f7197de tempest-VolumeTypesAccessTest-1292855997 None] Volume volume-f64cd2c5-83d9-47f3-af32-5dfb475fb704 (f64cd2c5-83d9-47f3-af32-5dfb475fb704): created successfully Aug 28 09:34:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8daf65f8-465c-42c5-b724-eb751f7197de tempest-VolumeTypesAccessTest-1292855997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a67f030e-a29c-450c-86d5-116397f5f353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:34:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8daf65f8-465c-42c5-b724-eb751f7197de tempest-VolumeTypesAccessTest-1292855997 None] Flow 'volume_create_manager' (8e5ca0f1-362a-4560-bf6f-8e0ffb5f0306) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:34:38 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-8daf65f8-465c-42c5-b724-eb751f7197de tempest-VolumeTypesAccessTest-1292855997 None] Created volume successfully. Aug 28 09:34:38 devstack sudo[91418]: pam_unix(sudo:session): session closed for user root Aug 28 09:34:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.708s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:34:38 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:34:38 devstack cinder-volume[86081]: DEBUG oslo_service.periodic_task [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running periodic task VolumeManager._thread_info {{(pid=86081) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:34:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] thread count: 28 {{(pid=86081) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 09:34:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] thread info: [<_MainThread(MainThread, started 129914189705344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86081) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 09:34:39 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-7130ffdd-99c6-43be-8b26-07d63dd96ce1 tempest-VolumeTypesAccessTest-1292855997 None] Acquiring lock "cinder-f64cd2c5-83d9-47f3-af32-5dfb475fb704-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:34:39 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-7130ffdd-99c6-43be-8b26-07d63dd96ce1 tempest-VolumeTypesAccessTest-1292855997 None] Lock "cinder-f64cd2c5-83d9-47f3-af32-5dfb475fb704-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:34:39 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-7130ffdd-99c6-43be-8b26-07d63dd96ce1 tempest-VolumeTypesAccessTest-1292855997 None] Acquiring lock "cinder-quobyte-f64cd2c5-83d9-47f3-af32-5dfb475fb704" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:34:39 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-7130ffdd-99c6-43be-8b26-07d63dd96ce1 tempest-VolumeTypesAccessTest-1292855997 None] Lock "cinder-quobyte-f64cd2c5-83d9-47f3-af32-5dfb475fb704" acquired by "delete_volume" :: waited 0.039s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:34:39 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a74bc2c-6ea6-401a-acd3-893c43f0b2a0]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:34:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7130ffdd-99c6-43be-8b26-07d63dd96ce1 tempest-VolumeTypesAccessTest-1292855997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f64cd2c5-83d9-47f3-af32-5dfb475fb704 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:34:40 devstack sudo[91428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f64cd2c5-83d9-47f3-af32-5dfb475fb704 Aug 28 09:34:40 devstack sudo[91428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:34:40 devstack sudo[91428]: pam_unix(sudo:session): session closed for user root Aug 28 09:34:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7130ffdd-99c6-43be-8b26-07d63dd96ce1 tempest-VolumeTypesAccessTest-1292855997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f64cd2c5-83d9-47f3-af32-5dfb475fb704" returned: 0 in 0.979s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:34:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7130ffdd-99c6-43be-8b26-07d63dd96ce1 tempest-VolumeTypesAccessTest-1292855997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f64cd2c5-83d9-47f3-af32-5dfb475fb704 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:34:40 devstack sudo[91437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f64cd2c5-83d9-47f3-af32-5dfb475fb704 Aug 28 09:34:40 devstack sudo[91437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:34:41 devstack sudo[91437]: pam_unix(sudo:session): session closed for user root Aug 28 09:34:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7130ffdd-99c6-43be-8b26-07d63dd96ce1 tempest-VolumeTypesAccessTest-1292855997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f64cd2c5-83d9-47f3-af32-5dfb475fb704" returned: 0 in 0.753s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:34:41 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-7130ffdd-99c6-43be-8b26-07d63dd96ce1 tempest-VolumeTypesAccessTest-1292855997 None] Lock "cinder-quobyte-f64cd2c5-83d9-47f3-af32-5dfb475fb704" released by "delete_volume" :: held 1.852s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:34:41 devstack cinder-volume[86081]: WARNING cinder.quota [None req-7130ffdd-99c6-43be-8b26-07d63dd96ce1 tempest-VolumeTypesAccessTest-1292855997 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-201534102 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-201534102, it is now deprecated. Please use the default quota class for default quota. Aug 28 09:34:41 devstack cinder-volume[86081]: WARNING cinder.quota [None req-7130ffdd-99c6-43be-8b26-07d63dd96ce1 tempest-VolumeTypesAccessTest-1292855997 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-201534102 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-201534102, it is now deprecated. Please use the default quota class for default quota. Aug 28 09:34:41 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-7130ffdd-99c6-43be-8b26-07d63dd96ce1 tempest-VolumeTypesAccessTest-1292855997 None] Created reservations ['422018d1-7b55-412f-8486-b8a491b3e309', '0346f9ae-f34a-4700-bace-f0d26bc95d59', 'fe19f86e-ccc2-462c-96d6-81e4f152eced', 'dd194c39-2cae-4017-80c2-bf6d7678fca3'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:34:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-7130ffdd-99c6-43be-8b26-07d63dd96ce1 tempest-VolumeTypesAccessTest-1292855997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:34:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-7130ffdd-99c6-43be-8b26-07d63dd96ce1 tempest-VolumeTypesAccessTest-1292855997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:34:41 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-7130ffdd-99c6-43be-8b26-07d63dd96ce1 tempest-VolumeTypesAccessTest-1292855997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:34:41 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-7130ffdd-99c6-43be-8b26-07d63dd96ce1 tempest-VolumeTypesAccessTest-1292855997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:34:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-7130ffdd-99c6-43be-8b26-07d63dd96ce1 tempest-VolumeTypesAccessTest-1292855997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:34:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7130ffdd-99c6-43be-8b26-07d63dd96ce1 tempest-VolumeTypesAccessTest-1292855997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:34:42 devstack sudo[91440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:34:42 devstack sudo[91440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:34:42 devstack sudo[91440]: pam_unix(sudo:session): session closed for user root Aug 28 09:34:42 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7130ffdd-99c6-43be-8b26-07d63dd96ce1 tempest-VolumeTypesAccessTest-1292855997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.883s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:34:42 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-7130ffdd-99c6-43be-8b26-07d63dd96ce1 tempest-VolumeTypesAccessTest-1292855997 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:34:42 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-7130ffdd-99c6-43be-8b26-07d63dd96ce1 tempest-VolumeTypesAccessTest-1292855997 None] Deleted volume successfully. Aug 28 09:34:42 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-7130ffdd-99c6-43be-8b26-07d63dd96ce1 tempest-VolumeTypesAccessTest-1292855997 None] Lock "cinder-f64cd2c5-83d9-47f3-af32-5dfb475fb704-delete_volume" released by "delete_volume" :: held 3.243s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:34:51 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writing DB stats cinder:SELECT=37,cinder:UPDATE=48,cinder:INSERT=12,cinder:DELETE=3 {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:34:52 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writing DB stats cinder:UPDATE=44,cinder:SELECT=35,cinder:INSERT=8,cinder:DELETE=5 {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:35:14 devstack cinder-volume[86081]: INFO cinder.volume.manager [req-4c030381-9930-4af7-bcc3-94019e48b1b9 req-1f4b1579-d353-42ce-8e4b-3ab7a1b41941 tempest-ServerActionsTestOtherA-1923649618 None] Terminate volume connection completed successfully. Aug 28 09:35:14 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-4c030381-9930-4af7-bcc3-94019e48b1b9 req-1f4b1579-d353-42ce-8e4b-3ab7a1b41941 tempest-ServerActionsTestOtherA-1923649618 None] Deleting attachment 574a5058-6315-4756-9e70-b9be421575a2. {{(pid=86081) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 09:35:14 devstack cinder-volume[86081]: DEBUG cinder.coordination [req-4c030381-9930-4af7-bcc3-94019e48b1b9 req-e26a3e56-8890-471b-a464-54eb8ed5e512 tempest-ServerActionsTestOtherA-1923649618 None] Acquiring lock "cinder-2e827f2c-b669-440f-9625-91c66beaa717-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:35:14 devstack cinder-volume[86081]: DEBUG cinder.coordination [req-4c030381-9930-4af7-bcc3-94019e48b1b9 req-e26a3e56-8890-471b-a464-54eb8ed5e512 tempest-ServerActionsTestOtherA-1923649618 None] Lock "cinder-2e827f2c-b669-440f-9625-91c66beaa717-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:35:14 devstack cinder-volume[86081]: DEBUG cinder.coordination [req-4c030381-9930-4af7-bcc3-94019e48b1b9 req-e26a3e56-8890-471b-a464-54eb8ed5e512 tempest-ServerActionsTestOtherA-1923649618 None] Acquiring lock "cinder-quobyte-2e827f2c-b669-440f-9625-91c66beaa717" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:35:14 devstack cinder-volume[86081]: DEBUG cinder.coordination [req-4c030381-9930-4af7-bcc3-94019e48b1b9 req-e26a3e56-8890-471b-a464-54eb8ed5e512 tempest-ServerActionsTestOtherA-1923649618 None] Lock "cinder-quobyte-2e827f2c-b669-440f-9625-91c66beaa717" acquired by "delete_volume" :: waited 0.039s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:35:14 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[750e69b6-3218-4986-b77e-ac939e96fb64]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:35:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [req-4c030381-9930-4af7-bcc3-94019e48b1b9 req-e26a3e56-8890-471b-a464-54eb8ed5e512 tempest-ServerActionsTestOtherA-1923649618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e827f2c-b669-440f-9625-91c66beaa717 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:35:14 devstack sudo[91679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e827f2c-b669-440f-9625-91c66beaa717 Aug 28 09:35:14 devstack sudo[91679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:35:15 devstack sudo[91679]: pam_unix(sudo:session): session closed for user root Aug 28 09:35:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [req-4c030381-9930-4af7-bcc3-94019e48b1b9 req-e26a3e56-8890-471b-a464-54eb8ed5e512 tempest-ServerActionsTestOtherA-1923649618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e827f2c-b669-440f-9625-91c66beaa717" returned: 0 in 0.533s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:35:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [req-4c030381-9930-4af7-bcc3-94019e48b1b9 req-e26a3e56-8890-471b-a464-54eb8ed5e512 tempest-ServerActionsTestOtherA-1923649618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e827f2c-b669-440f-9625-91c66beaa717 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:35:15 devstack sudo[91685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e827f2c-b669-440f-9625-91c66beaa717 Aug 28 09:35:15 devstack sudo[91685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:35:15 devstack sudo[91685]: pam_unix(sudo:session): session closed for user root Aug 28 09:35:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [req-4c030381-9930-4af7-bcc3-94019e48b1b9 req-e26a3e56-8890-471b-a464-54eb8ed5e512 tempest-ServerActionsTestOtherA-1923649618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e827f2c-b669-440f-9625-91c66beaa717" returned: 0 in 0.296s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:35:15 devstack cinder-volume[86081]: DEBUG cinder.coordination [req-4c030381-9930-4af7-bcc3-94019e48b1b9 req-e26a3e56-8890-471b-a464-54eb8ed5e512 tempest-ServerActionsTestOtherA-1923649618 None] Lock "cinder-quobyte-2e827f2c-b669-440f-9625-91c66beaa717" released by "delete_volume" :: held 0.916s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:35:15 devstack cinder-volume[86081]: DEBUG cinder.quota [req-4c030381-9930-4af7-bcc3-94019e48b1b9 req-e26a3e56-8890-471b-a464-54eb8ed5e512 tempest-ServerActionsTestOtherA-1923649618 None] Created reservations ['d99f1da5-54c1-438b-bae0-322faa64d845', '44e405e5-db86-4d47-adb0-8c0fede884e2', '7b219ee2-6ff9-43f4-b272-681ab20e4846', 'ef0feb30-958e-4636-8ea4-214e1526cbb0'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:35:15 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-073a6ff8-ba41-49ac-b053-fdbadca91523 tempest-ServerActionsTestOtherA-1923649618 None] Acquiring lock "cinder-eb63f10b-56e5-41f7-85eb-8408c442a334-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:35:15 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-073a6ff8-ba41-49ac-b053-fdbadca91523 tempest-ServerActionsTestOtherA-1923649618 None] Lock "cinder-eb63f10b-56e5-41f7-85eb-8408c442a334-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:35:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-4c030381-9930-4af7-bcc3-94019e48b1b9 req-e26a3e56-8890-471b-a464-54eb8ed5e512 tempest-ServerActionsTestOtherA-1923649618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:35:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-4c030381-9930-4af7-bcc3-94019e48b1b9 req-e26a3e56-8890-471b-a464-54eb8ed5e512 tempest-ServerActionsTestOtherA-1923649618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:35:15 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [req-4c030381-9930-4af7-bcc3-94019e48b1b9 req-e26a3e56-8890-471b-a464-54eb8ed5e512 tempest-ServerActionsTestOtherA-1923649618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:35:15 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [req-4c030381-9930-4af7-bcc3-94019e48b1b9 req-e26a3e56-8890-471b-a464-54eb8ed5e512 tempest-ServerActionsTestOtherA-1923649618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:35:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-4c030381-9930-4af7-bcc3-94019e48b1b9 req-e26a3e56-8890-471b-a464-54eb8ed5e512 tempest-ServerActionsTestOtherA-1923649618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:35:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [req-4c030381-9930-4af7-bcc3-94019e48b1b9 req-e26a3e56-8890-471b-a464-54eb8ed5e512 tempest-ServerActionsTestOtherA-1923649618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:35:15 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-073a6ff8-ba41-49ac-b053-fdbadca91523 tempest-ServerActionsTestOtherA-1923649618 None] Acquiring lock "cinder-quobyte-eb63f10b-56e5-41f7-85eb-8408c442a334" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:35:15 devstack sudo[91688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:35:15 devstack sudo[91688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:35:15 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-073a6ff8-ba41-49ac-b053-fdbadca91523 tempest-ServerActionsTestOtherA-1923649618 None] Lock "cinder-quobyte-eb63f10b-56e5-41f7-85eb-8408c442a334" acquired by "delete_volume" :: waited 0.024s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:35:15 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[129ee1fa-60ec-418f-92d8-d7f3d2d4dcea]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:35:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-073a6ff8-ba41-49ac-b053-fdbadca91523 tempest-ServerActionsTestOtherA-1923649618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-eb63f10b-56e5-41f7-85eb-8408c442a334 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:35:16 devstack sudo[91690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-eb63f10b-56e5-41f7-85eb-8408c442a334 Aug 28 09:35:16 devstack sudo[91690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:35:16 devstack sudo[91688]: pam_unix(sudo:session): session closed for user root Aug 28 09:35:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [req-4c030381-9930-4af7-bcc3-94019e48b1b9 req-e26a3e56-8890-471b-a464-54eb8ed5e512 tempest-ServerActionsTestOtherA-1923649618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.349s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:35:16 devstack cinder-volume[86081]: DEBUG cinder.manager [req-4c030381-9930-4af7-bcc3-94019e48b1b9 req-e26a3e56-8890-471b-a464-54eb8ed5e512 tempest-ServerActionsTestOtherA-1923649618 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:35:16 devstack cinder-volume[86081]: INFO cinder.volume.manager [req-4c030381-9930-4af7-bcc3-94019e48b1b9 req-e26a3e56-8890-471b-a464-54eb8ed5e512 tempest-ServerActionsTestOtherA-1923649618 None] Deleted volume successfully. Aug 28 09:35:16 devstack cinder-volume[86081]: DEBUG cinder.coordination [req-4c030381-9930-4af7-bcc3-94019e48b1b9 req-e26a3e56-8890-471b-a464-54eb8ed5e512 tempest-ServerActionsTestOtherA-1923649618 None] Lock "cinder-2e827f2c-b669-440f-9625-91c66beaa717-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:35:16 devstack sudo[91690]: pam_unix(sudo:session): session closed for user root Aug 28 09:35:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-073a6ff8-ba41-49ac-b053-fdbadca91523 tempest-ServerActionsTestOtherA-1923649618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-eb63f10b-56e5-41f7-85eb-8408c442a334" returned: 0 in 0.472s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:35:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-073a6ff8-ba41-49ac-b053-fdbadca91523 tempest-ServerActionsTestOtherA-1923649618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-eb63f10b-56e5-41f7-85eb-8408c442a334 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:35:16 devstack sudo[91698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-eb63f10b-56e5-41f7-85eb-8408c442a334 Aug 28 09:35:16 devstack sudo[91698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:35:16 devstack sudo[91698]: pam_unix(sudo:session): session closed for user root Aug 28 09:35:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-073a6ff8-ba41-49ac-b053-fdbadca91523 tempest-ServerActionsTestOtherA-1923649618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-eb63f10b-56e5-41f7-85eb-8408c442a334" returned: 0 in 0.510s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:35:17 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-073a6ff8-ba41-49ac-b053-fdbadca91523 tempest-ServerActionsTestOtherA-1923649618 None] Lock "cinder-quobyte-eb63f10b-56e5-41f7-85eb-8408c442a334" released by "delete_volume" :: held 1.060s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:35:17 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-073a6ff8-ba41-49ac-b053-fdbadca91523 tempest-ServerActionsTestOtherA-1923649618 None] Created reservations ['44fdf7d9-3e64-441d-8c84-360e8974dfbe', '504a6abe-021a-4405-9ba2-630bef6d41b5', '029dc5cf-7951-41c2-9178-f96411a130aa', '953ccc3a-9a74-42e1-a5db-c24c7e4ae624'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:35:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-073a6ff8-ba41-49ac-b053-fdbadca91523 tempest-ServerActionsTestOtherA-1923649618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:35:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-073a6ff8-ba41-49ac-b053-fdbadca91523 tempest-ServerActionsTestOtherA-1923649618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:35:17 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-073a6ff8-ba41-49ac-b053-fdbadca91523 tempest-ServerActionsTestOtherA-1923649618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:35:17 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-073a6ff8-ba41-49ac-b053-fdbadca91523 tempest-ServerActionsTestOtherA-1923649618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:35:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-073a6ff8-ba41-49ac-b053-fdbadca91523 tempest-ServerActionsTestOtherA-1923649618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:35:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-073a6ff8-ba41-49ac-b053-fdbadca91523 tempest-ServerActionsTestOtherA-1923649618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:35:17 devstack sudo[91704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:35:17 devstack sudo[91704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:35:17 devstack sudo[91704]: pam_unix(sudo:session): session closed for user root Aug 28 09:35:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-073a6ff8-ba41-49ac-b053-fdbadca91523 tempest-ServerActionsTestOtherA-1923649618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.384s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:35:17 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-073a6ff8-ba41-49ac-b053-fdbadca91523 tempest-ServerActionsTestOtherA-1923649618 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:35:17 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-073a6ff8-ba41-49ac-b053-fdbadca91523 tempest-ServerActionsTestOtherA-1923649618 None] Deleted volume successfully. Aug 28 09:35:17 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-073a6ff8-ba41-49ac-b053-fdbadca91523 tempest-ServerActionsTestOtherA-1923649618 None] Lock "cinder-eb63f10b-56e5-41f7-85eb-8408c442a334-delete_volume" released by "delete_volume" :: held 1.890s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:35:24 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9a88985-9f83-4de4-ba9d-b1eef06501ae tempest-VolumesListAdminTestJSON-24999556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:35:24 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b9a88985-9f83-4de4-ba9d-b1eef06501ae tempest-VolumesListAdminTestJSON-24999556 None] Flow 'volume_create_manager' (f04ab505-84de-45a3-bd63-2611507a0efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:35:24 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b9a88985-9f83-4de4-ba9d-b1eef06501ae tempest-VolumesListAdminTestJSON-24999556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (750aad6b-6a6a-4123-a141-da88facddd01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:35:24 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b9a88985-9f83-4de4-ba9d-b1eef06501ae tempest-VolumesListAdminTestJSON-24999556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (750aad6b-6a6a-4123-a141-da88facddd01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:35:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-675036000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b4e6ef5-2efc-480d-85b0-d01cb504f563,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8027589a60a4948818b7a4cc2ec0baa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:35:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:35:24Z,use_quota=True,user_id='903b024e71874eb39fe2f1c541799bb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:35:24 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b9a88985-9f83-4de4-ba9d-b1eef06501ae tempest-VolumesListAdminTestJSON-24999556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd3c1605-ed53-43ac-809b-850725e7afa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:35:24 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b9a88985-9f83-4de4-ba9d-b1eef06501ae tempest-VolumesListAdminTestJSON-24999556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd3c1605-ed53-43ac-809b-850725e7afa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:35:24 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b9a88985-9f83-4de4-ba9d-b1eef06501ae tempest-VolumesListAdminTestJSON-24999556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a5ca20d-51ca-45d0-a829-844761c11053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:35:24 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b9a88985-9f83-4de4-ba9d-b1eef06501ae tempest-VolumesListAdminTestJSON-24999556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a5ca20d-51ca-45d0-a829-844761c11053) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b4e6ef5-2efc-480d-85b0-d01cb504f563', 'volume_name': 'volume-2b4e6ef5-2efc-480d-85b0-d01cb504f563', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:35:24 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b9a88985-9f83-4de4-ba9d-b1eef06501ae tempest-VolumesListAdminTestJSON-24999556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7878fa3-02a7-4155-ae17-28004a021a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:35:24 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b9a88985-9f83-4de4-ba9d-b1eef06501ae tempest-VolumesListAdminTestJSON-24999556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7878fa3-02a7-4155-ae17-28004a021a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:35:24 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b9a88985-9f83-4de4-ba9d-b1eef06501ae tempest-VolumesListAdminTestJSON-24999556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e6387b4-e787-41f5-b56b-9c05fa34c945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:35:24 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-b9a88985-9f83-4de4-ba9d-b1eef06501ae tempest-VolumesListAdminTestJSON-24999556 None] Volume 2b4e6ef5-2efc-480d-85b0-d01cb504f563: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b4e6ef5-2efc-480d-85b0-d01cb504f563', 'volume_size': 1} Aug 28 09:35:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b9a88985-9f83-4de4-ba9d-b1eef06501ae tempest-VolumesListAdminTestJSON-24999556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:35:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b9a88985-9f83-4de4-ba9d-b1eef06501ae tempest-VolumesListAdminTestJSON-24999556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:35:24 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-b9a88985-9f83-4de4-ba9d-b1eef06501ae tempest-VolumesListAdminTestJSON-24999556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:35:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-675036000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b4e6ef5-2efc-480d-85b0-d01cb504f563,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8027589a60a4948818b7a4cc2ec0baa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:35:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:35:24Z,use_quota=True,user_id='903b024e71874eb39fe2f1c541799bb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:35:24 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-b9a88985-9f83-4de4-ba9d-b1eef06501ae tempest-VolumesListAdminTestJSON-24999556 None] Creating volume 2b4e6ef5-2efc-480d-85b0-d01cb504f563 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:35:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b9a88985-9f83-4de4-ba9d-b1eef06501ae tempest-VolumesListAdminTestJSON-24999556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:35:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b9a88985-9f83-4de4-ba9d-b1eef06501ae tempest-VolumesListAdminTestJSON-24999556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:35:24 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-b9a88985-9f83-4de4-ba9d-b1eef06501ae tempest-VolumesListAdminTestJSON-24999556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:35:24 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-b9a88985-9f83-4de4-ba9d-b1eef06501ae tempest-VolumesListAdminTestJSON-24999556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:35:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b9a88985-9f83-4de4-ba9d-b1eef06501ae tempest-VolumesListAdminTestJSON-24999556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:35:24 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-b9a88985-9f83-4de4-ba9d-b1eef06501ae tempest-VolumesListAdminTestJSON-24999556 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:35:24 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-b9a88985-9f83-4de4-ba9d-b1eef06501ae tempest-VolumesListAdminTestJSON-24999556 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:35:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b9a88985-9f83-4de4-ba9d-b1eef06501ae tempest-VolumesListAdminTestJSON-24999556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2b4e6ef5-2efc-480d-85b0-d01cb504f563 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:35:24 devstack sudo[91762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2b4e6ef5-2efc-480d-85b0-d01cb504f563 1073741824 Aug 28 09:35:24 devstack sudo[91762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:35:25 devstack sudo[91762]: pam_unix(sudo:session): session closed for user root Aug 28 09:35:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b9a88985-9f83-4de4-ba9d-b1eef06501ae tempest-VolumesListAdminTestJSON-24999556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2b4e6ef5-2efc-480d-85b0-d01cb504f563 1073741824" returned: 0 in 0.782s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:35:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b9a88985-9f83-4de4-ba9d-b1eef06501ae tempest-VolumesListAdminTestJSON-24999556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2b4e6ef5-2efc-480d-85b0-d01cb504f563 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:35:25 devstack sudo[91773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2b4e6ef5-2efc-480d-85b0-d01cb504f563 Aug 28 09:35:25 devstack sudo[91773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:35:25 devstack sudo[91773]: pam_unix(sudo:session): session closed for user root Aug 28 09:35:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b9a88985-9f83-4de4-ba9d-b1eef06501ae tempest-VolumesListAdminTestJSON-24999556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2b4e6ef5-2efc-480d-85b0-d01cb504f563" returned: 0 in 0.346s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:35:25 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-b9a88985-9f83-4de4-ba9d-b1eef06501ae tempest-VolumesListAdminTestJSON-24999556 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:35:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b9a88985-9f83-4de4-ba9d-b1eef06501ae tempest-VolumesListAdminTestJSON-24999556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:35:25 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b9a88985-9f83-4de4-ba9d-b1eef06501ae tempest-VolumesListAdminTestJSON-24999556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e6387b4-e787-41f5-b56b-9c05fa34c945) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b4e6ef5-2efc-480d-85b0-d01cb504f563', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:35:25 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b9a88985-9f83-4de4-ba9d-b1eef06501ae tempest-VolumesListAdminTestJSON-24999556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b002dbf-4d1e-41ff-a117-d96e2fe0792d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:35:25 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-b9a88985-9f83-4de4-ba9d-b1eef06501ae tempest-VolumesListAdminTestJSON-24999556 None] Volume volume-2b4e6ef5-2efc-480d-85b0-d01cb504f563 (2b4e6ef5-2efc-480d-85b0-d01cb504f563): created successfully Aug 28 09:35:25 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b9a88985-9f83-4de4-ba9d-b1eef06501ae tempest-VolumesListAdminTestJSON-24999556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b002dbf-4d1e-41ff-a117-d96e2fe0792d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:35:25 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b9a88985-9f83-4de4-ba9d-b1eef06501ae tempest-VolumesListAdminTestJSON-24999556 None] Flow 'volume_create_manager' (f04ab505-84de-45a3-bd63-2611507a0efb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:35:25 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-b9a88985-9f83-4de4-ba9d-b1eef06501ae tempest-VolumesListAdminTestJSON-24999556 None] Created volume successfully. Aug 28 09:35:27 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-e20d2192-7574-45ff-88f1-82aec3c5d8aa tempest-VolumesListAdminTestJSON-24999556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:35:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e20d2192-7574-45ff-88f1-82aec3c5d8aa tempest-VolumesListAdminTestJSON-24999556 None] Flow 'volume_create_manager' (f6622432-7fb8-4eb9-a7be-214ebc1fa0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:35:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e20d2192-7574-45ff-88f1-82aec3c5d8aa tempest-VolumesListAdminTestJSON-24999556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35222af9-0fbb-436e-88c9-6efeac7c76a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:35:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e20d2192-7574-45ff-88f1-82aec3c5d8aa tempest-VolumesListAdminTestJSON-24999556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35222af9-0fbb-436e-88c9-6efeac7c76a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:35:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1502787428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=164f1534-662a-4f53-9080-7e38dbd4ad16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8027589a60a4948818b7a4cc2ec0baa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:35:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:35:27Z,use_quota=True,user_id='903b024e71874eb39fe2f1c541799bb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:35:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e20d2192-7574-45ff-88f1-82aec3c5d8aa tempest-VolumesListAdminTestJSON-24999556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fabdc73e-9093-4254-a765-7f0312b2b7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:35:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e20d2192-7574-45ff-88f1-82aec3c5d8aa tempest-VolumesListAdminTestJSON-24999556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fabdc73e-9093-4254-a765-7f0312b2b7f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:35:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e20d2192-7574-45ff-88f1-82aec3c5d8aa tempest-VolumesListAdminTestJSON-24999556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b59cbc44-8cea-4301-b025-430b2985120e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:35:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e20d2192-7574-45ff-88f1-82aec3c5d8aa tempest-VolumesListAdminTestJSON-24999556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b59cbc44-8cea-4301-b025-430b2985120e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '164f1534-662a-4f53-9080-7e38dbd4ad16', 'volume_name': 'volume-164f1534-662a-4f53-9080-7e38dbd4ad16', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:35:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e20d2192-7574-45ff-88f1-82aec3c5d8aa tempest-VolumesListAdminTestJSON-24999556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52a36f3d-d93d-4f3e-a464-73074f5d8d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:35:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e20d2192-7574-45ff-88f1-82aec3c5d8aa tempest-VolumesListAdminTestJSON-24999556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52a36f3d-d93d-4f3e-a464-73074f5d8d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:35:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e20d2192-7574-45ff-88f1-82aec3c5d8aa tempest-VolumesListAdminTestJSON-24999556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85e34b2c-d42c-42bf-a7f0-6757374936ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:35:27 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-e20d2192-7574-45ff-88f1-82aec3c5d8aa tempest-VolumesListAdminTestJSON-24999556 None] Volume 164f1534-662a-4f53-9080-7e38dbd4ad16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-164f1534-662a-4f53-9080-7e38dbd4ad16', 'volume_size': 1} Aug 28 09:35:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e20d2192-7574-45ff-88f1-82aec3c5d8aa tempest-VolumesListAdminTestJSON-24999556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:35:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e20d2192-7574-45ff-88f1-82aec3c5d8aa tempest-VolumesListAdminTestJSON-24999556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:35:27 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e20d2192-7574-45ff-88f1-82aec3c5d8aa tempest-VolumesListAdminTestJSON-24999556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:35:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1502787428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=164f1534-662a-4f53-9080-7e38dbd4ad16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8027589a60a4948818b7a4cc2ec0baa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:35:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:35:27Z,use_quota=True,user_id='903b024e71874eb39fe2f1c541799bb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:35:27 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-e20d2192-7574-45ff-88f1-82aec3c5d8aa tempest-VolumesListAdminTestJSON-24999556 None] Creating volume 164f1534-662a-4f53-9080-7e38dbd4ad16 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:35:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e20d2192-7574-45ff-88f1-82aec3c5d8aa tempest-VolumesListAdminTestJSON-24999556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:35:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e20d2192-7574-45ff-88f1-82aec3c5d8aa tempest-VolumesListAdminTestJSON-24999556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:35:27 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e20d2192-7574-45ff-88f1-82aec3c5d8aa tempest-VolumesListAdminTestJSON-24999556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:35:27 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e20d2192-7574-45ff-88f1-82aec3c5d8aa tempest-VolumesListAdminTestJSON-24999556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:35:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e20d2192-7574-45ff-88f1-82aec3c5d8aa tempest-VolumesListAdminTestJSON-24999556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:35:27 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e20d2192-7574-45ff-88f1-82aec3c5d8aa tempest-VolumesListAdminTestJSON-24999556 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:35:27 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-e20d2192-7574-45ff-88f1-82aec3c5d8aa tempest-VolumesListAdminTestJSON-24999556 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:35:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e20d2192-7574-45ff-88f1-82aec3c5d8aa tempest-VolumesListAdminTestJSON-24999556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-164f1534-662a-4f53-9080-7e38dbd4ad16 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:35:27 devstack sudo[91778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-164f1534-662a-4f53-9080-7e38dbd4ad16 1073741824 Aug 28 09:35:27 devstack sudo[91778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:35:28 devstack sudo[91778]: pam_unix(sudo:session): session closed for user root Aug 28 09:35:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e20d2192-7574-45ff-88f1-82aec3c5d8aa tempest-VolumesListAdminTestJSON-24999556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-164f1534-662a-4f53-9080-7e38dbd4ad16 1073741824" returned: 0 in 0.972s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:35:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e20d2192-7574-45ff-88f1-82aec3c5d8aa tempest-VolumesListAdminTestJSON-24999556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-164f1534-662a-4f53-9080-7e38dbd4ad16 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:35:28 devstack sudo[91836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-164f1534-662a-4f53-9080-7e38dbd4ad16 Aug 28 09:35:28 devstack sudo[91836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:35:28 devstack sudo[91836]: pam_unix(sudo:session): session closed for user root Aug 28 09:35:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e20d2192-7574-45ff-88f1-82aec3c5d8aa tempest-VolumesListAdminTestJSON-24999556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-164f1534-662a-4f53-9080-7e38dbd4ad16" returned: 0 in 0.394s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:35:28 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e20d2192-7574-45ff-88f1-82aec3c5d8aa tempest-VolumesListAdminTestJSON-24999556 None] <== create_volume: return (1432ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:35:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e20d2192-7574-45ff-88f1-82aec3c5d8aa tempest-VolumesListAdminTestJSON-24999556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.437s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:35:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e20d2192-7574-45ff-88f1-82aec3c5d8aa tempest-VolumesListAdminTestJSON-24999556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85e34b2c-d42c-42bf-a7f0-6757374936ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-164f1534-662a-4f53-9080-7e38dbd4ad16', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:35:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e20d2192-7574-45ff-88f1-82aec3c5d8aa tempest-VolumesListAdminTestJSON-24999556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcd30b7a-14bf-4025-9e59-e7241bd51af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:35:28 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-e20d2192-7574-45ff-88f1-82aec3c5d8aa tempest-VolumesListAdminTestJSON-24999556 None] Volume volume-164f1534-662a-4f53-9080-7e38dbd4ad16 (164f1534-662a-4f53-9080-7e38dbd4ad16): created successfully Aug 28 09:35:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e20d2192-7574-45ff-88f1-82aec3c5d8aa tempest-VolumesListAdminTestJSON-24999556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcd30b7a-14bf-4025-9e59-e7241bd51af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:35:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e20d2192-7574-45ff-88f1-82aec3c5d8aa tempest-VolumesListAdminTestJSON-24999556 None] Flow 'volume_create_manager' (f6622432-7fb8-4eb9-a7be-214ebc1fa0d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:35:28 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-e20d2192-7574-45ff-88f1-82aec3c5d8aa tempest-VolumesListAdminTestJSON-24999556 None] Created volume successfully. Aug 28 09:35:30 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-30a711d0-1f9d-4823-9825-e0deb0c7c81e tempest-VolumesListAdminTestJSON-24999556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:35:30 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-30a711d0-1f9d-4823-9825-e0deb0c7c81e tempest-VolumesListAdminTestJSON-24999556 None] Flow 'volume_create_manager' (ca83fec3-62cc-4ccd-bd63-8163412b62de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:35:30 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-30a711d0-1f9d-4823-9825-e0deb0c7c81e tempest-VolumesListAdminTestJSON-24999556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79bae301-8140-4934-b661-bc7525f0ce9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:35:30 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-30a711d0-1f9d-4823-9825-e0deb0c7c81e tempest-VolumesListAdminTestJSON-24999556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79bae301-8140-4934-b661-bc7525f0ce9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:35:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2087551125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be5f8d05-deff-4a23-9a78-7473f9239671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8027589a60a4948818b7a4cc2ec0baa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:35:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:35:30Z,use_quota=True,user_id='903b024e71874eb39fe2f1c541799bb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:35:30 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-30a711d0-1f9d-4823-9825-e0deb0c7c81e tempest-VolumesListAdminTestJSON-24999556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93475546-6c39-4751-a474-6d821f403c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:35:30 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-30a711d0-1f9d-4823-9825-e0deb0c7c81e tempest-VolumesListAdminTestJSON-24999556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93475546-6c39-4751-a474-6d821f403c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:35:30 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-30a711d0-1f9d-4823-9825-e0deb0c7c81e tempest-VolumesListAdminTestJSON-24999556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b28b2d24-7db4-4fe6-8a62-ccdd491e31b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:35:30 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-30a711d0-1f9d-4823-9825-e0deb0c7c81e tempest-VolumesListAdminTestJSON-24999556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b28b2d24-7db4-4fe6-8a62-ccdd491e31b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be5f8d05-deff-4a23-9a78-7473f9239671', 'volume_name': 'volume-be5f8d05-deff-4a23-9a78-7473f9239671', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:35:30 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-30a711d0-1f9d-4823-9825-e0deb0c7c81e tempest-VolumesListAdminTestJSON-24999556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64289ce3-3369-47fe-b423-ab89775837bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:35:30 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-30a711d0-1f9d-4823-9825-e0deb0c7c81e tempest-VolumesListAdminTestJSON-24999556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64289ce3-3369-47fe-b423-ab89775837bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:35:30 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-30a711d0-1f9d-4823-9825-e0deb0c7c81e tempest-VolumesListAdminTestJSON-24999556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e9a6f53-4faf-4e84-87c9-34a7033b6cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:35:30 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-30a711d0-1f9d-4823-9825-e0deb0c7c81e tempest-VolumesListAdminTestJSON-24999556 None] Volume be5f8d05-deff-4a23-9a78-7473f9239671: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be5f8d05-deff-4a23-9a78-7473f9239671', 'volume_size': 1} Aug 28 09:35:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-30a711d0-1f9d-4823-9825-e0deb0c7c81e tempest-VolumesListAdminTestJSON-24999556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:35:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-30a711d0-1f9d-4823-9825-e0deb0c7c81e tempest-VolumesListAdminTestJSON-24999556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:35:30 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-30a711d0-1f9d-4823-9825-e0deb0c7c81e tempest-VolumesListAdminTestJSON-24999556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:35:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2087551125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be5f8d05-deff-4a23-9a78-7473f9239671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8027589a60a4948818b7a4cc2ec0baa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:35:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:35:30Z,use_quota=True,user_id='903b024e71874eb39fe2f1c541799bb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:35:30 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-30a711d0-1f9d-4823-9825-e0deb0c7c81e tempest-VolumesListAdminTestJSON-24999556 None] Creating volume be5f8d05-deff-4a23-9a78-7473f9239671 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:35:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-30a711d0-1f9d-4823-9825-e0deb0c7c81e tempest-VolumesListAdminTestJSON-24999556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:35:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-30a711d0-1f9d-4823-9825-e0deb0c7c81e tempest-VolumesListAdminTestJSON-24999556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:35:30 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-30a711d0-1f9d-4823-9825-e0deb0c7c81e tempest-VolumesListAdminTestJSON-24999556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:35:30 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-30a711d0-1f9d-4823-9825-e0deb0c7c81e tempest-VolumesListAdminTestJSON-24999556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:35:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-30a711d0-1f9d-4823-9825-e0deb0c7c81e tempest-VolumesListAdminTestJSON-24999556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:35:30 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-30a711d0-1f9d-4823-9825-e0deb0c7c81e tempest-VolumesListAdminTestJSON-24999556 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:35:30 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-30a711d0-1f9d-4823-9825-e0deb0c7c81e tempest-VolumesListAdminTestJSON-24999556 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:35:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-30a711d0-1f9d-4823-9825-e0deb0c7c81e tempest-VolumesListAdminTestJSON-24999556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-be5f8d05-deff-4a23-9a78-7473f9239671 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:35:30 devstack sudo[91890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-be5f8d05-deff-4a23-9a78-7473f9239671 1073741824 Aug 28 09:35:30 devstack sudo[91890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:35:31 devstack sudo[91890]: pam_unix(sudo:session): session closed for user root Aug 28 09:35:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-30a711d0-1f9d-4823-9825-e0deb0c7c81e tempest-VolumesListAdminTestJSON-24999556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-be5f8d05-deff-4a23-9a78-7473f9239671 1073741824" returned: 0 in 0.732s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:35:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-30a711d0-1f9d-4823-9825-e0deb0c7c81e tempest-VolumesListAdminTestJSON-24999556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-be5f8d05-deff-4a23-9a78-7473f9239671 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:35:31 devstack sudo[91896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-be5f8d05-deff-4a23-9a78-7473f9239671 Aug 28 09:35:31 devstack sudo[91896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:35:31 devstack sudo[91896]: pam_unix(sudo:session): session closed for user root Aug 28 09:35:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-30a711d0-1f9d-4823-9825-e0deb0c7c81e tempest-VolumesListAdminTestJSON-24999556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-be5f8d05-deff-4a23-9a78-7473f9239671" returned: 0 in 0.273s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:35:31 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-30a711d0-1f9d-4823-9825-e0deb0c7c81e tempest-VolumesListAdminTestJSON-24999556 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:35:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-30a711d0-1f9d-4823-9825-e0deb0c7c81e tempest-VolumesListAdminTestJSON-24999556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:35:31 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-30a711d0-1f9d-4823-9825-e0deb0c7c81e tempest-VolumesListAdminTestJSON-24999556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e9a6f53-4faf-4e84-87c9-34a7033b6cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be5f8d05-deff-4a23-9a78-7473f9239671', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:35:31 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-30a711d0-1f9d-4823-9825-e0deb0c7c81e tempest-VolumesListAdminTestJSON-24999556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1b461e8-a41e-4f35-a2fa-5de339c33e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:35:31 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-30a711d0-1f9d-4823-9825-e0deb0c7c81e tempest-VolumesListAdminTestJSON-24999556 None] Volume volume-be5f8d05-deff-4a23-9a78-7473f9239671 (be5f8d05-deff-4a23-9a78-7473f9239671): created successfully Aug 28 09:35:31 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-30a711d0-1f9d-4823-9825-e0deb0c7c81e tempest-VolumesListAdminTestJSON-24999556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1b461e8-a41e-4f35-a2fa-5de339c33e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:35:31 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-30a711d0-1f9d-4823-9825-e0deb0c7c81e tempest-VolumesListAdminTestJSON-24999556 None] Flow 'volume_create_manager' (ca83fec3-62cc-4ccd-bd63-8163412b62de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:35:31 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-30a711d0-1f9d-4823-9825-e0deb0c7c81e tempest-VolumesListAdminTestJSON-24999556 None] Created volume successfully. Aug 28 09:35:33 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d22434d-afe2-4dde-9d3e-b6a8ba19bce2 tempest-VolumesListAdminTestJSON-308425542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:35:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-9d22434d-afe2-4dde-9d3e-b6a8ba19bce2 tempest-VolumesListAdminTestJSON-308425542 None] Flow 'volume_create_manager' (e0d01afb-6a36-4a42-9cae-00f576920b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:35:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-9d22434d-afe2-4dde-9d3e-b6a8ba19bce2 tempest-VolumesListAdminTestJSON-308425542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c8809d8-6373-4ae8-915f-a8e034aa49d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:35:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-9d22434d-afe2-4dde-9d3e-b6a8ba19bce2 tempest-VolumesListAdminTestJSON-308425542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c8809d8-6373-4ae8-915f-a8e034aa49d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:35:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0252afb0-51da-4623-8af2-f97a67d23f29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4131153ac3448a99fc332ee4b5ac31f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:35:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:35:33Z,use_quota=True,user_id='ddb1856eb89f4bddb1315437bbc80ad1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:35:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-9d22434d-afe2-4dde-9d3e-b6a8ba19bce2 tempest-VolumesListAdminTestJSON-308425542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dbe1ab7-a145-43e7-ad09-68bfb88212bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:35:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-9d22434d-afe2-4dde-9d3e-b6a8ba19bce2 tempest-VolumesListAdminTestJSON-308425542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dbe1ab7-a145-43e7-ad09-68bfb88212bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:35:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-9d22434d-afe2-4dde-9d3e-b6a8ba19bce2 tempest-VolumesListAdminTestJSON-308425542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e36cddbf-d0f9-4f3c-9b85-6ac137ec3ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:35:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-9d22434d-afe2-4dde-9d3e-b6a8ba19bce2 tempest-VolumesListAdminTestJSON-308425542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e36cddbf-d0f9-4f3c-9b85-6ac137ec3ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0252afb0-51da-4623-8af2-f97a67d23f29', 'volume_name': 'volume-0252afb0-51da-4623-8af2-f97a67d23f29', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:35:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-9d22434d-afe2-4dde-9d3e-b6a8ba19bce2 tempest-VolumesListAdminTestJSON-308425542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d107b640-a6f1-4c55-ad7a-ce665107be7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:35:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-9d22434d-afe2-4dde-9d3e-b6a8ba19bce2 tempest-VolumesListAdminTestJSON-308425542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d107b640-a6f1-4c55-ad7a-ce665107be7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:35:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-9d22434d-afe2-4dde-9d3e-b6a8ba19bce2 tempest-VolumesListAdminTestJSON-308425542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3d0ec20-8dd2-408f-b433-ae44c6c5e9d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:35:33 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-9d22434d-afe2-4dde-9d3e-b6a8ba19bce2 tempest-VolumesListAdminTestJSON-308425542 None] Volume 0252afb0-51da-4623-8af2-f97a67d23f29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0252afb0-51da-4623-8af2-f97a67d23f29', 'volume_size': 1} Aug 28 09:35:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-9d22434d-afe2-4dde-9d3e-b6a8ba19bce2 tempest-VolumesListAdminTestJSON-308425542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:35:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-9d22434d-afe2-4dde-9d3e-b6a8ba19bce2 tempest-VolumesListAdminTestJSON-308425542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:35:33 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-9d22434d-afe2-4dde-9d3e-b6a8ba19bce2 tempest-VolumesListAdminTestJSON-308425542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:35:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0252afb0-51da-4623-8af2-f97a67d23f29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4131153ac3448a99fc332ee4b5ac31f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:35:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:35:33Z,use_quota=True,user_id='ddb1856eb89f4bddb1315437bbc80ad1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:35:33 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-9d22434d-afe2-4dde-9d3e-b6a8ba19bce2 tempest-VolumesListAdminTestJSON-308425542 None] Creating volume 0252afb0-51da-4623-8af2-f97a67d23f29 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:35:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-9d22434d-afe2-4dde-9d3e-b6a8ba19bce2 tempest-VolumesListAdminTestJSON-308425542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:35:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-9d22434d-afe2-4dde-9d3e-b6a8ba19bce2 tempest-VolumesListAdminTestJSON-308425542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:35:33 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-9d22434d-afe2-4dde-9d3e-b6a8ba19bce2 tempest-VolumesListAdminTestJSON-308425542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:35:33 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-9d22434d-afe2-4dde-9d3e-b6a8ba19bce2 tempest-VolumesListAdminTestJSON-308425542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:35:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-9d22434d-afe2-4dde-9d3e-b6a8ba19bce2 tempest-VolumesListAdminTestJSON-308425542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:35:33 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-9d22434d-afe2-4dde-9d3e-b6a8ba19bce2 tempest-VolumesListAdminTestJSON-308425542 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:35:33 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-9d22434d-afe2-4dde-9d3e-b6a8ba19bce2 tempest-VolumesListAdminTestJSON-308425542 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:35:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9d22434d-afe2-4dde-9d3e-b6a8ba19bce2 tempest-VolumesListAdminTestJSON-308425542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-0252afb0-51da-4623-8af2-f97a67d23f29 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:35:33 devstack sudo[91902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-0252afb0-51da-4623-8af2-f97a67d23f29 1073741824 Aug 28 09:35:33 devstack sudo[91902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:35:34 devstack sudo[91902]: pam_unix(sudo:session): session closed for user root Aug 28 09:35:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9d22434d-afe2-4dde-9d3e-b6a8ba19bce2 tempest-VolumesListAdminTestJSON-308425542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-0252afb0-51da-4623-8af2-f97a67d23f29 1073741824" returned: 0 in 0.602s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:35:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9d22434d-afe2-4dde-9d3e-b6a8ba19bce2 tempest-VolumesListAdminTestJSON-308425542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-0252afb0-51da-4623-8af2-f97a67d23f29 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:35:34 devstack sudo[91909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-0252afb0-51da-4623-8af2-f97a67d23f29 Aug 28 09:35:34 devstack sudo[91909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:35:34 devstack sudo[91909]: pam_unix(sudo:session): session closed for user root Aug 28 09:35:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9d22434d-afe2-4dde-9d3e-b6a8ba19bce2 tempest-VolumesListAdminTestJSON-308425542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-0252afb0-51da-4623-8af2-f97a67d23f29" returned: 0 in 0.340s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:35:34 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-9d22434d-afe2-4dde-9d3e-b6a8ba19bce2 tempest-VolumesListAdminTestJSON-308425542 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:35:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-9d22434d-afe2-4dde-9d3e-b6a8ba19bce2 tempest-VolumesListAdminTestJSON-308425542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:35:34 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-9d22434d-afe2-4dde-9d3e-b6a8ba19bce2 tempest-VolumesListAdminTestJSON-308425542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3d0ec20-8dd2-408f-b433-ae44c6c5e9d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0252afb0-51da-4623-8af2-f97a67d23f29', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:35:34 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-9d22434d-afe2-4dde-9d3e-b6a8ba19bce2 tempest-VolumesListAdminTestJSON-308425542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebd75182-54d0-4fd2-891c-6506cb3ca0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:35:34 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-9d22434d-afe2-4dde-9d3e-b6a8ba19bce2 tempest-VolumesListAdminTestJSON-308425542 None] Volume volume-0252afb0-51da-4623-8af2-f97a67d23f29 (0252afb0-51da-4623-8af2-f97a67d23f29): created successfully Aug 28 09:35:34 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-9d22434d-afe2-4dde-9d3e-b6a8ba19bce2 tempest-VolumesListAdminTestJSON-308425542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebd75182-54d0-4fd2-891c-6506cb3ca0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:35:34 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-9d22434d-afe2-4dde-9d3e-b6a8ba19bce2 tempest-VolumesListAdminTestJSON-308425542 None] Flow 'volume_create_manager' (e0d01afb-6a36-4a42-9cae-00f576920b57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:35:34 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-9d22434d-afe2-4dde-9d3e-b6a8ba19bce2 tempest-VolumesListAdminTestJSON-308425542 None] Created volume successfully. Aug 28 09:35:35 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c77ecb2d-dd2a-41f8-85c5-85ad267ecd65 tempest-VolumesListAdminTestJSON-308425542 None] Acquiring lock "cinder-0252afb0-51da-4623-8af2-f97a67d23f29-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:35:35 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c77ecb2d-dd2a-41f8-85c5-85ad267ecd65 tempest-VolumesListAdminTestJSON-308425542 None] Lock "cinder-0252afb0-51da-4623-8af2-f97a67d23f29-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:35:36 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c77ecb2d-dd2a-41f8-85c5-85ad267ecd65 tempest-VolumesListAdminTestJSON-308425542 None] Acquiring lock "cinder-quobyte-0252afb0-51da-4623-8af2-f97a67d23f29" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:35:36 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c77ecb2d-dd2a-41f8-85c5-85ad267ecd65 tempest-VolumesListAdminTestJSON-308425542 None] Lock "cinder-quobyte-0252afb0-51da-4623-8af2-f97a67d23f29" acquired by "delete_volume" :: waited 0.026s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:35:36 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04805df-5dd2-4c57-9979-61d9cb8d2160]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:35:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c77ecb2d-dd2a-41f8-85c5-85ad267ecd65 tempest-VolumesListAdminTestJSON-308425542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-0252afb0-51da-4623-8af2-f97a67d23f29 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:35:36 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-5d622e8c-9903-4c10-8607-825177d13a60 tempest-VolumesListAdminTestJSON-24999556 None] Acquiring lock "cinder-be5f8d05-deff-4a23-9a78-7473f9239671-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:35:36 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-5d622e8c-9903-4c10-8607-825177d13a60 tempest-VolumesListAdminTestJSON-24999556 None] Lock "cinder-be5f8d05-deff-4a23-9a78-7473f9239671-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:35:36 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-5d622e8c-9903-4c10-8607-825177d13a60 tempest-VolumesListAdminTestJSON-24999556 None] Acquiring lock "cinder-quobyte-be5f8d05-deff-4a23-9a78-7473f9239671" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:35:36 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-5d622e8c-9903-4c10-8607-825177d13a60 tempest-VolumesListAdminTestJSON-24999556 None] Lock "cinder-quobyte-be5f8d05-deff-4a23-9a78-7473f9239671" acquired by "delete_volume" :: waited 0.032s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:35:36 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e416c6-8af9-4654-a1e8-81b464fc3cd2]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:35:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5d622e8c-9903-4c10-8607-825177d13a60 tempest-VolumesListAdminTestJSON-24999556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-be5f8d05-deff-4a23-9a78-7473f9239671 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:35:36 devstack sudo[91912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-0252afb0-51da-4623-8af2-f97a67d23f29 Aug 28 09:35:36 devstack sudo[91912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:35:36 devstack sudo[91913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-be5f8d05-deff-4a23-9a78-7473f9239671 Aug 28 09:35:36 devstack sudo[91913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:35:36 devstack sudo[91912]: pam_unix(sudo:session): session closed for user root Aug 28 09:35:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c77ecb2d-dd2a-41f8-85c5-85ad267ecd65 tempest-VolumesListAdminTestJSON-308425542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-0252afb0-51da-4623-8af2-f97a67d23f29" returned: 0 in 0.762s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:35:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c77ecb2d-dd2a-41f8-85c5-85ad267ecd65 tempest-VolumesListAdminTestJSON-308425542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-0252afb0-51da-4623-8af2-f97a67d23f29 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:35:36 devstack sudo[91921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-0252afb0-51da-4623-8af2-f97a67d23f29 Aug 28 09:35:36 devstack sudo[91921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:35:37 devstack sudo[91913]: pam_unix(sudo:session): session closed for user root Aug 28 09:35:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5d622e8c-9903-4c10-8607-825177d13a60 tempest-VolumesListAdminTestJSON-24999556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-be5f8d05-deff-4a23-9a78-7473f9239671" returned: 0 in 0.604s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:35:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5d622e8c-9903-4c10-8607-825177d13a60 tempest-VolumesListAdminTestJSON-24999556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-be5f8d05-deff-4a23-9a78-7473f9239671 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:35:37 devstack sudo[91924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-be5f8d05-deff-4a23-9a78-7473f9239671 Aug 28 09:35:37 devstack sudo[91924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:35:37 devstack sudo[91921]: pam_unix(sudo:session): session closed for user root Aug 28 09:35:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c77ecb2d-dd2a-41f8-85c5-85ad267ecd65 tempest-VolumesListAdminTestJSON-308425542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-0252afb0-51da-4623-8af2-f97a67d23f29" returned: 0 in 0.376s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:35:37 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c77ecb2d-dd2a-41f8-85c5-85ad267ecd65 tempest-VolumesListAdminTestJSON-308425542 None] Lock "cinder-quobyte-0252afb0-51da-4623-8af2-f97a67d23f29" released by "delete_volume" :: held 1.230s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:35:37 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-c77ecb2d-dd2a-41f8-85c5-85ad267ecd65 tempest-VolumesListAdminTestJSON-308425542 None] Created reservations ['ef5bacc4-f9d7-4365-ae4a-b6c07363d638', '25558443-3078-4c60-b740-9755cba66c5e', '61b836d7-f820-47c5-9207-a5c495b91989', 'c9cf8b91-8f67-4d87-bbc5-bcf50e0987ca'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:35:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-c77ecb2d-dd2a-41f8-85c5-85ad267ecd65 tempest-VolumesListAdminTestJSON-308425542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:35:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-c77ecb2d-dd2a-41f8-85c5-85ad267ecd65 tempest-VolumesListAdminTestJSON-308425542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:35:37 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-c77ecb2d-dd2a-41f8-85c5-85ad267ecd65 tempest-VolumesListAdminTestJSON-308425542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:35:37 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-c77ecb2d-dd2a-41f8-85c5-85ad267ecd65 tempest-VolumesListAdminTestJSON-308425542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:35:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-c77ecb2d-dd2a-41f8-85c5-85ad267ecd65 tempest-VolumesListAdminTestJSON-308425542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:35:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c77ecb2d-dd2a-41f8-85c5-85ad267ecd65 tempest-VolumesListAdminTestJSON-308425542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:35:37 devstack sudo[91924]: pam_unix(sudo:session): session closed for user root Aug 28 09:35:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5d622e8c-9903-4c10-8607-825177d13a60 tempest-VolumesListAdminTestJSON-24999556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-be5f8d05-deff-4a23-9a78-7473f9239671" returned: 0 in 0.471s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:35:37 devstack sudo[91928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:35:37 devstack sudo[91928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:35:37 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-5d622e8c-9903-4c10-8607-825177d13a60 tempest-VolumesListAdminTestJSON-24999556 None] Lock "cinder-quobyte-be5f8d05-deff-4a23-9a78-7473f9239671" released by "delete_volume" :: held 1.181s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:35:37 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-5d622e8c-9903-4c10-8607-825177d13a60 tempest-VolumesListAdminTestJSON-24999556 None] Created reservations ['7c5fd5f6-31aa-4559-a609-10565c067f27', '8b332da1-fddd-4220-8d65-a6f91870a092', '0a67f6ab-d049-4813-9e8b-4cf300b4de66', '047e327e-b3d5-4787-b7aa-e824a14163a5'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:35:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-5d622e8c-9903-4c10-8607-825177d13a60 tempest-VolumesListAdminTestJSON-24999556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:35:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-5d622e8c-9903-4c10-8607-825177d13a60 tempest-VolumesListAdminTestJSON-24999556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:35:37 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-5d622e8c-9903-4c10-8607-825177d13a60 tempest-VolumesListAdminTestJSON-24999556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:35:37 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-5d622e8c-9903-4c10-8607-825177d13a60 tempest-VolumesListAdminTestJSON-24999556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:35:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-5d622e8c-9903-4c10-8607-825177d13a60 tempest-VolumesListAdminTestJSON-24999556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:35:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5d622e8c-9903-4c10-8607-825177d13a60 tempest-VolumesListAdminTestJSON-24999556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:35:37 devstack sudo[91930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:35:37 devstack sudo[91930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:35:37 devstack sudo[91928]: pam_unix(sudo:session): session closed for user root Aug 28 09:35:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c77ecb2d-dd2a-41f8-85c5-85ad267ecd65 tempest-VolumesListAdminTestJSON-308425542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.410s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:35:37 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-c77ecb2d-dd2a-41f8-85c5-85ad267ecd65 tempest-VolumesListAdminTestJSON-308425542 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:35:37 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-c77ecb2d-dd2a-41f8-85c5-85ad267ecd65 tempest-VolumesListAdminTestJSON-308425542 None] Deleted volume successfully. Aug 28 09:35:37 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c77ecb2d-dd2a-41f8-85c5-85ad267ecd65 tempest-VolumesListAdminTestJSON-308425542 None] Lock "cinder-0252afb0-51da-4623-8af2-f97a67d23f29-delete_volume" released by "delete_volume" :: held 2.044s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:35:38 devstack cinder-volume[86081]: DEBUG oslo_service.periodic_task [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86081) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:35:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:35:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:35:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:35:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:35:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:35:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:35:38 devstack sudo[91933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:35:38 devstack sudo[91933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:35:38 devstack sudo[91930]: pam_unix(sudo:session): session closed for user root Aug 28 09:35:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5d622e8c-9903-4c10-8607-825177d13a60 tempest-VolumesListAdminTestJSON-24999556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.482s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:35:38 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-5d622e8c-9903-4c10-8607-825177d13a60 tempest-VolumesListAdminTestJSON-24999556 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:35:38 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-5d622e8c-9903-4c10-8607-825177d13a60 tempest-VolumesListAdminTestJSON-24999556 None] Deleted volume successfully. Aug 28 09:35:38 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-5d622e8c-9903-4c10-8607-825177d13a60 tempest-VolumesListAdminTestJSON-24999556 None] Lock "cinder-be5f8d05-deff-4a23-9a78-7473f9239671-delete_volume" released by "delete_volume" :: held 2.053s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:35:38 devstack sudo[91933]: pam_unix(sudo:session): session closed for user root Aug 28 09:35:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.307s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:35:38 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:35:38 devstack cinder-volume[86081]: DEBUG oslo_service.periodic_task [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running periodic task VolumeManager._thread_info {{(pid=86081) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:35:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] thread count: 28 {{(pid=86081) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 09:35:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] thread info: [<_MainThread(MainThread, started 129914189705344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86081) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 09:35:38 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-77efebd6-2077-4fd0-9e73-eab5745b5608 tempest-VolumesListAdminTestJSON-24999556 None] Acquiring lock "cinder-164f1534-662a-4f53-9080-7e38dbd4ad16-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:35:38 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-77efebd6-2077-4fd0-9e73-eab5745b5608 tempest-VolumesListAdminTestJSON-24999556 None] Lock "cinder-164f1534-662a-4f53-9080-7e38dbd4ad16-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:35:38 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-77efebd6-2077-4fd0-9e73-eab5745b5608 tempest-VolumesListAdminTestJSON-24999556 None] Acquiring lock "cinder-quobyte-164f1534-662a-4f53-9080-7e38dbd4ad16" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:35:38 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-77efebd6-2077-4fd0-9e73-eab5745b5608 tempest-VolumesListAdminTestJSON-24999556 None] Lock "cinder-quobyte-164f1534-662a-4f53-9080-7e38dbd4ad16" acquired by "delete_volume" :: waited 0.022s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:35:38 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0fb278-a23f-4b34-b1f9-4c5b7a15a707]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:35:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-77efebd6-2077-4fd0-9e73-eab5745b5608 tempest-VolumesListAdminTestJSON-24999556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-164f1534-662a-4f53-9080-7e38dbd4ad16 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:35:38 devstack sudo[91938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-164f1534-662a-4f53-9080-7e38dbd4ad16 Aug 28 09:35:38 devstack sudo[91938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:35:39 devstack sudo[91938]: pam_unix(sudo:session): session closed for user root Aug 28 09:35:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-77efebd6-2077-4fd0-9e73-eab5745b5608 tempest-VolumesListAdminTestJSON-24999556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-164f1534-662a-4f53-9080-7e38dbd4ad16" returned: 0 in 0.465s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:35:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-77efebd6-2077-4fd0-9e73-eab5745b5608 tempest-VolumesListAdminTestJSON-24999556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-164f1534-662a-4f53-9080-7e38dbd4ad16 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:35:39 devstack sudo[91943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-164f1534-662a-4f53-9080-7e38dbd4ad16 Aug 28 09:35:39 devstack sudo[91943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:35:39 devstack sudo[91943]: pam_unix(sudo:session): session closed for user root Aug 28 09:35:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-77efebd6-2077-4fd0-9e73-eab5745b5608 tempest-VolumesListAdminTestJSON-24999556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-164f1534-662a-4f53-9080-7e38dbd4ad16" returned: 0 in 0.267s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:35:39 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-77efebd6-2077-4fd0-9e73-eab5745b5608 tempest-VolumesListAdminTestJSON-24999556 None] Lock "cinder-quobyte-164f1534-662a-4f53-9080-7e38dbd4ad16" released by "delete_volume" :: held 0.783s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:35:39 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-77efebd6-2077-4fd0-9e73-eab5745b5608 tempest-VolumesListAdminTestJSON-24999556 None] Created reservations ['d28ed5ec-c7b2-41c1-b29d-15fa7e7e4b15', '61df8c10-589f-4a6c-9830-4b90b46edf9c', '1fe14061-9a1c-460c-8fee-bb5345735fc1', '8ab94fd1-4474-4a05-a07a-4cb5fa793b1d'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:35:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-77efebd6-2077-4fd0-9e73-eab5745b5608 tempest-VolumesListAdminTestJSON-24999556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:35:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-77efebd6-2077-4fd0-9e73-eab5745b5608 tempest-VolumesListAdminTestJSON-24999556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:35:39 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-77efebd6-2077-4fd0-9e73-eab5745b5608 tempest-VolumesListAdminTestJSON-24999556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:35:39 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-77efebd6-2077-4fd0-9e73-eab5745b5608 tempest-VolumesListAdminTestJSON-24999556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:35:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-77efebd6-2077-4fd0-9e73-eab5745b5608 tempest-VolumesListAdminTestJSON-24999556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:35:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-77efebd6-2077-4fd0-9e73-eab5745b5608 tempest-VolumesListAdminTestJSON-24999556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:35:39 devstack sudo[91946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:35:39 devstack sudo[91946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:35:39 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-386830ef-8400-41e6-adc9-208b2b22998a tempest-VolumesListAdminTestJSON-24999556 None] Acquiring lock "cinder-2b4e6ef5-2efc-480d-85b0-d01cb504f563-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:35:40 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-386830ef-8400-41e6-adc9-208b2b22998a tempest-VolumesListAdminTestJSON-24999556 None] Lock "cinder-2b4e6ef5-2efc-480d-85b0-d01cb504f563-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:35:40 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-386830ef-8400-41e6-adc9-208b2b22998a tempest-VolumesListAdminTestJSON-24999556 None] Acquiring lock "cinder-quobyte-2b4e6ef5-2efc-480d-85b0-d01cb504f563" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:35:40 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-386830ef-8400-41e6-adc9-208b2b22998a tempest-VolumesListAdminTestJSON-24999556 None] Lock "cinder-quobyte-2b4e6ef5-2efc-480d-85b0-d01cb504f563" acquired by "delete_volume" :: waited 0.031s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:35:40 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7de1dd-7e97-488c-9fe1-850150279fec]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:35:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-386830ef-8400-41e6-adc9-208b2b22998a tempest-VolumesListAdminTestJSON-24999556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2b4e6ef5-2efc-480d-85b0-d01cb504f563 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:35:40 devstack sudo[91946]: pam_unix(sudo:session): session closed for user root Aug 28 09:35:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-77efebd6-2077-4fd0-9e73-eab5745b5608 tempest-VolumesListAdminTestJSON-24999556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.496s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:35:40 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-77efebd6-2077-4fd0-9e73-eab5745b5608 tempest-VolumesListAdminTestJSON-24999556 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:35:40 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-77efebd6-2077-4fd0-9e73-eab5745b5608 tempest-VolumesListAdminTestJSON-24999556 None] Deleted volume successfully. Aug 28 09:35:40 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-77efebd6-2077-4fd0-9e73-eab5745b5608 tempest-VolumesListAdminTestJSON-24999556 None] Lock "cinder-164f1534-662a-4f53-9080-7e38dbd4ad16-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:35:40 devstack sudo[91949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2b4e6ef5-2efc-480d-85b0-d01cb504f563 Aug 28 09:35:40 devstack sudo[91949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:35:40 devstack sudo[91949]: pam_unix(sudo:session): session closed for user root Aug 28 09:35:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-386830ef-8400-41e6-adc9-208b2b22998a tempest-VolumesListAdminTestJSON-24999556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2b4e6ef5-2efc-480d-85b0-d01cb504f563" returned: 0 in 0.557s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:35:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-386830ef-8400-41e6-adc9-208b2b22998a tempest-VolumesListAdminTestJSON-24999556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2b4e6ef5-2efc-480d-85b0-d01cb504f563 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:35:40 devstack sudo[91954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2b4e6ef5-2efc-480d-85b0-d01cb504f563 Aug 28 09:35:40 devstack sudo[91954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:35:41 devstack sudo[91954]: pam_unix(sudo:session): session closed for user root Aug 28 09:35:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-386830ef-8400-41e6-adc9-208b2b22998a tempest-VolumesListAdminTestJSON-24999556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2b4e6ef5-2efc-480d-85b0-d01cb504f563" returned: 0 in 0.274s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:35:41 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-386830ef-8400-41e6-adc9-208b2b22998a tempest-VolumesListAdminTestJSON-24999556 None] Lock "cinder-quobyte-2b4e6ef5-2efc-480d-85b0-d01cb504f563" released by "delete_volume" :: held 0.913s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:35:41 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-386830ef-8400-41e6-adc9-208b2b22998a tempest-VolumesListAdminTestJSON-24999556 None] Created reservations ['771ddf39-00dd-4e1f-9c32-1083cc20367d', '6d75d57e-ccbe-4635-858c-7af8b7c41f6d', 'dd32c0a7-0f5d-414a-bcee-98115de84ed3', '9feeaa12-6c07-4f63-983c-d14f26dd45cf'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:35:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-386830ef-8400-41e6-adc9-208b2b22998a tempest-VolumesListAdminTestJSON-24999556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:35:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-386830ef-8400-41e6-adc9-208b2b22998a tempest-VolumesListAdminTestJSON-24999556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:35:41 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-386830ef-8400-41e6-adc9-208b2b22998a tempest-VolumesListAdminTestJSON-24999556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:35:41 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-386830ef-8400-41e6-adc9-208b2b22998a tempest-VolumesListAdminTestJSON-24999556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:35:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-386830ef-8400-41e6-adc9-208b2b22998a tempest-VolumesListAdminTestJSON-24999556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:35:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-386830ef-8400-41e6-adc9-208b2b22998a tempest-VolumesListAdminTestJSON-24999556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:35:41 devstack sudo[91957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:35:41 devstack sudo[91957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:35:41 devstack sudo[91957]: pam_unix(sudo:session): session closed for user root Aug 28 09:35:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-386830ef-8400-41e6-adc9-208b2b22998a tempest-VolumesListAdminTestJSON-24999556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.328s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:35:41 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-386830ef-8400-41e6-adc9-208b2b22998a tempest-VolumesListAdminTestJSON-24999556 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:35:41 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-386830ef-8400-41e6-adc9-208b2b22998a tempest-VolumesListAdminTestJSON-24999556 None] Deleted volume successfully. Aug 28 09:35:41 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-386830ef-8400-41e6-adc9-208b2b22998a tempest-VolumesListAdminTestJSON-24999556 None] Lock "cinder-2b4e6ef5-2efc-480d-85b0-d01cb504f563-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:35:43 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1e3e380-2d6e-4993-ac8c-01923eba34e5 tempest-AttachVolumeTestJSON-601093567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:35:43 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e1e3e380-2d6e-4993-ac8c-01923eba34e5 tempest-AttachVolumeTestJSON-601093567 None] Flow 'volume_create_manager' (1cd9de27-4934-49ce-abdf-9f9dff216399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:35:43 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e1e3e380-2d6e-4993-ac8c-01923eba34e5 tempest-AttachVolumeTestJSON-601093567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc8932ba-53a1-4e62-a4f5-03a36b2fee2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:35:43 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e1e3e380-2d6e-4993-ac8c-01923eba34e5 tempest-AttachVolumeTestJSON-601093567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc8932ba-53a1-4e62-a4f5-03a36b2fee2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2081997705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6097feec-ae6a-48a3-b80a-623e358517b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f2c9303e4cb495cab8f1e097bf57338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:35:43Z,use_quota=True,user_id='1d3905384f6b452f8e13789416d869a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:35:43 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e1e3e380-2d6e-4993-ac8c-01923eba34e5 tempest-AttachVolumeTestJSON-601093567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a181dfb-acd0-44d3-920c-f66d93102066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:35:43 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e1e3e380-2d6e-4993-ac8c-01923eba34e5 tempest-AttachVolumeTestJSON-601093567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a181dfb-acd0-44d3-920c-f66d93102066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:35:43 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e1e3e380-2d6e-4993-ac8c-01923eba34e5 tempest-AttachVolumeTestJSON-601093567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c69a0c76-1165-4c17-b821-8957278b0b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:35:43 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e1e3e380-2d6e-4993-ac8c-01923eba34e5 tempest-AttachVolumeTestJSON-601093567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c69a0c76-1165-4c17-b821-8957278b0b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6097feec-ae6a-48a3-b80a-623e358517b8', 'volume_name': 'volume-6097feec-ae6a-48a3-b80a-623e358517b8', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:35:43 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e1e3e380-2d6e-4993-ac8c-01923eba34e5 tempest-AttachVolumeTestJSON-601093567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07231dc7-74cb-4a8f-8eb9-5da65fcdb2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:35:43 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e1e3e380-2d6e-4993-ac8c-01923eba34e5 tempest-AttachVolumeTestJSON-601093567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07231dc7-74cb-4a8f-8eb9-5da65fcdb2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:35:43 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e1e3e380-2d6e-4993-ac8c-01923eba34e5 tempest-AttachVolumeTestJSON-601093567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91899bc0-538e-41bf-b3b6-c8cd5aaea7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:35:43 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-e1e3e380-2d6e-4993-ac8c-01923eba34e5 tempest-AttachVolumeTestJSON-601093567 None] Volume 6097feec-ae6a-48a3-b80a-623e358517b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6097feec-ae6a-48a3-b80a-623e358517b8', 'volume_size': 1} Aug 28 09:35:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e1e3e380-2d6e-4993-ac8c-01923eba34e5 tempest-AttachVolumeTestJSON-601093567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:35:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e1e3e380-2d6e-4993-ac8c-01923eba34e5 tempest-AttachVolumeTestJSON-601093567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:35:43 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e1e3e380-2d6e-4993-ac8c-01923eba34e5 tempest-AttachVolumeTestJSON-601093567 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2081997705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6097feec-ae6a-48a3-b80a-623e358517b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f2c9303e4cb495cab8f1e097bf57338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:35:43Z,use_quota=True,user_id='1d3905384f6b452f8e13789416d869a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:35:43 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-e1e3e380-2d6e-4993-ac8c-01923eba34e5 tempest-AttachVolumeTestJSON-601093567 None] Creating volume 6097feec-ae6a-48a3-b80a-623e358517b8 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:35:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e1e3e380-2d6e-4993-ac8c-01923eba34e5 tempest-AttachVolumeTestJSON-601093567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:35:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e1e3e380-2d6e-4993-ac8c-01923eba34e5 tempest-AttachVolumeTestJSON-601093567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:35:43 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e1e3e380-2d6e-4993-ac8c-01923eba34e5 tempest-AttachVolumeTestJSON-601093567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:35:43 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e1e3e380-2d6e-4993-ac8c-01923eba34e5 tempest-AttachVolumeTestJSON-601093567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:35:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e1e3e380-2d6e-4993-ac8c-01923eba34e5 tempest-AttachVolumeTestJSON-601093567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:35:43 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e1e3e380-2d6e-4993-ac8c-01923eba34e5 tempest-AttachVolumeTestJSON-601093567 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:35:43 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-e1e3e380-2d6e-4993-ac8c-01923eba34e5 tempest-AttachVolumeTestJSON-601093567 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:35:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e1e3e380-2d6e-4993-ac8c-01923eba34e5 tempest-AttachVolumeTestJSON-601093567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6097feec-ae6a-48a3-b80a-623e358517b8 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:35:43 devstack sudo[91999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6097feec-ae6a-48a3-b80a-623e358517b8 1073741824 Aug 28 09:35:43 devstack sudo[91999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:35:43 devstack sudo[91999]: pam_unix(sudo:session): session closed for user root Aug 28 09:35:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e1e3e380-2d6e-4993-ac8c-01923eba34e5 tempest-AttachVolumeTestJSON-601093567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6097feec-ae6a-48a3-b80a-623e358517b8 1073741824" returned: 0 in 0.545s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:35:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e1e3e380-2d6e-4993-ac8c-01923eba34e5 tempest-AttachVolumeTestJSON-601093567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6097feec-ae6a-48a3-b80a-623e358517b8 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:35:44 devstack sudo[92005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6097feec-ae6a-48a3-b80a-623e358517b8 Aug 28 09:35:44 devstack sudo[92005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:35:44 devstack sudo[92005]: pam_unix(sudo:session): session closed for user root Aug 28 09:35:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e1e3e380-2d6e-4993-ac8c-01923eba34e5 tempest-AttachVolumeTestJSON-601093567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6097feec-ae6a-48a3-b80a-623e358517b8" returned: 0 in 0.329s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:35:44 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e1e3e380-2d6e-4993-ac8c-01923eba34e5 tempest-AttachVolumeTestJSON-601093567 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:35:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e1e3e380-2d6e-4993-ac8c-01923eba34e5 tempest-AttachVolumeTestJSON-601093567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:35:44 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e1e3e380-2d6e-4993-ac8c-01923eba34e5 tempest-AttachVolumeTestJSON-601093567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91899bc0-538e-41bf-b3b6-c8cd5aaea7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6097feec-ae6a-48a3-b80a-623e358517b8', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:35:44 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e1e3e380-2d6e-4993-ac8c-01923eba34e5 tempest-AttachVolumeTestJSON-601093567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d862922-08d0-4fc5-bcb5-4a8f5e87a842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:35:44 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-e1e3e380-2d6e-4993-ac8c-01923eba34e5 tempest-AttachVolumeTestJSON-601093567 None] Volume volume-6097feec-ae6a-48a3-b80a-623e358517b8 (6097feec-ae6a-48a3-b80a-623e358517b8): created successfully Aug 28 09:35:44 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e1e3e380-2d6e-4993-ac8c-01923eba34e5 tempest-AttachVolumeTestJSON-601093567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d862922-08d0-4fc5-bcb5-4a8f5e87a842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:35:44 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e1e3e380-2d6e-4993-ac8c-01923eba34e5 tempest-AttachVolumeTestJSON-601093567 None] Flow 'volume_create_manager' (1cd9de27-4934-49ce-abdf-9f9dff216399) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:35:44 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-e1e3e380-2d6e-4993-ac8c-01923eba34e5 tempest-AttachVolumeTestJSON-601093567 None] Created volume successfully. Aug 28 09:35:46 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-360be4f7-9efd-4051-8959-1e765d0c5734 tempest-VolumesCloneNegativeTest-843287305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:35:46 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-360be4f7-9efd-4051-8959-1e765d0c5734 tempest-VolumesCloneNegativeTest-843287305 None] Flow 'volume_create_manager' (5aee2a05-3b86-46a3-aede-3f22cf6cfe3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:35:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-360be4f7-9efd-4051-8959-1e765d0c5734 tempest-VolumesCloneNegativeTest-843287305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88c0dff5-bcd3-40cf-b934-56f03b32d3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:35:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-360be4f7-9efd-4051-8959-1e765d0c5734 tempest-VolumesCloneNegativeTest-843287305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88c0dff5-bcd3-40cf-b934-56f03b32d3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:35:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1238267747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79625578-2c43-4253-9f25-ce9ef1f25c99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f8b71cf4b6f4145a67b78caac4578da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:35:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:35:47Z,use_quota=True,user_id='b17b200813ce4c538288a081d017c2d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:35:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-360be4f7-9efd-4051-8959-1e765d0c5734 tempest-VolumesCloneNegativeTest-843287305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f62eda72-5bd7-48ba-90b5-b9b33f21f900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:35:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-360be4f7-9efd-4051-8959-1e765d0c5734 tempest-VolumesCloneNegativeTest-843287305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f62eda72-5bd7-48ba-90b5-b9b33f21f900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:35:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-360be4f7-9efd-4051-8959-1e765d0c5734 tempest-VolumesCloneNegativeTest-843287305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92180b77-f6fe-434e-818e-0181df890f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:35:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-360be4f7-9efd-4051-8959-1e765d0c5734 tempest-VolumesCloneNegativeTest-843287305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92180b77-f6fe-434e-818e-0181df890f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79625578-2c43-4253-9f25-ce9ef1f25c99', 'volume_name': 'volume-79625578-2c43-4253-9f25-ce9ef1f25c99', 'volume_size': 2}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:35:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-360be4f7-9efd-4051-8959-1e765d0c5734 tempest-VolumesCloneNegativeTest-843287305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faf0712a-6377-4e09-9025-652df1a29f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:35:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-360be4f7-9efd-4051-8959-1e765d0c5734 tempest-VolumesCloneNegativeTest-843287305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faf0712a-6377-4e09-9025-652df1a29f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:35:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-360be4f7-9efd-4051-8959-1e765d0c5734 tempest-VolumesCloneNegativeTest-843287305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5513388b-b8d8-4da2-8c72-cfaff19e9c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:35:47 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-360be4f7-9efd-4051-8959-1e765d0c5734 tempest-VolumesCloneNegativeTest-843287305 None] Volume 79625578-2c43-4253-9f25-ce9ef1f25c99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79625578-2c43-4253-9f25-ce9ef1f25c99', 'volume_size': 2} Aug 28 09:35:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-360be4f7-9efd-4051-8959-1e765d0c5734 tempest-VolumesCloneNegativeTest-843287305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:35:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-360be4f7-9efd-4051-8959-1e765d0c5734 tempest-VolumesCloneNegativeTest-843287305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:35:47 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-360be4f7-9efd-4051-8959-1e765d0c5734 tempest-VolumesCloneNegativeTest-843287305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:35:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1238267747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79625578-2c43-4253-9f25-ce9ef1f25c99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f8b71cf4b6f4145a67b78caac4578da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:35:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:35:47Z,use_quota=True,user_id='b17b200813ce4c538288a081d017c2d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:35:47 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-360be4f7-9efd-4051-8959-1e765d0c5734 tempest-VolumesCloneNegativeTest-843287305 None] Creating volume 79625578-2c43-4253-9f25-ce9ef1f25c99 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:35:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-360be4f7-9efd-4051-8959-1e765d0c5734 tempest-VolumesCloneNegativeTest-843287305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:35:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-360be4f7-9efd-4051-8959-1e765d0c5734 tempest-VolumesCloneNegativeTest-843287305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:35:47 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-360be4f7-9efd-4051-8959-1e765d0c5734 tempest-VolumesCloneNegativeTest-843287305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:35:47 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-360be4f7-9efd-4051-8959-1e765d0c5734 tempest-VolumesCloneNegativeTest-843287305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:35:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-360be4f7-9efd-4051-8959-1e765d0c5734 tempest-VolumesCloneNegativeTest-843287305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:35:47 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-360be4f7-9efd-4051-8959-1e765d0c5734 tempest-VolumesCloneNegativeTest-843287305 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:35:47 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-360be4f7-9efd-4051-8959-1e765d0c5734 tempest-VolumesCloneNegativeTest-843287305 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:35:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-360be4f7-9efd-4051-8959-1e765d0c5734 tempest-VolumesCloneNegativeTest-843287305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-79625578-2c43-4253-9f25-ce9ef1f25c99 2147483648 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:35:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-671ac2f8-d6e7-470f-abbd-386e957e5a99 req-0d938095-86bb-42f4-b6b7-f92b2142cfc4 tempest-AttachVolumeTestJSON-601093567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:35:47 devstack sudo[92022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-79625578-2c43-4253-9f25-ce9ef1f25c99 2147483648 Aug 28 09:35:47 devstack sudo[92022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:35:47 devstack sudo[92022]: pam_unix(sudo:session): session closed for user root Aug 28 09:35:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-360be4f7-9efd-4051-8959-1e765d0c5734 tempest-VolumesCloneNegativeTest-843287305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-79625578-2c43-4253-9f25-ce9ef1f25c99 2147483648" returned: 0 in 0.540s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:35:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-360be4f7-9efd-4051-8959-1e765d0c5734 tempest-VolumesCloneNegativeTest-843287305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-79625578-2c43-4253-9f25-ce9ef1f25c99 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:35:47 devstack sudo[92028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-79625578-2c43-4253-9f25-ce9ef1f25c99 Aug 28 09:35:47 devstack sudo[92028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:35:47 devstack sudo[92028]: pam_unix(sudo:session): session closed for user root Aug 28 09:35:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-360be4f7-9efd-4051-8959-1e765d0c5734 tempest-VolumesCloneNegativeTest-843287305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-79625578-2c43-4253-9f25-ce9ef1f25c99" returned: 0 in 0.287s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:35:47 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-360be4f7-9efd-4051-8959-1e765d0c5734 tempest-VolumesCloneNegativeTest-843287305 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:35:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-360be4f7-9efd-4051-8959-1e765d0c5734 tempest-VolumesCloneNegativeTest-843287305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:35:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-671ac2f8-d6e7-470f-abbd-386e957e5a99 req-0d938095-86bb-42f4-b6b7-f92b2142cfc4 tempest-AttachVolumeTestJSON-601093567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.853s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:35:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-360be4f7-9efd-4051-8959-1e765d0c5734 tempest-VolumesCloneNegativeTest-843287305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5513388b-b8d8-4da2-8c72-cfaff19e9c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79625578-2c43-4253-9f25-ce9ef1f25c99', 'volume_size': 2}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:35:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-360be4f7-9efd-4051-8959-1e765d0c5734 tempest-VolumesCloneNegativeTest-843287305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9b934eb-b856-4f7a-a93d-78fc01134ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:35:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-671ac2f8-d6e7-470f-abbd-386e957e5a99 req-0d938095-86bb-42f4-b6b7-f92b2142cfc4 tempest-AttachVolumeTestJSON-601093567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:35:48 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-360be4f7-9efd-4051-8959-1e765d0c5734 tempest-VolumesCloneNegativeTest-843287305 None] Volume volume-79625578-2c43-4253-9f25-ce9ef1f25c99 (79625578-2c43-4253-9f25-ce9ef1f25c99): created successfully Aug 28 09:35:48 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-360be4f7-9efd-4051-8959-1e765d0c5734 tempest-VolumesCloneNegativeTest-843287305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9b934eb-b856-4f7a-a93d-78fc01134ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:35:48 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-360be4f7-9efd-4051-8959-1e765d0c5734 tempest-VolumesCloneNegativeTest-843287305 None] Flow 'volume_create_manager' (5aee2a05-3b86-46a3-aede-3f22cf6cfe3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:35:48 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-360be4f7-9efd-4051-8959-1e765d0c5734 tempest-VolumesCloneNegativeTest-843287305 None] Created volume successfully. Aug 28 09:35:48 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-671ac2f8-d6e7-470f-abbd-386e957e5a99 req-0d938095-86bb-42f4-b6b7-f92b2142cfc4 tempest-AttachVolumeTestJSON-601093567 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b', 'name': 'volume-6097feec-ae6a-48a3-b80a-623e358517b8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '02f71485-bbc3-464b-b9dc-77724bb82c11', 'enforce_multipath': True} {{(pid=86081) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 09:35:48 devstack cinder-volume[86081]: INFO cinder.volume.manager [req-671ac2f8-d6e7-470f-abbd-386e957e5a99 req-0d938095-86bb-42f4-b6b7-f92b2142cfc4 tempest-AttachVolumeTestJSON-601093567 None] attachment_update completed successfully. Aug 28 09:35:49 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-fb87f374-9dd7-430e-8321-8d6e25071efa tempest-VolumesCloneNegativeTest-843287305 None] Acquiring lock "cinder-79625578-2c43-4253-9f25-ce9ef1f25c99-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:35:49 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-fb87f374-9dd7-430e-8321-8d6e25071efa tempest-VolumesCloneNegativeTest-843287305 None] Lock "cinder-79625578-2c43-4253-9f25-ce9ef1f25c99-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:35:49 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-fb87f374-9dd7-430e-8321-8d6e25071efa tempest-VolumesCloneNegativeTest-843287305 None] Acquiring lock "cinder-quobyte-79625578-2c43-4253-9f25-ce9ef1f25c99" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:35:49 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-fb87f374-9dd7-430e-8321-8d6e25071efa tempest-VolumesCloneNegativeTest-843287305 None] Lock "cinder-quobyte-79625578-2c43-4253-9f25-ce9ef1f25c99" acquired by "delete_volume" :: waited 0.027s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:35:49 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87e9bd4-e22c-4a7f-88e4-37fca26b211d]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:35:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fb87f374-9dd7-430e-8321-8d6e25071efa tempest-VolumesCloneNegativeTest-843287305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-79625578-2c43-4253-9f25-ce9ef1f25c99 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:35:49 devstack sudo[92414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-79625578-2c43-4253-9f25-ce9ef1f25c99 Aug 28 09:35:49 devstack sudo[92414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:35:49 devstack sudo[92414]: pam_unix(sudo:session): session closed for user root Aug 28 09:35:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fb87f374-9dd7-430e-8321-8d6e25071efa tempest-VolumesCloneNegativeTest-843287305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-79625578-2c43-4253-9f25-ce9ef1f25c99" returned: 0 in 0.391s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:35:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fb87f374-9dd7-430e-8321-8d6e25071efa tempest-VolumesCloneNegativeTest-843287305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-79625578-2c43-4253-9f25-ce9ef1f25c99 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:35:49 devstack sudo[92419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-79625578-2c43-4253-9f25-ce9ef1f25c99 Aug 28 09:35:49 devstack sudo[92419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:35:50 devstack sudo[92419]: pam_unix(sudo:session): session closed for user root Aug 28 09:35:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fb87f374-9dd7-430e-8321-8d6e25071efa tempest-VolumesCloneNegativeTest-843287305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-79625578-2c43-4253-9f25-ce9ef1f25c99" returned: 0 in 0.324s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:35:50 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-fb87f374-9dd7-430e-8321-8d6e25071efa tempest-VolumesCloneNegativeTest-843287305 None] Lock "cinder-quobyte-79625578-2c43-4253-9f25-ce9ef1f25c99" released by "delete_volume" :: held 0.780s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:35:50 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-fb87f374-9dd7-430e-8321-8d6e25071efa tempest-VolumesCloneNegativeTest-843287305 None] Created reservations ['27b1e40a-31c5-4cc6-8e94-7f57e3d99036', 'd1386f27-4908-452a-a90d-5fe6fe2f0ba8', '95143d8b-7c88-434b-b143-f89b3a48c0f9', '3cf6b4fd-1467-4b74-8e65-6dc4150b500f'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:35:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-fb87f374-9dd7-430e-8321-8d6e25071efa tempest-VolumesCloneNegativeTest-843287305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:35:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-fb87f374-9dd7-430e-8321-8d6e25071efa tempest-VolumesCloneNegativeTest-843287305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:35:50 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-fb87f374-9dd7-430e-8321-8d6e25071efa tempest-VolumesCloneNegativeTest-843287305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:35:50 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-fb87f374-9dd7-430e-8321-8d6e25071efa tempest-VolumesCloneNegativeTest-843287305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:35:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-fb87f374-9dd7-430e-8321-8d6e25071efa tempest-VolumesCloneNegativeTest-843287305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:35:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fb87f374-9dd7-430e-8321-8d6e25071efa tempest-VolumesCloneNegativeTest-843287305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:35:50 devstack sudo[92423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:35:50 devstack sudo[92423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:35:50 devstack sudo[92423]: pam_unix(sudo:session): session closed for user root Aug 28 09:35:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fb87f374-9dd7-430e-8321-8d6e25071efa tempest-VolumesCloneNegativeTest-843287305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.522s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:35:50 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-fb87f374-9dd7-430e-8321-8d6e25071efa tempest-VolumesCloneNegativeTest-843287305 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:35:50 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-fb87f374-9dd7-430e-8321-8d6e25071efa tempest-VolumesCloneNegativeTest-843287305 None] Deleted volume successfully. Aug 28 09:35:50 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-fb87f374-9dd7-430e-8321-8d6e25071efa tempest-VolumesCloneNegativeTest-843287305 None] Lock "cinder-79625578-2c43-4253-9f25-ce9ef1f25c99-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:35:54 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-af3c7200-c81b-4232-b751-25b753234a6c tempest-AttachVolumeNegativeTest-1867820442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:35:54 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-af3c7200-c81b-4232-b751-25b753234a6c tempest-AttachVolumeNegativeTest-1867820442 None] Flow 'volume_create_manager' (72c5d9e5-d9ce-4fe2-9f61-880cb8c2359f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:35:54 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-af3c7200-c81b-4232-b751-25b753234a6c tempest-AttachVolumeNegativeTest-1867820442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (430b739c-c7bf-4c94-bfff-640e3ec8db86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:35:54 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-af3c7200-c81b-4232-b751-25b753234a6c tempest-AttachVolumeNegativeTest-1867820442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (430b739c-c7bf-4c94-bfff-640e3ec8db86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:35:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1463600282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12a443d5-4f71-4ff1-915b-675f664703a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44a80d5e47094bc58d0bce329e32f15e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:35:55Z,use_quota=True,user_id='74867e4ae611477aa97b45f6b6fb70b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:35:54 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-af3c7200-c81b-4232-b751-25b753234a6c tempest-AttachVolumeNegativeTest-1867820442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d34f2350-87f5-478f-ba23-0d08a7e1da04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:35:54 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-af3c7200-c81b-4232-b751-25b753234a6c tempest-AttachVolumeNegativeTest-1867820442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d34f2350-87f5-478f-ba23-0d08a7e1da04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:35:54 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-af3c7200-c81b-4232-b751-25b753234a6c tempest-AttachVolumeNegativeTest-1867820442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ee86c8c-37f7-4e6f-b827-5e0bf47f5ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:35:54 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-af3c7200-c81b-4232-b751-25b753234a6c tempest-AttachVolumeNegativeTest-1867820442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ee86c8c-37f7-4e6f-b827-5e0bf47f5ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12a443d5-4f71-4ff1-915b-675f664703a4', 'volume_name': 'volume-12a443d5-4f71-4ff1-915b-675f664703a4', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:35:54 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-af3c7200-c81b-4232-b751-25b753234a6c tempest-AttachVolumeNegativeTest-1867820442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28ee015b-2067-4792-b1eb-3e5dcb65d75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:35:54 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-af3c7200-c81b-4232-b751-25b753234a6c tempest-AttachVolumeNegativeTest-1867820442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28ee015b-2067-4792-b1eb-3e5dcb65d75c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:35:54 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-af3c7200-c81b-4232-b751-25b753234a6c tempest-AttachVolumeNegativeTest-1867820442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a222f507-4c05-43db-8b60-291761eee181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:35:54 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-af3c7200-c81b-4232-b751-25b753234a6c tempest-AttachVolumeNegativeTest-1867820442 None] Volume 12a443d5-4f71-4ff1-915b-675f664703a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12a443d5-4f71-4ff1-915b-675f664703a4', 'volume_size': 1} Aug 28 09:35:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-af3c7200-c81b-4232-b751-25b753234a6c tempest-AttachVolumeNegativeTest-1867820442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:35:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-af3c7200-c81b-4232-b751-25b753234a6c tempest-AttachVolumeNegativeTest-1867820442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:35:54 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-af3c7200-c81b-4232-b751-25b753234a6c tempest-AttachVolumeNegativeTest-1867820442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:35:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1463600282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12a443d5-4f71-4ff1-915b-675f664703a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44a80d5e47094bc58d0bce329e32f15e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:35:55Z,use_quota=True,user_id='74867e4ae611477aa97b45f6b6fb70b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:35:54 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-af3c7200-c81b-4232-b751-25b753234a6c tempest-AttachVolumeNegativeTest-1867820442 None] Creating volume 12a443d5-4f71-4ff1-915b-675f664703a4 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:35:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-af3c7200-c81b-4232-b751-25b753234a6c tempest-AttachVolumeNegativeTest-1867820442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:35:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-af3c7200-c81b-4232-b751-25b753234a6c tempest-AttachVolumeNegativeTest-1867820442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:35:54 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-af3c7200-c81b-4232-b751-25b753234a6c tempest-AttachVolumeNegativeTest-1867820442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:35:54 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-af3c7200-c81b-4232-b751-25b753234a6c tempest-AttachVolumeNegativeTest-1867820442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:35:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-af3c7200-c81b-4232-b751-25b753234a6c tempest-AttachVolumeNegativeTest-1867820442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:35:54 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-af3c7200-c81b-4232-b751-25b753234a6c tempest-AttachVolumeNegativeTest-1867820442 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:35:54 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-af3c7200-c81b-4232-b751-25b753234a6c tempest-AttachVolumeNegativeTest-1867820442 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:35:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-af3c7200-c81b-4232-b751-25b753234a6c tempest-AttachVolumeNegativeTest-1867820442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-12a443d5-4f71-4ff1-915b-675f664703a4 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:35:54 devstack sudo[92557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-12a443d5-4f71-4ff1-915b-675f664703a4 1073741824 Aug 28 09:35:54 devstack sudo[92557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:35:55 devstack sudo[92557]: pam_unix(sudo:session): session closed for user root Aug 28 09:35:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-af3c7200-c81b-4232-b751-25b753234a6c tempest-AttachVolumeNegativeTest-1867820442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-12a443d5-4f71-4ff1-915b-675f664703a4 1073741824" returned: 0 in 0.935s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:35:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-af3c7200-c81b-4232-b751-25b753234a6c tempest-AttachVolumeNegativeTest-1867820442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-12a443d5-4f71-4ff1-915b-675f664703a4 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:35:55 devstack sudo[92928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-12a443d5-4f71-4ff1-915b-675f664703a4 Aug 28 09:35:55 devstack sudo[92928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:35:56 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:35:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] Flow 'volume_create_manager' (4cab662f-0f80-4d79-a360-0a39d20c2973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:35:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7397547-104a-400a-84fe-31df457ce199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:35:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7397547-104a-400a-84fe-31df457ce199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1298697379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36f6cf99-1111-4283-9a0c-8a9311a87573,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5208b7f13fee4b2a8955d6876fff9d1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:35:56Z,use_quota=True,user_id='bb7554da29ce4074b532f5c6ca06b9ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:35:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29f85335-d89e-4f9e-bd6c-f16f3c068a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:35:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29f85335-d89e-4f9e-bd6c-f16f3c068a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:35:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c0d03fe-0137-4496-85de-005d7b1e3e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:35:56 devstack cinder-volume[86081]: DEBUG cinder.image.glance [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] Creating Keystone auth plugin from conf {{(pid=86081) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 28 09:35:56 devstack sudo[92928]: pam_unix(sudo:session): session closed for user root Aug 28 09:35:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-af3c7200-c81b-4232-b751-25b753234a6c tempest-AttachVolumeNegativeTest-1867820442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-12a443d5-4f71-4ff1-915b-675f664703a4" returned: 0 in 0.617s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:35:56 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-af3c7200-c81b-4232-b751-25b753234a6c tempest-AttachVolumeNegativeTest-1867820442 None] <== create_volume: return (1671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:35:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-af3c7200-c81b-4232-b751-25b753234a6c tempest-AttachVolumeNegativeTest-1867820442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.674s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:35:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-af3c7200-c81b-4232-b751-25b753234a6c tempest-AttachVolumeNegativeTest-1867820442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a222f507-4c05-43db-8b60-291761eee181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12a443d5-4f71-4ff1-915b-675f664703a4', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:35:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-af3c7200-c81b-4232-b751-25b753234a6c tempest-AttachVolumeNegativeTest-1867820442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07937b8d-5cd3-4f95-8974-cf730f5a15ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:35:56 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-af3c7200-c81b-4232-b751-25b753234a6c tempest-AttachVolumeNegativeTest-1867820442 None] Volume volume-12a443d5-4f71-4ff1-915b-675f664703a4 (12a443d5-4f71-4ff1-915b-675f664703a4): created successfully Aug 28 09:35:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-af3c7200-c81b-4232-b751-25b753234a6c tempest-AttachVolumeNegativeTest-1867820442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07937b8d-5cd3-4f95-8974-cf730f5a15ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:35:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-af3c7200-c81b-4232-b751-25b753234a6c tempest-AttachVolumeNegativeTest-1867820442 None] Flow 'volume_create_manager' (72c5d9e5-d9ce-4fe2-9f61-880cb8c2359f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:35:56 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-af3c7200-c81b-4232-b751-25b753234a6c tempest-AttachVolumeNegativeTest-1867820442 None] Created volume successfully. Aug 28 09:35:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c0d03fe-0137-4496-85de-005d7b1e3e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '36f6cf99-1111-4283-9a0c-8a9311a87573', 'volume_name': 'volume-36f6cf99-1111-4283-9a0c-8a9311a87573', 'volume_size': 1, 'image_id': '4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b980c3c37cfa4760ad4846d0fd4baffc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'created_at': datetime.datetime(2026, 8, 28, 7, 25, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 7, 25, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:35:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (026a59a0-7114-4a74-b667-4ed8f2aa6795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:35:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (026a59a0-7114-4a74-b667-4ed8f2aa6795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:35:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c0234b3-f776-4146-a98b-a8362c6bf050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:35:56 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] Volume 36f6cf99-1111-4283-9a0c-8a9311a87573: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-36f6cf99-1111-4283-9a0c-8a9311a87573', 'volume_size': 1, 'image_id': '4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b980c3c37cfa4760ad4846d0fd4baffc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'created_at': datetime.datetime(2026, 8, 28, 7, 25, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 7, 25, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 28 09:35:56 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] Trying to clone 36f6cf99-1111-4283-9a0c-8a9311a87573 from image 4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'metadata': {}}]). {{(pid=86081) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 28 09:35:57 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_i0_yxnqidevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86081) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 28 09:35:57 devstack cinder-volume[86081]: INFO cinder.image.image_utils [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] Image download 20.69 MB at 20.69 MB/s Aug 28 09:35:57 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[54228113-802f-42eb-a68a-d28147fd0ba8]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:35:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_i0_yxnqidevstack@QuobyteHD {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:35:58 devstack sudo[92975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_i0_yxnqidevstack@QuobyteHD Aug 28 09:35:58 devstack sudo[92975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:35:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-a71c8926-3655-4398-ac37-d7df9f8334eb req-f957cf5b-d498-454e-9117-fe5277fb4b89 tempest-AttachVolumeNegativeTest-1867820442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:35:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-a71c8926-3655-4398-ac37-d7df9f8334eb req-f957cf5b-d498-454e-9117-fe5277fb4b89 tempest-AttachVolumeNegativeTest-1867820442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:35:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-a71c8926-3655-4398-ac37-d7df9f8334eb req-f957cf5b-d498-454e-9117-fe5277fb4b89 tempest-AttachVolumeNegativeTest-1867820442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.065s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:35:58 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-a71c8926-3655-4398-ac37-d7df9f8334eb req-f957cf5b-d498-454e-9117-fe5277fb4b89 tempest-AttachVolumeNegativeTest-1867820442 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b', 'name': 'volume-12a443d5-4f71-4ff1-915b-675f664703a4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0794edab-6953-4fc6-81cf-0103db74ea65', 'enforce_multipath': True} {{(pid=86081) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 09:35:58 devstack sudo[92975]: pam_unix(sudo:session): session closed for user root Aug 28 09:35:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_i0_yxnqidevstack@QuobyteHD" returned: 0 in 0.801s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:35:58 devstack cinder-volume[86081]: INFO cinder.volume.manager [req-a71c8926-3655-4398-ac37-d7df9f8334eb req-f957cf5b-d498-454e-9117-fe5277fb4b89 tempest-AttachVolumeNegativeTest-1867820442 None] attachment_update completed successfully. Aug 28 09:35:58 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] Temporary image 4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0 is fetched for user bb7554da29ce4074b532f5c6ca06b9ac. {{(pid=86081) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 28 09:35:58 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[0607f189-28dc-4541-929a-a9e9d9ad386a]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:35:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_i0_yxnqidevstack@QuobyteHD {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:35:58 devstack sudo[92990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_i0_yxnqidevstack@QuobyteHD Aug 28 09:35:58 devstack sudo[92990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:35:59 devstack sudo[92990]: pam_unix(sudo:session): session closed for user root Aug 28 09:35:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_i0_yxnqidevstack@QuobyteHD" returned: 0 in 0.447s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:35:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:35:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:35:59 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1298697379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36f6cf99-1111-4283-9a0c-8a9311a87573,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5208b7f13fee4b2a8955d6876fff9d1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:35:56Z,use_quota=True,user_id='bb7554da29ce4074b532f5c6ca06b9ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:35:59 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] Creating volume 36f6cf99-1111-4283-9a0c-8a9311a87573 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:35:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:35:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:35:59 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:35:59 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:35:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:35:59 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:35:59 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:35:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-36f6cf99-1111-4283-9a0c-8a9311a87573 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:35:59 devstack sudo[92996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-36f6cf99-1111-4283-9a0c-8a9311a87573 1073741824 Aug 28 09:35:59 devstack sudo[92996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:35:59 devstack sudo[92996]: pam_unix(sudo:session): session closed for user root Aug 28 09:35:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-36f6cf99-1111-4283-9a0c-8a9311a87573 1073741824" returned: 0 in 0.694s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:35:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-36f6cf99-1111-4283-9a0c-8a9311a87573 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:35:59 devstack sudo[93003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-36f6cf99-1111-4283-9a0c-8a9311a87573 Aug 28 09:35:59 devstack sudo[93003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:36:00 devstack sudo[93003]: pam_unix(sudo:session): session closed for user root Aug 28 09:36:00 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-36f6cf99-1111-4283-9a0c-8a9311a87573" returned: 0 in 0.314s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:36:00 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:36:00 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:36:00 devstack cinder-volume[86081]: DEBUG cinder.volume.volume_utils [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] Attempting download of 4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0 ((None, [{'url': 'file:///opt/stack/data/glance/images/4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'metadata': {}}])) to volume 36f6cf99-1111-4283-9a0c-8a9311a87573. {{(pid=86081) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 28 09:36:00 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b89b07-7235-46c8-a4f8-46455d7a5370]: (4, 'raw') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:36:00 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_r3n2c8yj {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:36:00 devstack sudo[93006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_r3n2c8yj Aug 28 09:36:00 devstack sudo[93006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:36:01 devstack sudo[93006]: pam_unix(sudo:session): session closed for user root Aug 28 09:36:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_r3n2c8yj" returned: 0 in 0.828s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:36:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_r3n2c8yj {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:36:01 devstack sudo[93047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_r3n2c8yj Aug 28 09:36:01 devstack sudo[93047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:36:01 devstack sudo[93047]: pam_unix(sudo:session): session closed for user root Aug 28 09:36:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_r3n2c8yj" returned: 1 in 0.638s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:36:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_r3n2c8yj' failed. Not Retrying. {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 09:36:01 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4153d5-e2ef-45a1-9946-3e6afb955c2e]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:36:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_i0_yxnqidevstack@QuobyteHD {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:36:02 devstack sudo[93072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_i0_yxnqidevstack@QuobyteHD Aug 28 09:36:02 devstack sudo[93072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:36:02 devstack sudo[93072]: pam_unix(sudo:session): session closed for user root Aug 28 09:36:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_i0_yxnqidevstack@QuobyteHD" returned: 0 in 0.580s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:36:02 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] 4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0 was qcow2, converting to qcow2 {{(pid=86081) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 28 09:36:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_i0_yxnqidevstack@QuobyteHD /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-36f6cf99-1111-4283-9a0c-8a9311a87573 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:36:02 devstack sudo[93090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_i0_yxnqidevstack@QuobyteHD /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-36f6cf99-1111-4283-9a0c-8a9311a87573 Aug 28 09:36:02 devstack sudo[93090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:36:05 devstack sudo[93090]: pam_unix(sudo:session): session closed for user root Aug 28 09:36:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_i0_yxnqidevstack@QuobyteHD /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-36f6cf99-1111-4283-9a0c-8a9311a87573" returned: 0 in 3.207s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:36:05 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_i0_yxnqidevstack@QuobyteHD, size 112.00 MB, duration 3.21 sec, destination /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-36f6cf99-1111-4283-9a0c-8a9311a87573 {{(pid=86081) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 09:36:05 devstack cinder-volume[86081]: INFO cinder.image.image_utils [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] Converted 112.00 MB image at 34.85 MB/s Aug 28 09:36:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-36f6cf99-1111-4283-9a0c-8a9311a87573 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:36:05 devstack sudo[93143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-36f6cf99-1111-4283-9a0c-8a9311a87573 1G Aug 28 09:36:05 devstack sudo[93143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:36:06 devstack sudo[93143]: pam_unix(sudo:session): session closed for user root Aug 28 09:36:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-36f6cf99-1111-4283-9a0c-8a9311a87573 1G" returned: 0 in 0.799s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:36:06 devstack cinder-volume[86081]: DEBUG cinder.volume.volume_utils [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] Downloaded image 4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0 ((None, [{'url': 'file:///opt/stack/data/glance/images/4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'metadata': {}}])) to volume 36f6cf99-1111-4283-9a0c-8a9311a87573 successfully. {{(pid=86081) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 28 09:36:06 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] Temporary image 4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0 for user bb7554da29ce4074b532f5c6ca06b9ac is deleted. {{(pid=86081) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 28 09:36:06 devstack cinder-volume[86081]: DEBUG cinder.volume.volume_utils [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] Marking volume 36f6cf99-1111-4283-9a0c-8a9311a87573 as bootable. {{(pid=86081) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 28 09:36:06 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] Copying metadata from image 4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0 to 36f6cf99-1111-4283-9a0c-8a9311a87573. {{(pid=86081) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 28 09:36:06 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] Creating volume glance metadata for volume 36f6cf99-1111-4283-9a0c-8a9311a87573 backed by image 4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86081) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 28 09:36:06 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c0234b3-f776-4146-a98b-a8362c6bf050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36f6cf99-1111-4283-9a0c-8a9311a87573', 'volume_size': 1, 'image_id': '4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b980c3c37cfa4760ad4846d0fd4baffc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'created_at': datetime.datetime(2026, 8, 28, 7, 25, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 7, 25, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:36:06 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7a284cf-ae5f-46fb-b3a8-814fdfdbeb3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:36:06 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] Volume volume-36f6cf99-1111-4283-9a0c-8a9311a87573 (36f6cf99-1111-4283-9a0c-8a9311a87573): created successfully Aug 28 09:36:06 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7a284cf-ae5f-46fb-b3a8-814fdfdbeb3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:36:06 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] Flow 'volume_create_manager' (4cab662f-0f80-4d79-a360-0a39d20c2973) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:36:06 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-42bfd2d5-9596-4984-a704-a37b3f4a1320 tempest-VolumesExtendTest-598381877 None] Created volume successfully. Aug 28 09:36:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-469e08ea-4cbb-4e66-919b-3749d322aa00 tempest-VolumesExtendTest-598381877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:36:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-469e08ea-4cbb-4e66-919b-3749d322aa00 tempest-VolumesExtendTest-598381877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:36:07 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aca5894-2ed9-4f6c-a9e4-3bf56c19d8fe]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:36:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-469e08ea-4cbb-4e66-919b-3749d322aa00 tempest-VolumesExtendTest-598381877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-36f6cf99-1111-4283-9a0c-8a9311a87573 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:36:07 devstack sudo[93154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-36f6cf99-1111-4283-9a0c-8a9311a87573 Aug 28 09:36:07 devstack sudo[93154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:36:08 devstack sudo[93154]: pam_unix(sudo:session): session closed for user root Aug 28 09:36:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-469e08ea-4cbb-4e66-919b-3749d322aa00 tempest-VolumesExtendTest-598381877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-36f6cf99-1111-4283-9a0c-8a9311a87573" returned: 0 in 0.839s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:36:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-469e08ea-4cbb-4e66-919b-3749d322aa00 tempest-VolumesExtendTest-598381877 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-36f6cf99-1111-4283-9a0c-8a9311a87573 2G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:36:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-469e08ea-4cbb-4e66-919b-3749d322aa00 tempest-VolumesExtendTest-598381877 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-36f6cf99-1111-4283-9a0c-8a9311a87573 2G" returned: 0 in 0.126s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:36:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-469e08ea-4cbb-4e66-919b-3749d322aa00 tempest-VolumesExtendTest-598381877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.002s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:36:08 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-469e08ea-4cbb-4e66-919b-3749d322aa00 tempest-VolumesExtendTest-598381877 None] Extend volume completed successfully. Aug 28 09:36:09 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-7331b766-b487-4cb5-bff9-df08e6c79217 tempest-VolumesExtendTest-598381877 None] Acquiring lock "cinder-36f6cf99-1111-4283-9a0c-8a9311a87573-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:36:09 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-7331b766-b487-4cb5-bff9-df08e6c79217 tempest-VolumesExtendTest-598381877 None] Lock "cinder-36f6cf99-1111-4283-9a0c-8a9311a87573-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:36:09 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-7331b766-b487-4cb5-bff9-df08e6c79217 tempest-VolumesExtendTest-598381877 None] Acquiring lock "cinder-quobyte-36f6cf99-1111-4283-9a0c-8a9311a87573" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:36:09 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-7331b766-b487-4cb5-bff9-df08e6c79217 tempest-VolumesExtendTest-598381877 None] Lock "cinder-quobyte-36f6cf99-1111-4283-9a0c-8a9311a87573" acquired by "delete_volume" :: waited 0.050s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:36:09 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[9501e5d2-f43e-4d99-a0ba-3a91ca9cf875]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:36:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7331b766-b487-4cb5-bff9-df08e6c79217 tempest-VolumesExtendTest-598381877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-36f6cf99-1111-4283-9a0c-8a9311a87573 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:36:09 devstack sudo[93169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-36f6cf99-1111-4283-9a0c-8a9311a87573 Aug 28 09:36:09 devstack sudo[93169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:36:10 devstack sudo[93169]: pam_unix(sudo:session): session closed for user root Aug 28 09:36:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7331b766-b487-4cb5-bff9-df08e6c79217 tempest-VolumesExtendTest-598381877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-36f6cf99-1111-4283-9a0c-8a9311a87573" returned: 0 in 0.679s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:36:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7331b766-b487-4cb5-bff9-df08e6c79217 tempest-VolumesExtendTest-598381877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-36f6cf99-1111-4283-9a0c-8a9311a87573 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:36:10 devstack sudo[93183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-36f6cf99-1111-4283-9a0c-8a9311a87573 Aug 28 09:36:10 devstack sudo[93183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:36:10 devstack sudo[93183]: pam_unix(sudo:session): session closed for user root Aug 28 09:36:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7331b766-b487-4cb5-bff9-df08e6c79217 tempest-VolumesExtendTest-598381877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-36f6cf99-1111-4283-9a0c-8a9311a87573" returned: 0 in 0.496s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:36:10 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-7331b766-b487-4cb5-bff9-df08e6c79217 tempest-VolumesExtendTest-598381877 None] Lock "cinder-quobyte-36f6cf99-1111-4283-9a0c-8a9311a87573" released by "delete_volume" :: held 1.265s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:36:10 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-7331b766-b487-4cb5-bff9-df08e6c79217 tempest-VolumesExtendTest-598381877 None] Created reservations ['08cf62e4-2a1d-4bed-bd80-53b44edf5cf4', '9d40099d-727b-4f88-bee4-6b064cdef0e7', '10bd804a-c0ec-456b-baf8-aa305e127329', 'bd810e14-e899-454e-a6c8-63fc0be01c84'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:36:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-7331b766-b487-4cb5-bff9-df08e6c79217 tempest-VolumesExtendTest-598381877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:36:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-7331b766-b487-4cb5-bff9-df08e6c79217 tempest-VolumesExtendTest-598381877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:36:10 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-7331b766-b487-4cb5-bff9-df08e6c79217 tempest-VolumesExtendTest-598381877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:36:11 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-7331b766-b487-4cb5-bff9-df08e6c79217 tempest-VolumesExtendTest-598381877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:36:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-7331b766-b487-4cb5-bff9-df08e6c79217 tempest-VolumesExtendTest-598381877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:36:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7331b766-b487-4cb5-bff9-df08e6c79217 tempest-VolumesExtendTest-598381877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:36:11 devstack sudo[93189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:36:11 devstack sudo[93189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:36:11 devstack sudo[93189]: pam_unix(sudo:session): session closed for user root Aug 28 09:36:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7331b766-b487-4cb5-bff9-df08e6c79217 tempest-VolumesExtendTest-598381877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.346s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:36:11 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-7331b766-b487-4cb5-bff9-df08e6c79217 tempest-VolumesExtendTest-598381877 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:36:11 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-7331b766-b487-4cb5-bff9-df08e6c79217 tempest-VolumesExtendTest-598381877 None] Deleted volume successfully. Aug 28 09:36:11 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-7331b766-b487-4cb5-bff9-df08e6c79217 tempest-VolumesExtendTest-598381877 None] Lock "cinder-36f6cf99-1111-4283-9a0c-8a9311a87573-delete_volume" released by "delete_volume" :: held 2.104s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:36:12 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1697084-1527-442c-8b40-af3a7175b6bd tempest-VolumesExtendTest-598381877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:36:12 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f1697084-1527-442c-8b40-af3a7175b6bd tempest-VolumesExtendTest-598381877 None] Flow 'volume_create_manager' (66a03992-026e-465b-8d01-50b9a110dba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:36:12 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f1697084-1527-442c-8b40-af3a7175b6bd tempest-VolumesExtendTest-598381877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (039543a6-d9f8-4a0e-aefe-051283f3da26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:36:12 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writing DB stats cinder:SELECT=73,cinder:UPDATE=95,cinder:INSERT=31,cinder:DELETE=11 {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:36:12 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f1697084-1527-442c-8b40-af3a7175b6bd tempest-VolumesExtendTest-598381877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (039543a6-d9f8-4a0e-aefe-051283f3da26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:36:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-370608098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccd52bf5-6171-4c16-8cef-13db0a50bd59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5208b7f13fee4b2a8955d6876fff9d1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:36:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:36:12Z,use_quota=True,user_id='bb7554da29ce4074b532f5c6ca06b9ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:36:12 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f1697084-1527-442c-8b40-af3a7175b6bd tempest-VolumesExtendTest-598381877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbc2c4ea-54ce-4175-9c42-d4ab423337e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:36:12 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f1697084-1527-442c-8b40-af3a7175b6bd tempest-VolumesExtendTest-598381877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbc2c4ea-54ce-4175-9c42-d4ab423337e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:36:12 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f1697084-1527-442c-8b40-af3a7175b6bd tempest-VolumesExtendTest-598381877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1833735-c532-432f-9b42-1bffdd1a53bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:36:12 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f1697084-1527-442c-8b40-af3a7175b6bd tempest-VolumesExtendTest-598381877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1833735-c532-432f-9b42-1bffdd1a53bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccd52bf5-6171-4c16-8cef-13db0a50bd59', 'volume_name': 'volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:36:12 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f1697084-1527-442c-8b40-af3a7175b6bd tempest-VolumesExtendTest-598381877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (887df46c-7678-4b18-9d1e-cec076f20c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:36:12 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f1697084-1527-442c-8b40-af3a7175b6bd tempest-VolumesExtendTest-598381877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (887df46c-7678-4b18-9d1e-cec076f20c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:36:12 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f1697084-1527-442c-8b40-af3a7175b6bd tempest-VolumesExtendTest-598381877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c64bf902-5f4c-4cf9-af96-3b817a00966a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:36:12 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-f1697084-1527-442c-8b40-af3a7175b6bd tempest-VolumesExtendTest-598381877 None] Volume ccd52bf5-6171-4c16-8cef-13db0a50bd59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59', 'volume_size': 1} Aug 28 09:36:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f1697084-1527-442c-8b40-af3a7175b6bd tempest-VolumesExtendTest-598381877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:36:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f1697084-1527-442c-8b40-af3a7175b6bd tempest-VolumesExtendTest-598381877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:36:12 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-f1697084-1527-442c-8b40-af3a7175b6bd tempest-VolumesExtendTest-598381877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:36:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-370608098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccd52bf5-6171-4c16-8cef-13db0a50bd59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5208b7f13fee4b2a8955d6876fff9d1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:36:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:36:12Z,use_quota=True,user_id='bb7554da29ce4074b532f5c6ca06b9ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:36:12 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-f1697084-1527-442c-8b40-af3a7175b6bd tempest-VolumesExtendTest-598381877 None] Creating volume ccd52bf5-6171-4c16-8cef-13db0a50bd59 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:36:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f1697084-1527-442c-8b40-af3a7175b6bd tempest-VolumesExtendTest-598381877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:36:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f1697084-1527-442c-8b40-af3a7175b6bd tempest-VolumesExtendTest-598381877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:36:12 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-f1697084-1527-442c-8b40-af3a7175b6bd tempest-VolumesExtendTest-598381877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:36:12 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-f1697084-1527-442c-8b40-af3a7175b6bd tempest-VolumesExtendTest-598381877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:36:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f1697084-1527-442c-8b40-af3a7175b6bd tempest-VolumesExtendTest-598381877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:36:12 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-f1697084-1527-442c-8b40-af3a7175b6bd tempest-VolumesExtendTest-598381877 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:36:12 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-f1697084-1527-442c-8b40-af3a7175b6bd tempest-VolumesExtendTest-598381877 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:36:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f1697084-1527-442c-8b40-af3a7175b6bd tempest-VolumesExtendTest-598381877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:36:12 devstack sudo[93202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59 1073741824 Aug 28 09:36:12 devstack sudo[93202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:36:13 devstack sudo[93202]: pam_unix(sudo:session): session closed for user root Aug 28 09:36:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f1697084-1527-442c-8b40-af3a7175b6bd tempest-VolumesExtendTest-598381877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59 1073741824" returned: 0 in 0.719s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:36:13 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writing DB stats cinder:SELECT=87,cinder:INSERT=23,cinder:UPDATE=96,cinder:DELETE=5 {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:36:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f1697084-1527-442c-8b40-af3a7175b6bd tempest-VolumesExtendTest-598381877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:36:13 devstack sudo[93232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59 Aug 28 09:36:13 devstack sudo[93232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:36:13 devstack sudo[93232]: pam_unix(sudo:session): session closed for user root Aug 28 09:36:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f1697084-1527-442c-8b40-af3a7175b6bd tempest-VolumesExtendTest-598381877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59" returned: 0 in 0.468s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:36:13 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-f1697084-1527-442c-8b40-af3a7175b6bd tempest-VolumesExtendTest-598381877 None] <== create_volume: return (1291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:36:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f1697084-1527-442c-8b40-af3a7175b6bd tempest-VolumesExtendTest-598381877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.301s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:36:13 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f1697084-1527-442c-8b40-af3a7175b6bd tempest-VolumesExtendTest-598381877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c64bf902-5f4c-4cf9-af96-3b817a00966a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:36:13 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f1697084-1527-442c-8b40-af3a7175b6bd tempest-VolumesExtendTest-598381877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d52a1999-9475-45b0-93bd-af4faea8def8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:36:13 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-f1697084-1527-442c-8b40-af3a7175b6bd tempest-VolumesExtendTest-598381877 None] Volume volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59 (ccd52bf5-6171-4c16-8cef-13db0a50bd59): created successfully Aug 28 09:36:13 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f1697084-1527-442c-8b40-af3a7175b6bd tempest-VolumesExtendTest-598381877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d52a1999-9475-45b0-93bd-af4faea8def8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:36:13 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f1697084-1527-442c-8b40-af3a7175b6bd tempest-VolumesExtendTest-598381877 None] Flow 'volume_create_manager' (66a03992-026e-465b-8d01-50b9a110dba3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:36:14 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-f1697084-1527-442c-8b40-af3a7175b6bd tempest-VolumesExtendTest-598381877 None] Created volume successfully. Aug 28 09:36:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-90e78636-ae18-400f-b602-50fce5aa6a81 tempest-VolumesExtendTest-598381877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:36:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-90e78636-ae18-400f-b602-50fce5aa6a81 tempest-VolumesExtendTest-598381877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:36:14 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-90e78636-ae18-400f-b602-50fce5aa6a81 tempest-VolumesExtendTest-598381877 None] Creating offline snapshot a33e27de-3951-4684-bf12-d0642918f961 of volume ccd52bf5-6171-4c16-8cef-13db0a50bd59 {{(pid=86081) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:36:15 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[86925da0-18ca-4575-abdd-476034399ad2]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:36:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-90e78636-ae18-400f-b602-50fce5aa6a81 tempest-VolumesExtendTest-598381877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:36:15 devstack sudo[93278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59 Aug 28 09:36:15 devstack sudo[93278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:36:15 devstack sudo[93278]: pam_unix(sudo:session): session closed for user root Aug 28 09:36:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-90e78636-ae18-400f-b602-50fce5aa6a81 tempest-VolumesExtendTest-598381877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59" returned: 0 in 0.589s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:36:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-90e78636-ae18-400f-b602-50fce5aa6a81 tempest-VolumesExtendTest-598381877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59.a33e27de-3951-4684-bf12-d0642918f961 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:36:15 devstack sudo[93283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59.a33e27de-3951-4684-bf12-d0642918f961 1G Aug 28 09:36:15 devstack sudo[93283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:36:16 devstack sudo[93283]: pam_unix(sudo:session): session closed for user root Aug 28 09:36:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-90e78636-ae18-400f-b602-50fce5aa6a81 tempest-VolumesExtendTest-598381877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59.a33e27de-3951-4684-bf12-d0642918f961 1G" returned: 0 in 0.432s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:36:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-90e78636-ae18-400f-b602-50fce5aa6a81 tempest-VolumesExtendTest-598381877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59.a33e27de-3951-4684-bf12-d0642918f961 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:36:16 devstack sudo[93289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59.a33e27de-3951-4684-bf12-d0642918f961 Aug 28 09:36:16 devstack sudo[93289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:36:16 devstack sudo[93289]: pam_unix(sudo:session): session closed for user root Aug 28 09:36:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-90e78636-ae18-400f-b602-50fce5aa6a81 tempest-VolumesExtendTest-598381877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59.a33e27de-3951-4684-bf12-d0642918f961" returned: 0 in 0.342s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:36:16 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-90e78636-ae18-400f-b602-50fce5aa6a81 tempest-VolumesExtendTest-598381877 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59.a33e27de-3951-4684-bf12-d0642918f961 is being set with open permissions: ugo+rw Aug 28 09:36:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-90e78636-ae18-400f-b602-50fce5aa6a81 tempest-VolumesExtendTest-598381877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59.a33e27de-3951-4684-bf12-d0642918f961 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:36:16 devstack sudo[93295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59.a33e27de-3951-4684-bf12-d0642918f961 Aug 28 09:36:16 devstack sudo[93295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:36:16 devstack sudo[93295]: pam_unix(sudo:session): session closed for user root Aug 28 09:36:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-90e78636-ae18-400f-b602-50fce5aa6a81 tempest-VolumesExtendTest-598381877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59.a33e27de-3951-4684-bf12-d0642918f961" returned: 0 in 0.336s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:36:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-90e78636-ae18-400f-b602-50fce5aa6a81 tempest-VolumesExtendTest-598381877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:36:16 devstack sudo[93325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59.info Aug 28 09:36:16 devstack sudo[93325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:36:17 devstack sudo[93325]: pam_unix(sudo:session): session closed for user root Aug 28 09:36:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-90e78636-ae18-400f-b602-50fce5aa6a81 tempest-VolumesExtendTest-598381877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59.info" returned: 0 in 0.440s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:36:17 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-90e78636-ae18-400f-b602-50fce5aa6a81 tempest-VolumesExtendTest-598381877 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59.info is being set with open permissions: ugo+rw Aug 28 09:36:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-90e78636-ae18-400f-b602-50fce5aa6a81 tempest-VolumesExtendTest-598381877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:36:17 devstack sudo[93328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59.info Aug 28 09:36:17 devstack sudo[93328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:36:17 devstack sudo[93328]: pam_unix(sudo:session): session closed for user root Aug 28 09:36:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-90e78636-ae18-400f-b602-50fce5aa6a81 tempest-VolumesExtendTest-598381877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59.info" returned: 0 in 0.279s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:36:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-90e78636-ae18-400f-b602-50fce5aa6a81 tempest-VolumesExtendTest-598381877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.583s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:36:17 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-90e78636-ae18-400f-b602-50fce5aa6a81 tempest-VolumesExtendTest-598381877 None] Create snapshot completed successfully Aug 28 09:36:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-c03525d3-0e80-4a92-8284-94718731b56b tempest-VolumesExtendTest-598381877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:36:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-c03525d3-0e80-4a92-8284-94718731b56b tempest-VolumesExtendTest-598381877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:36:18 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[629b7e82-a6e7-457b-8464-cb880cfb1ed9]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:36:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c03525d3-0e80-4a92-8284-94718731b56b tempest-VolumesExtendTest-598381877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:36:18 devstack sudo[93333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59 Aug 28 09:36:18 devstack sudo[93333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:36:18 devstack sudo[93333]: pam_unix(sudo:session): session closed for user root Aug 28 09:36:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c03525d3-0e80-4a92-8284-94718731b56b tempest-VolumesExtendTest-598381877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59" returned: 0 in 0.419s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:36:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c03525d3-0e80-4a92-8284-94718731b56b tempest-VolumesExtendTest-598381877 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59.a33e27de-3951-4684-bf12-d0642918f961 2G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:36:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c03525d3-0e80-4a92-8284-94718731b56b tempest-VolumesExtendTest-598381877 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59.a33e27de-3951-4684-bf12-d0642918f961 2G" returned: 0 in 0.142s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:36:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-c03525d3-0e80-4a92-8284-94718731b56b tempest-VolumesExtendTest-598381877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.608s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:36:18 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-c03525d3-0e80-4a92-8284-94718731b56b tempest-VolumesExtendTest-598381877 None] Extend volume completed successfully. Aug 28 09:36:19 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6d8c2534-07ab-4557-aa9a-4931c39ed91f tempest-VolumesExtendTest-598381877 None] Acquiring lock "cinder-a33e27de-3951-4684-bf12-d0642918f961-delete_snapshot" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:36:19 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6d8c2534-07ab-4557-aa9a-4931c39ed91f tempest-VolumesExtendTest-598381877 None] Lock "cinder-a33e27de-3951-4684-bf12-d0642918f961-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:36:19 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6d8c2534-07ab-4557-aa9a-4931c39ed91f tempest-VolumesExtendTest-598381877 None] Acquiring lock "cinder-quobyte-ccd52bf5-6171-4c16-8cef-13db0a50bd59" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:36:19 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6d8c2534-07ab-4557-aa9a-4931c39ed91f tempest-VolumesExtendTest-598381877 None] Lock "cinder-quobyte-ccd52bf5-6171-4c16-8cef-13db0a50bd59" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:36:19 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6d8c2534-07ab-4557-aa9a-4931c39ed91f tempest-VolumesExtendTest-598381877 None] Acquiring lock "cinder-quobyte-a33e27de-3951-4684-bf12-d0642918f961" by "_delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:36:19 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6d8c2534-07ab-4557-aa9a-4931c39ed91f tempest-VolumesExtendTest-598381877 None] Lock "cinder-quobyte-a33e27de-3951-4684-bf12-d0642918f961" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:36:19 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-6d8c2534-07ab-4557-aa9a-4931c39ed91f tempest-VolumesExtendTest-598381877 None] Deleting offline snapshot a33e27de-3951-4684-bf12-d0642918f961 of volume ccd52bf5-6171-4c16-8cef-13db0a50bd59 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:36:19 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-6d8c2534-07ab-4557-aa9a-4931c39ed91f tempest-VolumesExtendTest-598381877 None] snapshot_file for this snap is: volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59.a33e27de-3951-4684-bf12-d0642918f961 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:36:19 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[976f64d7-a934-4801-b4ad-8812dc9b7f51]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:36:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6d8c2534-07ab-4557-aa9a-4931c39ed91f tempest-VolumesExtendTest-598381877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59.a33e27de-3951-4684-bf12-d0642918f961 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:36:19 devstack sudo[93345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59.a33e27de-3951-4684-bf12-d0642918f961 Aug 28 09:36:19 devstack sudo[93345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:36:20 devstack sudo[93345]: pam_unix(sudo:session): session closed for user root Aug 28 09:36:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6d8c2534-07ab-4557-aa9a-4931c39ed91f tempest-VolumesExtendTest-598381877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59.a33e27de-3951-4684-bf12-d0642918f961" returned: 0 in 0.406s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:36:20 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-6d8c2534-07ab-4557-aa9a-4931c39ed91f tempest-VolumesExtendTest-598381877 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:36:20 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[9548cffa-ab41-44a5-9ff4-1ebca5c4c9e0]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:36:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6d8c2534-07ab-4557-aa9a-4931c39ed91f tempest-VolumesExtendTest-598381877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:36:20 devstack sudo[93350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59 Aug 28 09:36:20 devstack sudo[93350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:36:20 devstack sudo[93350]: pam_unix(sudo:session): session closed for user root Aug 28 09:36:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6d8c2534-07ab-4557-aa9a-4931c39ed91f tempest-VolumesExtendTest-598381877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59" returned: 0 in 0.358s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:36:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6d8c2534-07ab-4557-aa9a-4931c39ed91f tempest-VolumesExtendTest-598381877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59.a33e27de-3951-4684-bf12-d0642918f961 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:36:20 devstack sudo[93355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59.a33e27de-3951-4684-bf12-d0642918f961 Aug 28 09:36:20 devstack sudo[93355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:36:20 devstack sudo[93355]: pam_unix(sudo:session): session closed for user root Aug 28 09:36:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6d8c2534-07ab-4557-aa9a-4931c39ed91f tempest-VolumesExtendTest-598381877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59.a33e27de-3951-4684-bf12-d0642918f961" returned: 0 in 0.350s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:36:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6d8c2534-07ab-4557-aa9a-4931c39ed91f tempest-VolumesExtendTest-598381877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59.a33e27de-3951-4684-bf12-d0642918f961 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:36:20 devstack sudo[93361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59.a33e27de-3951-4684-bf12-d0642918f961 Aug 28 09:36:20 devstack sudo[93361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:36:21 devstack sudo[93361]: pam_unix(sudo:session): session closed for user root Aug 28 09:36:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6d8c2534-07ab-4557-aa9a-4931c39ed91f tempest-VolumesExtendTest-598381877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59.a33e27de-3951-4684-bf12-d0642918f961" returned: 0 in 0.238s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:36:21 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6d8c2534-07ab-4557-aa9a-4931c39ed91f tempest-VolumesExtendTest-598381877 None] Lock "cinder-quobyte-a33e27de-3951-4684-bf12-d0642918f961" released by "_delete_snapshot" :: held 1.498s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:36:21 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6d8c2534-07ab-4557-aa9a-4931c39ed91f tempest-VolumesExtendTest-598381877 None] Lock "cinder-quobyte-ccd52bf5-6171-4c16-8cef-13db0a50bd59" released by "delete_snapshot" :: held 1.523s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:36:21 devstack cinder-volume[86081]: WARNING cinder.quota [None req-6d8c2534-07ab-4557-aa9a-4931c39ed91f tempest-VolumesExtendTest-598381877 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 28 09:36:21 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-6d8c2534-07ab-4557-aa9a-4931c39ed91f tempest-VolumesExtendTest-598381877 None] Created reservations ['ccbc0937-78cb-4249-a04a-fedffb296b8e', 'dfc9c8c0-8348-4cee-91d5-821ee6287a6b', 'f57c404d-aaaa-429b-a3da-b34093b76bbb', 'a837b23f-db3f-4ebd-9f27-d482191e0b12'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:36:21 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-6d8c2534-07ab-4557-aa9a-4931c39ed91f tempest-VolumesExtendTest-598381877 None] Delete snapshot completed successfully. Aug 28 09:36:21 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6d8c2534-07ab-4557-aa9a-4931c39ed91f tempest-VolumesExtendTest-598381877 None] Lock "cinder-a33e27de-3951-4684-bf12-d0642918f961-delete_snapshot" released by "delete_snapshot" :: held 1.659s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:36:21 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ebe2ed6a-3fe9-4345-bb52-cacd28f7ad0e tempest-VolumesExtendTest-598381877 None] Acquiring lock "cinder-ccd52bf5-6171-4c16-8cef-13db0a50bd59-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:36:21 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ebe2ed6a-3fe9-4345-bb52-cacd28f7ad0e tempest-VolumesExtendTest-598381877 None] Lock "cinder-ccd52bf5-6171-4c16-8cef-13db0a50bd59-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:36:21 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ebe2ed6a-3fe9-4345-bb52-cacd28f7ad0e tempest-VolumesExtendTest-598381877 None] Acquiring lock "cinder-quobyte-ccd52bf5-6171-4c16-8cef-13db0a50bd59" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:36:21 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ebe2ed6a-3fe9-4345-bb52-cacd28f7ad0e tempest-VolumesExtendTest-598381877 None] Lock "cinder-quobyte-ccd52bf5-6171-4c16-8cef-13db0a50bd59" acquired by "delete_volume" :: waited 0.019s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:36:21 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d30815-24cd-4540-b83d-f9939c1c2d61]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:36:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ebe2ed6a-3fe9-4345-bb52-cacd28f7ad0e tempest-VolumesExtendTest-598381877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:36:21 devstack sudo[93364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59 Aug 28 09:36:21 devstack sudo[93364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:36:22 devstack sudo[93364]: pam_unix(sudo:session): session closed for user root Aug 28 09:36:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ebe2ed6a-3fe9-4345-bb52-cacd28f7ad0e tempest-VolumesExtendTest-598381877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59" returned: 0 in 0.371s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:36:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ebe2ed6a-3fe9-4345-bb52-cacd28f7ad0e tempest-VolumesExtendTest-598381877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:36:22 devstack sudo[93370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59 Aug 28 09:36:22 devstack sudo[93370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:36:22 devstack sudo[93370]: pam_unix(sudo:session): session closed for user root Aug 28 09:36:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ebe2ed6a-3fe9-4345-bb52-cacd28f7ad0e tempest-VolumesExtendTest-598381877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ccd52bf5-6171-4c16-8cef-13db0a50bd59" returned: 0 in 0.265s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:36:22 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ebe2ed6a-3fe9-4345-bb52-cacd28f7ad0e tempest-VolumesExtendTest-598381877 None] Lock "cinder-quobyte-ccd52bf5-6171-4c16-8cef-13db0a50bd59" released by "delete_volume" :: held 0.695s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:36:22 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-ebe2ed6a-3fe9-4345-bb52-cacd28f7ad0e tempest-VolumesExtendTest-598381877 None] Created reservations ['7a41b4de-9140-4be8-9a62-c55c0e78d84c', '56b0144e-7147-4ee3-bf47-d88283a8d483', '09eb3c24-aa79-4aca-9033-d57007eb0363', '4d0345cc-742f-43c0-9fb1-2ff9966fbbec'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:36:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ebe2ed6a-3fe9-4345-bb52-cacd28f7ad0e tempest-VolumesExtendTest-598381877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:36:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ebe2ed6a-3fe9-4345-bb52-cacd28f7ad0e tempest-VolumesExtendTest-598381877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:36:22 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ebe2ed6a-3fe9-4345-bb52-cacd28f7ad0e tempest-VolumesExtendTest-598381877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:36:22 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ebe2ed6a-3fe9-4345-bb52-cacd28f7ad0e tempest-VolumesExtendTest-598381877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:36:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ebe2ed6a-3fe9-4345-bb52-cacd28f7ad0e tempest-VolumesExtendTest-598381877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:36:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ebe2ed6a-3fe9-4345-bb52-cacd28f7ad0e tempest-VolumesExtendTest-598381877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:36:22 devstack sudo[93373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:36:22 devstack sudo[93373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:36:22 devstack sudo[93373]: pam_unix(sudo:session): session closed for user root Aug 28 09:36:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ebe2ed6a-3fe9-4345-bb52-cacd28f7ad0e tempest-VolumesExtendTest-598381877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.266s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:36:22 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-ebe2ed6a-3fe9-4345-bb52-cacd28f7ad0e tempest-VolumesExtendTest-598381877 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:36:22 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-ebe2ed6a-3fe9-4345-bb52-cacd28f7ad0e tempest-VolumesExtendTest-598381877 None] Deleted volume successfully. Aug 28 09:36:22 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ebe2ed6a-3fe9-4345-bb52-cacd28f7ad0e tempest-VolumesExtendTest-598381877 None] Lock "cinder-ccd52bf5-6171-4c16-8cef-13db0a50bd59-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:36:26 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f9ae99d-68f4-408a-b186-b941b848afdc tempest-VolumesNegativeTest-1450050196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:36:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8f9ae99d-68f4-408a-b186-b941b848afdc tempest-VolumesNegativeTest-1450050196 None] Flow 'volume_create_manager' (0854bb8a-2c9c-499e-b60e-8022f07c961a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:36:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8f9ae99d-68f4-408a-b186-b941b848afdc tempest-VolumesNegativeTest-1450050196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02a0f5eb-018d-4aad-a9e1-b8409763757a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:36:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8f9ae99d-68f4-408a-b186-b941b848afdc tempest-VolumesNegativeTest-1450050196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02a0f5eb-018d-4aad-a9e1-b8409763757a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1129135683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5674079-63dd-4f82-8f4f-950ab2ec9dbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='619de053e1f04b7db52c567db0f647cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:36:26Z,use_quota=True,user_id='713cfccb8ffd4becae520c05d4733e2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:36:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8f9ae99d-68f4-408a-b186-b941b848afdc tempest-VolumesNegativeTest-1450050196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85c462fa-baf1-44c7-9b39-df3510dff4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:36:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8f9ae99d-68f4-408a-b186-b941b848afdc tempest-VolumesNegativeTest-1450050196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85c462fa-baf1-44c7-9b39-df3510dff4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:36:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8f9ae99d-68f4-408a-b186-b941b848afdc tempest-VolumesNegativeTest-1450050196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1d32718-89f9-4311-872c-7e7d4125d44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:36:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8f9ae99d-68f4-408a-b186-b941b848afdc tempest-VolumesNegativeTest-1450050196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1d32718-89f9-4311-872c-7e7d4125d44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5674079-63dd-4f82-8f4f-950ab2ec9dbe', 'volume_name': 'volume-b5674079-63dd-4f82-8f4f-950ab2ec9dbe', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:36:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8f9ae99d-68f4-408a-b186-b941b848afdc tempest-VolumesNegativeTest-1450050196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (824aee78-77ac-496c-81cd-5bcd3a3be84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:36:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8f9ae99d-68f4-408a-b186-b941b848afdc tempest-VolumesNegativeTest-1450050196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (824aee78-77ac-496c-81cd-5bcd3a3be84c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:36:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8f9ae99d-68f4-408a-b186-b941b848afdc tempest-VolumesNegativeTest-1450050196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc5cc96a-1bf1-44b0-9527-4244092d2a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:36:26 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-8f9ae99d-68f4-408a-b186-b941b848afdc tempest-VolumesNegativeTest-1450050196 None] Volume b5674079-63dd-4f82-8f4f-950ab2ec9dbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5674079-63dd-4f82-8f4f-950ab2ec9dbe', 'volume_size': 1} Aug 28 09:36:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8f9ae99d-68f4-408a-b186-b941b848afdc tempest-VolumesNegativeTest-1450050196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:36:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8f9ae99d-68f4-408a-b186-b941b848afdc tempest-VolumesNegativeTest-1450050196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:36:26 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-8f9ae99d-68f4-408a-b186-b941b848afdc tempest-VolumesNegativeTest-1450050196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1129135683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5674079-63dd-4f82-8f4f-950ab2ec9dbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='619de053e1f04b7db52c567db0f647cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:36:26Z,use_quota=True,user_id='713cfccb8ffd4becae520c05d4733e2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:36:26 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-8f9ae99d-68f4-408a-b186-b941b848afdc tempest-VolumesNegativeTest-1450050196 None] Creating volume b5674079-63dd-4f82-8f4f-950ab2ec9dbe {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:36:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8f9ae99d-68f4-408a-b186-b941b848afdc tempest-VolumesNegativeTest-1450050196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:36:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8f9ae99d-68f4-408a-b186-b941b848afdc tempest-VolumesNegativeTest-1450050196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:36:26 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-8f9ae99d-68f4-408a-b186-b941b848afdc tempest-VolumesNegativeTest-1450050196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:36:26 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-8f9ae99d-68f4-408a-b186-b941b848afdc tempest-VolumesNegativeTest-1450050196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:36:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8f9ae99d-68f4-408a-b186-b941b848afdc tempest-VolumesNegativeTest-1450050196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:36:26 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-8f9ae99d-68f4-408a-b186-b941b848afdc tempest-VolumesNegativeTest-1450050196 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:36:26 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-8f9ae99d-68f4-408a-b186-b941b848afdc tempest-VolumesNegativeTest-1450050196 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:36:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8f9ae99d-68f4-408a-b186-b941b848afdc tempest-VolumesNegativeTest-1450050196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b5674079-63dd-4f82-8f4f-950ab2ec9dbe 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:36:26 devstack sudo[93404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b5674079-63dd-4f82-8f4f-950ab2ec9dbe 1073741824 Aug 28 09:36:26 devstack sudo[93404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:36:26 devstack sudo[93404]: pam_unix(sudo:session): session closed for user root Aug 28 09:36:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8f9ae99d-68f4-408a-b186-b941b848afdc tempest-VolumesNegativeTest-1450050196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b5674079-63dd-4f82-8f4f-950ab2ec9dbe 1073741824" returned: 0 in 0.458s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:36:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8f9ae99d-68f4-408a-b186-b941b848afdc tempest-VolumesNegativeTest-1450050196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b5674079-63dd-4f82-8f4f-950ab2ec9dbe {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:36:26 devstack sudo[93411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b5674079-63dd-4f82-8f4f-950ab2ec9dbe Aug 28 09:36:26 devstack sudo[93411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:36:27 devstack sudo[93411]: pam_unix(sudo:session): session closed for user root Aug 28 09:36:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8f9ae99d-68f4-408a-b186-b941b848afdc tempest-VolumesNegativeTest-1450050196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b5674079-63dd-4f82-8f4f-950ab2ec9dbe" returned: 0 in 0.270s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:36:27 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-8f9ae99d-68f4-408a-b186-b941b848afdc tempest-VolumesNegativeTest-1450050196 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:36:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8f9ae99d-68f4-408a-b186-b941b848afdc tempest-VolumesNegativeTest-1450050196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:36:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8f9ae99d-68f4-408a-b186-b941b848afdc tempest-VolumesNegativeTest-1450050196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc5cc96a-1bf1-44b0-9527-4244092d2a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5674079-63dd-4f82-8f4f-950ab2ec9dbe', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:36:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8f9ae99d-68f4-408a-b186-b941b848afdc tempest-VolumesNegativeTest-1450050196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89c44640-1a82-4c33-ace0-0524c8a72f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:36:27 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-8f9ae99d-68f4-408a-b186-b941b848afdc tempest-VolumesNegativeTest-1450050196 None] Volume volume-b5674079-63dd-4f82-8f4f-950ab2ec9dbe (b5674079-63dd-4f82-8f4f-950ab2ec9dbe): created successfully Aug 28 09:36:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8f9ae99d-68f4-408a-b186-b941b848afdc tempest-VolumesNegativeTest-1450050196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89c44640-1a82-4c33-ace0-0524c8a72f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:36:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8f9ae99d-68f4-408a-b186-b941b848afdc tempest-VolumesNegativeTest-1450050196 None] Flow 'volume_create_manager' (0854bb8a-2c9c-499e-b60e-8022f07c961a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:36:27 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-8f9ae99d-68f4-408a-b186-b941b848afdc tempest-VolumesNegativeTest-1450050196 None] Created volume successfully. Aug 28 09:36:27 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-c67026a4-4929-47a0-b275-c61467872110 tempest-AttachVolumeShelveTestJSON-186225897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:36:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-c67026a4-4929-47a0-b275-c61467872110 tempest-AttachVolumeShelveTestJSON-186225897 None] Flow 'volume_create_manager' (ff1febfa-3206-433e-bcfb-b3c91b20d6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:36:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-c67026a4-4929-47a0-b275-c61467872110 tempest-AttachVolumeShelveTestJSON-186225897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b42435ec-fb1c-4122-9479-3cdad62905cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:36:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-c67026a4-4929-47a0-b275-c61467872110 tempest-AttachVolumeShelveTestJSON-186225897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b42435ec-fb1c-4122-9479-3cdad62905cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2111691573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b705e164-6d45-4d4e-ab1c-2609ec3e58fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cefd5afef22469cb0b1e749dbdf3fa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:36:27Z,use_quota=True,user_id='f0991fa92063447daff5d6222d1c1813',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:36:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-c67026a4-4929-47a0-b275-c61467872110 tempest-AttachVolumeShelveTestJSON-186225897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eee193f-c24d-4c74-bbae-d57b9be431ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:36:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-c67026a4-4929-47a0-b275-c61467872110 tempest-AttachVolumeShelveTestJSON-186225897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eee193f-c24d-4c74-bbae-d57b9be431ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:36:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-c67026a4-4929-47a0-b275-c61467872110 tempest-AttachVolumeShelveTestJSON-186225897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93a812f5-1ffb-46d6-9523-d939e41e9f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:36:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-c67026a4-4929-47a0-b275-c61467872110 tempest-AttachVolumeShelveTestJSON-186225897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93a812f5-1ffb-46d6-9523-d939e41e9f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b705e164-6d45-4d4e-ab1c-2609ec3e58fd', 'volume_name': 'volume-b705e164-6d45-4d4e-ab1c-2609ec3e58fd', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:36:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-c67026a4-4929-47a0-b275-c61467872110 tempest-AttachVolumeShelveTestJSON-186225897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f2a9133-d44d-4223-85e5-951736b91302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:36:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-c67026a4-4929-47a0-b275-c61467872110 tempest-AttachVolumeShelveTestJSON-186225897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f2a9133-d44d-4223-85e5-951736b91302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:36:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-c67026a4-4929-47a0-b275-c61467872110 tempest-AttachVolumeShelveTestJSON-186225897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3e547bd-231e-40b1-9c2c-8a3c013fb399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:36:27 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-c67026a4-4929-47a0-b275-c61467872110 tempest-AttachVolumeShelveTestJSON-186225897 None] Volume b705e164-6d45-4d4e-ab1c-2609ec3e58fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b705e164-6d45-4d4e-ab1c-2609ec3e58fd', 'volume_size': 1} Aug 28 09:36:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-c67026a4-4929-47a0-b275-c61467872110 tempest-AttachVolumeShelveTestJSON-186225897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:36:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-c67026a4-4929-47a0-b275-c61467872110 tempest-AttachVolumeShelveTestJSON-186225897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:36:27 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-c67026a4-4929-47a0-b275-c61467872110 tempest-AttachVolumeShelveTestJSON-186225897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2111691573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b705e164-6d45-4d4e-ab1c-2609ec3e58fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cefd5afef22469cb0b1e749dbdf3fa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:36:27Z,use_quota=True,user_id='f0991fa92063447daff5d6222d1c1813',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:36:27 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-c67026a4-4929-47a0-b275-c61467872110 tempest-AttachVolumeShelveTestJSON-186225897 None] Creating volume b705e164-6d45-4d4e-ab1c-2609ec3e58fd {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:36:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-c67026a4-4929-47a0-b275-c61467872110 tempest-AttachVolumeShelveTestJSON-186225897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:36:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-c67026a4-4929-47a0-b275-c61467872110 tempest-AttachVolumeShelveTestJSON-186225897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:36:27 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-c67026a4-4929-47a0-b275-c61467872110 tempest-AttachVolumeShelveTestJSON-186225897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:36:27 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-c67026a4-4929-47a0-b275-c61467872110 tempest-AttachVolumeShelveTestJSON-186225897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:36:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-c67026a4-4929-47a0-b275-c61467872110 tempest-AttachVolumeShelveTestJSON-186225897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:36:27 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-c67026a4-4929-47a0-b275-c61467872110 tempest-AttachVolumeShelveTestJSON-186225897 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:36:27 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-c67026a4-4929-47a0-b275-c61467872110 tempest-AttachVolumeShelveTestJSON-186225897 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:36:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c67026a4-4929-47a0-b275-c61467872110 tempest-AttachVolumeShelveTestJSON-186225897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b705e164-6d45-4d4e-ab1c-2609ec3e58fd 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:36:27 devstack sudo[93430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b705e164-6d45-4d4e-ab1c-2609ec3e58fd 1073741824 Aug 28 09:36:27 devstack sudo[93430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:36:28 devstack sudo[93430]: pam_unix(sudo:session): session closed for user root Aug 28 09:36:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c67026a4-4929-47a0-b275-c61467872110 tempest-AttachVolumeShelveTestJSON-186225897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b705e164-6d45-4d4e-ab1c-2609ec3e58fd 1073741824" returned: 0 in 0.446s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:36:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c67026a4-4929-47a0-b275-c61467872110 tempest-AttachVolumeShelveTestJSON-186225897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b705e164-6d45-4d4e-ab1c-2609ec3e58fd {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:36:28 devstack sudo[93440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b705e164-6d45-4d4e-ab1c-2609ec3e58fd Aug 28 09:36:28 devstack sudo[93440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:36:28 devstack sudo[93440]: pam_unix(sudo:session): session closed for user root Aug 28 09:36:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c67026a4-4929-47a0-b275-c61467872110 tempest-AttachVolumeShelveTestJSON-186225897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b705e164-6d45-4d4e-ab1c-2609ec3e58fd" returned: 0 in 0.265s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:36:28 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-c67026a4-4929-47a0-b275-c61467872110 tempest-AttachVolumeShelveTestJSON-186225897 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:36:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-c67026a4-4929-47a0-b275-c61467872110 tempest-AttachVolumeShelveTestJSON-186225897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:36:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-c67026a4-4929-47a0-b275-c61467872110 tempest-AttachVolumeShelveTestJSON-186225897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3e547bd-231e-40b1-9c2c-8a3c013fb399) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b705e164-6d45-4d4e-ab1c-2609ec3e58fd', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:36:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-c67026a4-4929-47a0-b275-c61467872110 tempest-AttachVolumeShelveTestJSON-186225897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea9041c3-b853-412a-8c90-e9393ba5a591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:36:28 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-c67026a4-4929-47a0-b275-c61467872110 tempest-AttachVolumeShelveTestJSON-186225897 None] Volume volume-b705e164-6d45-4d4e-ab1c-2609ec3e58fd (b705e164-6d45-4d4e-ab1c-2609ec3e58fd): created successfully Aug 28 09:36:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-c67026a4-4929-47a0-b275-c61467872110 tempest-AttachVolumeShelveTestJSON-186225897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea9041c3-b853-412a-8c90-e9393ba5a591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:36:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-c67026a4-4929-47a0-b275-c61467872110 tempest-AttachVolumeShelveTestJSON-186225897 None] Flow 'volume_create_manager' (ff1febfa-3206-433e-bcfb-b3c91b20d6e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:36:28 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-c67026a4-4929-47a0-b275-c61467872110 tempest-AttachVolumeShelveTestJSON-186225897 None] Created volume successfully. Aug 28 09:36:35 devstack cinder-volume[86081]: INFO cinder.volume.manager [req-573ad069-b702-4cab-9126-8469fe61941d req-d3d03eb6-1d25-427c-b3d8-79bca35d22dd tempest-AttachVolumeTestJSON-601093567 None] Terminate volume connection completed successfully. Aug 28 09:36:35 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-573ad069-b702-4cab-9126-8469fe61941d req-d3d03eb6-1d25-427c-b3d8-79bca35d22dd tempest-AttachVolumeTestJSON-601093567 None] Deleting attachment 02f71485-bbc3-464b-b9dc-77724bb82c11. {{(pid=86081) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 09:36:38 devstack cinder-volume[86081]: DEBUG oslo_service.periodic_task [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86081) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:36:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:36:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:36:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:36:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:36:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:36:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:36:38 devstack sudo[93583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:36:38 devstack sudo[93583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:36:38 devstack sudo[93583]: pam_unix(sudo:session): session closed for user root Aug 28 09:36:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.436s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:36:38 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:36:38 devstack cinder-volume[86081]: DEBUG oslo_service.periodic_task [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running periodic task VolumeManager._thread_info {{(pid=86081) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:36:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] thread count: 28 {{(pid=86081) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 09:36:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] thread info: [<_MainThread(MainThread, started 129914189705344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86081) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 09:36:42 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-5c80ddb5-a15e-47a2-91a5-bcf852cd347c req-24a2353e-30c8-4466-a544-3a287c1a237a tempest-AttachVolumeShelveTestJSON-186225897 None] No connector for attachment 76791f87-fea4-40df-873e-c52a5cbbe47c; skipping storage backend terminate_connection call. {{(pid=86081) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Aug 28 09:36:42 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-5c80ddb5-a15e-47a2-91a5-bcf852cd347c req-24a2353e-30c8-4466-a544-3a287c1a237a tempest-AttachVolumeShelveTestJSON-186225897 None] Deleting attachment 76791f87-fea4-40df-873e-c52a5cbbe47c. {{(pid=86081) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 09:36:46 devstack cinder-volume[86081]: INFO cinder.volume.manager [req-a2b9cd6e-3a5c-49df-8e6e-7071599feb67 req-6f424ede-3d9a-48d5-ba3f-b23acd05d6ba tempest-AttachVolumeNegativeTest-1867820442 None] Terminate volume connection completed successfully. Aug 28 09:36:46 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-a2b9cd6e-3a5c-49df-8e6e-7071599feb67 req-6f424ede-3d9a-48d5-ba3f-b23acd05d6ba tempest-AttachVolumeNegativeTest-1867820442 None] Deleting attachment 0794edab-6953-4fc6-81cf-0103db74ea65. {{(pid=86081) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 09:36:52 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-d5de3a2b-e557-43c8-aeac-0c60acec58bc tempest-VolumesNegativeTest-1450050196 None] Acquiring lock "cinder-b5674079-63dd-4f82-8f4f-950ab2ec9dbe-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:36:52 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-d5de3a2b-e557-43c8-aeac-0c60acec58bc tempest-VolumesNegativeTest-1450050196 None] Lock "cinder-b5674079-63dd-4f82-8f4f-950ab2ec9dbe-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:36:52 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-d5de3a2b-e557-43c8-aeac-0c60acec58bc tempest-VolumesNegativeTest-1450050196 None] Acquiring lock "cinder-quobyte-b5674079-63dd-4f82-8f4f-950ab2ec9dbe" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:36:52 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-d5de3a2b-e557-43c8-aeac-0c60acec58bc tempest-VolumesNegativeTest-1450050196 None] Lock "cinder-quobyte-b5674079-63dd-4f82-8f4f-950ab2ec9dbe" acquired by "delete_volume" :: waited 0.036s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:36:52 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a6716d-c610-4c42-8849-da1145d6aec1]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:36:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d5de3a2b-e557-43c8-aeac-0c60acec58bc tempest-VolumesNegativeTest-1450050196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b5674079-63dd-4f82-8f4f-950ab2ec9dbe {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:36:52 devstack sudo[93767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b5674079-63dd-4f82-8f4f-950ab2ec9dbe Aug 28 09:36:52 devstack sudo[93767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:36:52 devstack sudo[93767]: pam_unix(sudo:session): session closed for user root Aug 28 09:36:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d5de3a2b-e557-43c8-aeac-0c60acec58bc tempest-VolumesNegativeTest-1450050196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b5674079-63dd-4f82-8f4f-950ab2ec9dbe" returned: 0 in 0.643s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:36:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d5de3a2b-e557-43c8-aeac-0c60acec58bc tempest-VolumesNegativeTest-1450050196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b5674079-63dd-4f82-8f4f-950ab2ec9dbe {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:36:52 devstack sudo[93782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b5674079-63dd-4f82-8f4f-950ab2ec9dbe Aug 28 09:36:52 devstack sudo[93782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:36:53 devstack sudo[93782]: pam_unix(sudo:session): session closed for user root Aug 28 09:36:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d5de3a2b-e557-43c8-aeac-0c60acec58bc tempest-VolumesNegativeTest-1450050196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b5674079-63dd-4f82-8f4f-950ab2ec9dbe" returned: 0 in 0.360s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:36:53 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-d5de3a2b-e557-43c8-aeac-0c60acec58bc tempest-VolumesNegativeTest-1450050196 None] Lock "cinder-quobyte-b5674079-63dd-4f82-8f4f-950ab2ec9dbe" released by "delete_volume" :: held 1.074s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:36:53 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-d5de3a2b-e557-43c8-aeac-0c60acec58bc tempest-VolumesNegativeTest-1450050196 None] Created reservations ['205b9f8b-cc8b-459a-8b86-bf5a3d6b9208', '425879df-7a04-4ff1-99f8-f3601ec50409', 'a0c49596-ce9e-4e64-b048-f18ced5cb83a', '2b6624c1-7de0-4f89-a9ac-aa07fc88ef1c'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:36:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-d5de3a2b-e557-43c8-aeac-0c60acec58bc tempest-VolumesNegativeTest-1450050196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:36:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-d5de3a2b-e557-43c8-aeac-0c60acec58bc tempest-VolumesNegativeTest-1450050196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:36:53 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-d5de3a2b-e557-43c8-aeac-0c60acec58bc tempest-VolumesNegativeTest-1450050196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:36:53 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-d5de3a2b-e557-43c8-aeac-0c60acec58bc tempest-VolumesNegativeTest-1450050196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:36:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-d5de3a2b-e557-43c8-aeac-0c60acec58bc tempest-VolumesNegativeTest-1450050196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:36:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d5de3a2b-e557-43c8-aeac-0c60acec58bc tempest-VolumesNegativeTest-1450050196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:36:53 devstack sudo[93803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:36:53 devstack sudo[93803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:36:53 devstack sudo[93803]: pam_unix(sudo:session): session closed for user root Aug 28 09:36:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d5de3a2b-e557-43c8-aeac-0c60acec58bc tempest-VolumesNegativeTest-1450050196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.378s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:36:53 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-d5de3a2b-e557-43c8-aeac-0c60acec58bc tempest-VolumesNegativeTest-1450050196 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:36:53 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-d5de3a2b-e557-43c8-aeac-0c60acec58bc tempest-VolumesNegativeTest-1450050196 None] Deleted volume successfully. Aug 28 09:36:54 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-d5de3a2b-e557-43c8-aeac-0c60acec58bc tempest-VolumesNegativeTest-1450050196 None] Lock "cinder-b5674079-63dd-4f82-8f4f-950ab2ec9dbe-delete_volume" released by "delete_volume" :: held 1.980s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:37:03 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writing DB stats cinder:SELECT=33,cinder:UPDATE=35,cinder:INSERT=6 {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:37:03 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writing DB stats cinder:UPDATE=34,cinder:DELETE=6,cinder:SELECT=25,cinder:INSERT=9 {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:37:29 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-301cb999-8b0c-4741-99c6-2bffdeb16c83 tempest-AttachVolumeShelveTestJSON-186225897 None] Acquiring lock "cinder-b705e164-6d45-4d4e-ab1c-2609ec3e58fd-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:37:29 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-301cb999-8b0c-4741-99c6-2bffdeb16c83 tempest-AttachVolumeShelveTestJSON-186225897 None] Lock "cinder-b705e164-6d45-4d4e-ab1c-2609ec3e58fd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:37:29 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-301cb999-8b0c-4741-99c6-2bffdeb16c83 tempest-AttachVolumeShelveTestJSON-186225897 None] Acquiring lock "cinder-quobyte-b705e164-6d45-4d4e-ab1c-2609ec3e58fd" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:37:29 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-301cb999-8b0c-4741-99c6-2bffdeb16c83 tempest-AttachVolumeShelveTestJSON-186225897 None] Lock "cinder-quobyte-b705e164-6d45-4d4e-ab1c-2609ec3e58fd" acquired by "delete_volume" :: waited 0.026s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:37:29 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7a6ef9-e919-45a5-bb7a-5ed532721a8a]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:37:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-301cb999-8b0c-4741-99c6-2bffdeb16c83 tempest-AttachVolumeShelveTestJSON-186225897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b705e164-6d45-4d4e-ab1c-2609ec3e58fd {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:37:30 devstack sudo[94211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b705e164-6d45-4d4e-ab1c-2609ec3e58fd Aug 28 09:37:30 devstack sudo[94211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:37:30 devstack sudo[94211]: pam_unix(sudo:session): session closed for user root Aug 28 09:37:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-301cb999-8b0c-4741-99c6-2bffdeb16c83 tempest-AttachVolumeShelveTestJSON-186225897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b705e164-6d45-4d4e-ab1c-2609ec3e58fd" returned: 0 in 0.411s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:37:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-301cb999-8b0c-4741-99c6-2bffdeb16c83 tempest-AttachVolumeShelveTestJSON-186225897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b705e164-6d45-4d4e-ab1c-2609ec3e58fd {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:37:30 devstack sudo[94216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b705e164-6d45-4d4e-ab1c-2609ec3e58fd Aug 28 09:37:30 devstack sudo[94216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:37:30 devstack sudo[94216]: pam_unix(sudo:session): session closed for user root Aug 28 09:37:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-301cb999-8b0c-4741-99c6-2bffdeb16c83 tempest-AttachVolumeShelveTestJSON-186225897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b705e164-6d45-4d4e-ab1c-2609ec3e58fd" returned: 0 in 0.273s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:37:30 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-301cb999-8b0c-4741-99c6-2bffdeb16c83 tempest-AttachVolumeShelveTestJSON-186225897 None] Lock "cinder-quobyte-b705e164-6d45-4d4e-ab1c-2609ec3e58fd" released by "delete_volume" :: held 0.741s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:37:30 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-301cb999-8b0c-4741-99c6-2bffdeb16c83 tempest-AttachVolumeShelveTestJSON-186225897 None] Created reservations ['4ee5779d-942f-4687-99a6-1ef51abeff7f', '681ac324-9c39-438f-a5f6-7d55c96748d9', '6c5dcd40-95c2-4709-ab7e-42c676a600d9', '6475a23b-e5cd-4e12-a15a-23b3365d01d0'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:37:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-301cb999-8b0c-4741-99c6-2bffdeb16c83 tempest-AttachVolumeShelveTestJSON-186225897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:37:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-301cb999-8b0c-4741-99c6-2bffdeb16c83 tempest-AttachVolumeShelveTestJSON-186225897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:37:30 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-301cb999-8b0c-4741-99c6-2bffdeb16c83 tempest-AttachVolumeShelveTestJSON-186225897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:37:30 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-301cb999-8b0c-4741-99c6-2bffdeb16c83 tempest-AttachVolumeShelveTestJSON-186225897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:37:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-301cb999-8b0c-4741-99c6-2bffdeb16c83 tempest-AttachVolumeShelveTestJSON-186225897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:37:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-301cb999-8b0c-4741-99c6-2bffdeb16c83 tempest-AttachVolumeShelveTestJSON-186225897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:37:30 devstack sudo[94220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:37:30 devstack sudo[94220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:37:31 devstack sudo[94220]: pam_unix(sudo:session): session closed for user root Aug 28 09:37:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-301cb999-8b0c-4741-99c6-2bffdeb16c83 tempest-AttachVolumeShelveTestJSON-186225897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.290s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:37:31 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-301cb999-8b0c-4741-99c6-2bffdeb16c83 tempest-AttachVolumeShelveTestJSON-186225897 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:37:31 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-301cb999-8b0c-4741-99c6-2bffdeb16c83 tempest-AttachVolumeShelveTestJSON-186225897 None] Deleted volume successfully. Aug 28 09:37:31 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-301cb999-8b0c-4741-99c6-2bffdeb16c83 tempest-AttachVolumeShelveTestJSON-186225897 None] Lock "cinder-b705e164-6d45-4d4e-ab1c-2609ec3e58fd-delete_volume" released by "delete_volume" :: held 1.335s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:37:32 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-85adade5-65eb-43d2-9f77-db36d457883c tempest-TestInstancesWithCinderVolumes-726122166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:37:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-85adade5-65eb-43d2-9f77-db36d457883c tempest-TestInstancesWithCinderVolumes-726122166 None] Flow 'volume_create_manager' (8c9f7117-26cc-4f39-890c-219aa3bb38a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:37:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-85adade5-65eb-43d2-9f77-db36d457883c tempest-TestInstancesWithCinderVolumes-726122166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a2c2d8c-3cd4-4e8c-ac96-a8f4ab27a98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:37:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-85adade5-65eb-43d2-9f77-db36d457883c tempest-TestInstancesWithCinderVolumes-726122166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a2c2d8c-3cd4-4e8c-ac96-a8f4ab27a98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1151227475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b456b25-c720-412f-a299-fbb9ad5db242,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66704002cb684d12a8e442146089126e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:37:32Z,use_quota=True,user_id='9cc7df3a343e441dab998f1426b383d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f19aa456-6b2c-47ed-b745-f3a0be5a9da9),volume_type_id=f19aa456-6b2c-47ed-b745-f3a0be5a9da9)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:37:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-85adade5-65eb-43d2-9f77-db36d457883c tempest-TestInstancesWithCinderVolumes-726122166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba22bba9-efb2-4785-80f1-61374f365332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:37:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-85adade5-65eb-43d2-9f77-db36d457883c tempest-TestInstancesWithCinderVolumes-726122166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba22bba9-efb2-4785-80f1-61374f365332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:37:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-85adade5-65eb-43d2-9f77-db36d457883c tempest-TestInstancesWithCinderVolumes-726122166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b49034e3-637c-46ef-ad74-de25fb6948c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:37:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-85adade5-65eb-43d2-9f77-db36d457883c tempest-TestInstancesWithCinderVolumes-726122166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b49034e3-637c-46ef-ad74-de25fb6948c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b456b25-c720-412f-a299-fbb9ad5db242', 'volume_name': 'volume-8b456b25-c720-412f-a299-fbb9ad5db242', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:37:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-85adade5-65eb-43d2-9f77-db36d457883c tempest-TestInstancesWithCinderVolumes-726122166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7287ebd-e68c-44f8-82f8-12887e8afaf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:37:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-85adade5-65eb-43d2-9f77-db36d457883c tempest-TestInstancesWithCinderVolumes-726122166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7287ebd-e68c-44f8-82f8-12887e8afaf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:37:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-85adade5-65eb-43d2-9f77-db36d457883c tempest-TestInstancesWithCinderVolumes-726122166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39d7e1b0-b301-41b8-8421-6f583bf3250b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:37:32 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-85adade5-65eb-43d2-9f77-db36d457883c tempest-TestInstancesWithCinderVolumes-726122166 None] Volume 8b456b25-c720-412f-a299-fbb9ad5db242: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b456b25-c720-412f-a299-fbb9ad5db242', 'volume_size': 1} Aug 28 09:37:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-85adade5-65eb-43d2-9f77-db36d457883c tempest-TestInstancesWithCinderVolumes-726122166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:37:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-85adade5-65eb-43d2-9f77-db36d457883c tempest-TestInstancesWithCinderVolumes-726122166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:37:32 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-85adade5-65eb-43d2-9f77-db36d457883c tempest-TestInstancesWithCinderVolumes-726122166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1151227475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b456b25-c720-412f-a299-fbb9ad5db242,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66704002cb684d12a8e442146089126e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:37:32Z,use_quota=True,user_id='9cc7df3a343e441dab998f1426b383d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f19aa456-6b2c-47ed-b745-f3a0be5a9da9),volume_type_id=f19aa456-6b2c-47ed-b745-f3a0be5a9da9)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:37:32 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-85adade5-65eb-43d2-9f77-db36d457883c tempest-TestInstancesWithCinderVolumes-726122166 None] Creating volume 8b456b25-c720-412f-a299-fbb9ad5db242 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:37:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-85adade5-65eb-43d2-9f77-db36d457883c tempest-TestInstancesWithCinderVolumes-726122166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:37:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-85adade5-65eb-43d2-9f77-db36d457883c tempest-TestInstancesWithCinderVolumes-726122166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:37:32 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-85adade5-65eb-43d2-9f77-db36d457883c tempest-TestInstancesWithCinderVolumes-726122166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:37:32 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-85adade5-65eb-43d2-9f77-db36d457883c tempest-TestInstancesWithCinderVolumes-726122166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:37:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-85adade5-65eb-43d2-9f77-db36d457883c tempest-TestInstancesWithCinderVolumes-726122166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:37:32 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-85adade5-65eb-43d2-9f77-db36d457883c tempest-TestInstancesWithCinderVolumes-726122166 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:37:32 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-85adade5-65eb-43d2-9f77-db36d457883c tempest-TestInstancesWithCinderVolumes-726122166 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:37:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-85adade5-65eb-43d2-9f77-db36d457883c tempest-TestInstancesWithCinderVolumes-726122166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8b456b25-c720-412f-a299-fbb9ad5db242 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:37:32 devstack sudo[94228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8b456b25-c720-412f-a299-fbb9ad5db242 1073741824 Aug 28 09:37:32 devstack sudo[94228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:37:32 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dc1fe0b-6c6c-4753-a5f3-3c6dd16bff2b tempest-AttachVolumeNegativeTest-1867820442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:37:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7dc1fe0b-6c6c-4753-a5f3-3c6dd16bff2b tempest-AttachVolumeNegativeTest-1867820442 None] Flow 'volume_create_manager' (5147b530-3a48-41ed-8091-f1174c53c6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:37:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7dc1fe0b-6c6c-4753-a5f3-3c6dd16bff2b tempest-AttachVolumeNegativeTest-1867820442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe243746-e94e-4570-a616-825769398180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:37:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7dc1fe0b-6c6c-4753-a5f3-3c6dd16bff2b tempest-AttachVolumeNegativeTest-1867820442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe243746-e94e-4570-a616-825769398180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-990140877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbcb6c36-88c1-4f50-be13-5725ec76e44a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44a80d5e47094bc58d0bce329e32f15e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:37:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:37:33Z,use_quota=True,user_id='74867e4ae611477aa97b45f6b6fb70b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:37:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7dc1fe0b-6c6c-4753-a5f3-3c6dd16bff2b tempest-AttachVolumeNegativeTest-1867820442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beec8030-5037-4242-84f0-6174102eedb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:37:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7dc1fe0b-6c6c-4753-a5f3-3c6dd16bff2b tempest-AttachVolumeNegativeTest-1867820442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beec8030-5037-4242-84f0-6174102eedb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:37:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7dc1fe0b-6c6c-4753-a5f3-3c6dd16bff2b tempest-AttachVolumeNegativeTest-1867820442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ed32f12-7c82-478a-98a1-9df329d3bc77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:37:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7dc1fe0b-6c6c-4753-a5f3-3c6dd16bff2b tempest-AttachVolumeNegativeTest-1867820442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ed32f12-7c82-478a-98a1-9df329d3bc77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbcb6c36-88c1-4f50-be13-5725ec76e44a', 'volume_name': 'volume-dbcb6c36-88c1-4f50-be13-5725ec76e44a', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:37:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7dc1fe0b-6c6c-4753-a5f3-3c6dd16bff2b tempest-AttachVolumeNegativeTest-1867820442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0c7db1b-2df1-469a-b997-ead6628afd82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:37:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7dc1fe0b-6c6c-4753-a5f3-3c6dd16bff2b tempest-AttachVolumeNegativeTest-1867820442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0c7db1b-2df1-469a-b997-ead6628afd82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:37:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7dc1fe0b-6c6c-4753-a5f3-3c6dd16bff2b tempest-AttachVolumeNegativeTest-1867820442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd3a84ec-e9c4-4be5-8e1e-2fcd669df8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:37:33 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-7dc1fe0b-6c6c-4753-a5f3-3c6dd16bff2b tempest-AttachVolumeNegativeTest-1867820442 None] Volume dbcb6c36-88c1-4f50-be13-5725ec76e44a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbcb6c36-88c1-4f50-be13-5725ec76e44a', 'volume_size': 1} Aug 28 09:37:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-7dc1fe0b-6c6c-4753-a5f3-3c6dd16bff2b tempest-AttachVolumeNegativeTest-1867820442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:37:33 devstack sudo[94228]: pam_unix(sudo:session): session closed for user root Aug 28 09:37:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-85adade5-65eb-43d2-9f77-db36d457883c tempest-TestInstancesWithCinderVolumes-726122166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8b456b25-c720-412f-a299-fbb9ad5db242 1073741824" returned: 0 in 0.772s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:37:33 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3c34c06-4066-430b-bb08-4babaa5a8192 tempest-TestInstancesWithCinderVolumes-726122166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:37:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f3c34c06-4066-430b-bb08-4babaa5a8192 tempest-TestInstancesWithCinderVolumes-726122166 None] Flow 'volume_create_manager' (824998a4-af8a-45b6-907c-0cea77190213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:37:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f3c34c06-4066-430b-bb08-4babaa5a8192 tempest-TestInstancesWithCinderVolumes-726122166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (938f261d-4a0c-4333-95d0-f2a9dc66c0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:37:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f3c34c06-4066-430b-bb08-4babaa5a8192 tempest-TestInstancesWithCinderVolumes-726122166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (938f261d-4a0c-4333-95d0-f2a9dc66c0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-701660379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaf631df-7b08-4120-b4bd-71c5a659e9f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66704002cb684d12a8e442146089126e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:37:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:37:33Z,use_quota=True,user_id='9cc7df3a343e441dab998f1426b383d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e7c5cf0-888b-488a-824a-f02a1196ceb2),volume_type_id=8e7c5cf0-888b-488a-824a-f02a1196ceb2)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:37:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f3c34c06-4066-430b-bb08-4babaa5a8192 tempest-TestInstancesWithCinderVolumes-726122166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (719893db-abed-46bf-926f-9e6a5e941f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:37:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f3c34c06-4066-430b-bb08-4babaa5a8192 tempest-TestInstancesWithCinderVolumes-726122166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (719893db-abed-46bf-926f-9e6a5e941f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:37:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f3c34c06-4066-430b-bb08-4babaa5a8192 tempest-TestInstancesWithCinderVolumes-726122166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e81859b-d169-413a-b551-1a482006cd92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:37:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f3c34c06-4066-430b-bb08-4babaa5a8192 tempest-TestInstancesWithCinderVolumes-726122166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e81859b-d169-413a-b551-1a482006cd92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eaf631df-7b08-4120-b4bd-71c5a659e9f2', 'volume_name': 'volume-eaf631df-7b08-4120-b4bd-71c5a659e9f2', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:37:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f3c34c06-4066-430b-bb08-4babaa5a8192 tempest-TestInstancesWithCinderVolumes-726122166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f550efc3-b8b5-4e91-b70b-78d63f0c3ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:37:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f3c34c06-4066-430b-bb08-4babaa5a8192 tempest-TestInstancesWithCinderVolumes-726122166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f550efc3-b8b5-4e91-b70b-78d63f0c3ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:37:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f3c34c06-4066-430b-bb08-4babaa5a8192 tempest-TestInstancesWithCinderVolumes-726122166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e64877e-5fe8-4aac-be56-c5b4e5126c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:37:33 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-f3c34c06-4066-430b-bb08-4babaa5a8192 tempest-TestInstancesWithCinderVolumes-726122166 None] Volume eaf631df-7b08-4120-b4bd-71c5a659e9f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eaf631df-7b08-4120-b4bd-71c5a659e9f2', 'volume_size': 1} Aug 28 09:37:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f3c34c06-4066-430b-bb08-4babaa5a8192 tempest-TestInstancesWithCinderVolumes-726122166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:37:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-85adade5-65eb-43d2-9f77-db36d457883c tempest-TestInstancesWithCinderVolumes-726122166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8b456b25-c720-412f-a299-fbb9ad5db242 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:37:33 devstack sudo[94234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8b456b25-c720-412f-a299-fbb9ad5db242 Aug 28 09:37:33 devstack sudo[94234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:37:34 devstack sudo[94234]: pam_unix(sudo:session): session closed for user root Aug 28 09:37:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-85adade5-65eb-43d2-9f77-db36d457883c tempest-TestInstancesWithCinderVolumes-726122166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8b456b25-c720-412f-a299-fbb9ad5db242" returned: 0 in 0.601s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:37:34 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-85adade5-65eb-43d2-9f77-db36d457883c tempest-TestInstancesWithCinderVolumes-726122166 None] <== create_volume: return (1645ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:37:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-85adade5-65eb-43d2-9f77-db36d457883c tempest-TestInstancesWithCinderVolumes-726122166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.649s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:37:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-7dc1fe0b-6c6c-4753-a5f3-3c6dd16bff2b tempest-AttachVolumeNegativeTest-1867820442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.206s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:37:34 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-7dc1fe0b-6c6c-4753-a5f3-3c6dd16bff2b tempest-AttachVolumeNegativeTest-1867820442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-990140877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbcb6c36-88c1-4f50-be13-5725ec76e44a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44a80d5e47094bc58d0bce329e32f15e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:37:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:37:33Z,use_quota=True,user_id='74867e4ae611477aa97b45f6b6fb70b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:37:34 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-7dc1fe0b-6c6c-4753-a5f3-3c6dd16bff2b tempest-AttachVolumeNegativeTest-1867820442 None] Creating volume dbcb6c36-88c1-4f50-be13-5725ec76e44a {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:37:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-7dc1fe0b-6c6c-4753-a5f3-3c6dd16bff2b tempest-AttachVolumeNegativeTest-1867820442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:37:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-7dc1fe0b-6c6c-4753-a5f3-3c6dd16bff2b tempest-AttachVolumeNegativeTest-1867820442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:37:34 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-7dc1fe0b-6c6c-4753-a5f3-3c6dd16bff2b tempest-AttachVolumeNegativeTest-1867820442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:37:34 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-7dc1fe0b-6c6c-4753-a5f3-3c6dd16bff2b tempest-AttachVolumeNegativeTest-1867820442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:37:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-7dc1fe0b-6c6c-4753-a5f3-3c6dd16bff2b tempest-AttachVolumeNegativeTest-1867820442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:37:34 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-7dc1fe0b-6c6c-4753-a5f3-3c6dd16bff2b tempest-AttachVolumeNegativeTest-1867820442 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:37:34 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-7dc1fe0b-6c6c-4753-a5f3-3c6dd16bff2b tempest-AttachVolumeNegativeTest-1867820442 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:37:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7dc1fe0b-6c6c-4753-a5f3-3c6dd16bff2b tempest-AttachVolumeNegativeTest-1867820442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-dbcb6c36-88c1-4f50-be13-5725ec76e44a 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:37:34 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-85adade5-65eb-43d2-9f77-db36d457883c tempest-TestInstancesWithCinderVolumes-726122166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39d7e1b0-b301-41b8-8421-6f583bf3250b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b456b25-c720-412f-a299-fbb9ad5db242', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:37:34 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-85adade5-65eb-43d2-9f77-db36d457883c tempest-TestInstancesWithCinderVolumes-726122166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7731c3a3-9214-444f-b2ae-a88f33ea0522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:37:34 devstack sudo[94237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-dbcb6c36-88c1-4f50-be13-5725ec76e44a 1073741824 Aug 28 09:37:34 devstack sudo[94237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:37:34 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:37:34 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] Flow 'volume_create_manager' (8771ff76-4d24-4b6d-b416-7832bb90b64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:37:34 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (662bf028-9632-4a10-be94-559597e980db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:37:34 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-85adade5-65eb-43d2-9f77-db36d457883c tempest-TestInstancesWithCinderVolumes-726122166 None] Volume volume-8b456b25-c720-412f-a299-fbb9ad5db242 (8b456b25-c720-412f-a299-fbb9ad5db242): created successfully Aug 28 09:37:34 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-85adade5-65eb-43d2-9f77-db36d457883c tempest-TestInstancesWithCinderVolumes-726122166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7731c3a3-9214-444f-b2ae-a88f33ea0522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:37:34 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-85adade5-65eb-43d2-9f77-db36d457883c tempest-TestInstancesWithCinderVolumes-726122166 None] Flow 'volume_create_manager' (8c9f7117-26cc-4f39-890c-219aa3bb38a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:37:34 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (662bf028-9632-4a10-be94-559597e980db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-705731739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3974ae1a-d297-40ff-accf-d7aaef93f562,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66704002cb684d12a8e442146089126e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:37:34Z,use_quota=True,user_id='9cc7df3a343e441dab998f1426b383d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f3ac4fe-7d22-4f13-8297-bf3bbe0444f6),volume_type_id=3f3ac4fe-7d22-4f13-8297-bf3bbe0444f6)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:37:34 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f869971d-aad3-4a20-b5b9-37e2f8e2539b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:37:34 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f869971d-aad3-4a20-b5b9-37e2f8e2539b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:37:34 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9187d41-8fdb-46e2-93eb-5ae3b01dfada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:37:34 devstack cinder-volume[86081]: DEBUG cinder.image.glance [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] Creating Keystone auth plugin from conf {{(pid=86081) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 28 09:37:34 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-85adade5-65eb-43d2-9f77-db36d457883c tempest-TestInstancesWithCinderVolumes-726122166 None] Created volume successfully. Aug 28 09:37:34 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9187d41-8fdb-46e2-93eb-5ae3b01dfada) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3974ae1a-d297-40ff-accf-d7aaef93f562', 'volume_name': 'volume-3974ae1a-d297-40ff-accf-d7aaef93f562', 'volume_size': 1, 'image_id': '1ec90e0d-ed0b-4525-a46b-75eb86b870df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1ec90e0d-ed0b-4525-a46b-75eb86b870df', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--455446455', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66704002cb684d12a8e442146089126e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1ec90e0d-ed0b-4525-a46b-75eb86b870df', 'created_at': datetime.datetime(2026, 8, 28, 7, 37, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 7, 37, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1ec90e0d-ed0b-4525-a46b-75eb86b870df/file', 'properties': {}}, 'image_service': }' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:37:34 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0958cce-45bf-4238-9712-801dfed0456a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:37:34 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0958cce-45bf-4238-9712-801dfed0456a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:37:34 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e639a221-d089-4d4b-ab22-64e95a45f5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:37:34 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] Volume 3974ae1a-d297-40ff-accf-d7aaef93f562: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3974ae1a-d297-40ff-accf-d7aaef93f562', 'volume_size': 1, 'image_id': '1ec90e0d-ed0b-4525-a46b-75eb86b870df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1ec90e0d-ed0b-4525-a46b-75eb86b870df', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--455446455', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66704002cb684d12a8e442146089126e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1ec90e0d-ed0b-4525-a46b-75eb86b870df', 'created_at': datetime.datetime(2026, 8, 28, 7, 37, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 7, 37, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1ec90e0d-ed0b-4525-a46b-75eb86b870df/file', 'properties': {}}, 'image_service': } Aug 28 09:37:34 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] Trying to clone 3974ae1a-d297-40ff-accf-d7aaef93f562 from image 1ec90e0d-ed0b-4525-a46b-75eb86b870df at location (None, [{'url': 'file:///opt/stack/data/glance/images/1ec90e0d-ed0b-4525-a46b-75eb86b870df', 'metadata': {}}]). {{(pid=86081) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 28 09:37:35 devstack sudo[94237]: pam_unix(sudo:session): session closed for user root Aug 28 09:37:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7dc1fe0b-6c6c-4753-a5f3-3c6dd16bff2b tempest-AttachVolumeNegativeTest-1867820442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-dbcb6c36-88c1-4f50-be13-5725ec76e44a 1073741824" returned: 0 in 0.945s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:37:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7dc1fe0b-6c6c-4753-a5f3-3c6dd16bff2b tempest-AttachVolumeNegativeTest-1867820442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-dbcb6c36-88c1-4f50-be13-5725ec76e44a {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:37:35 devstack sudo[94246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-dbcb6c36-88c1-4f50-be13-5725ec76e44a Aug 28 09:37:35 devstack sudo[94246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:37:35 devstack sudo[94246]: pam_unix(sudo:session): session closed for user root Aug 28 09:37:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7dc1fe0b-6c6c-4753-a5f3-3c6dd16bff2b tempest-AttachVolumeNegativeTest-1867820442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-dbcb6c36-88c1-4f50-be13-5725ec76e44a" returned: 0 in 0.319s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:37:35 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-7dc1fe0b-6c6c-4753-a5f3-3c6dd16bff2b tempest-AttachVolumeNegativeTest-1867820442 None] <== create_volume: return (1344ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:37:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-7dc1fe0b-6c6c-4753-a5f3-3c6dd16bff2b tempest-AttachVolumeNegativeTest-1867820442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.349s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:37:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f3c34c06-4066-430b-bb08-4babaa5a8192 tempest-TestInstancesWithCinderVolumes-726122166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.020s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:37:35 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-f3c34c06-4066-430b-bb08-4babaa5a8192 tempest-TestInstancesWithCinderVolumes-726122166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-701660379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaf631df-7b08-4120-b4bd-71c5a659e9f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66704002cb684d12a8e442146089126e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:37:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:37:33Z,use_quota=True,user_id='9cc7df3a343e441dab998f1426b383d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e7c5cf0-888b-488a-824a-f02a1196ceb2),volume_type_id=8e7c5cf0-888b-488a-824a-f02a1196ceb2)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:37:35 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-f3c34c06-4066-430b-bb08-4babaa5a8192 tempest-TestInstancesWithCinderVolumes-726122166 None] Creating volume eaf631df-7b08-4120-b4bd-71c5a659e9f2 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:37:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f3c34c06-4066-430b-bb08-4babaa5a8192 tempest-TestInstancesWithCinderVolumes-726122166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:37:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f3c34c06-4066-430b-bb08-4babaa5a8192 tempest-TestInstancesWithCinderVolumes-726122166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:37:35 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-f3c34c06-4066-430b-bb08-4babaa5a8192 tempest-TestInstancesWithCinderVolumes-726122166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:37:35 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-f3c34c06-4066-430b-bb08-4babaa5a8192 tempest-TestInstancesWithCinderVolumes-726122166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:37:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f3c34c06-4066-430b-bb08-4babaa5a8192 tempest-TestInstancesWithCinderVolumes-726122166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:37:35 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-f3c34c06-4066-430b-bb08-4babaa5a8192 tempest-TestInstancesWithCinderVolumes-726122166 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:37:35 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-f3c34c06-4066-430b-bb08-4babaa5a8192 tempest-TestInstancesWithCinderVolumes-726122166 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:37:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f3c34c06-4066-430b-bb08-4babaa5a8192 tempest-TestInstancesWithCinderVolumes-726122166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-eaf631df-7b08-4120-b4bd-71c5a659e9f2 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:37:35 devstack sudo[94249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-eaf631df-7b08-4120-b4bd-71c5a659e9f2 1073741824 Aug 28 09:37:35 devstack sudo[94249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:37:35 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7dc1fe0b-6c6c-4753-a5f3-3c6dd16bff2b tempest-AttachVolumeNegativeTest-1867820442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd3a84ec-e9c4-4be5-8e1e-2fcd669df8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbcb6c36-88c1-4f50-be13-5725ec76e44a', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:37:35 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7dc1fe0b-6c6c-4753-a5f3-3c6dd16bff2b tempest-AttachVolumeNegativeTest-1867820442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee002634-fd1f-453a-b11c-37ffa132170d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:37:35 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-7dc1fe0b-6c6c-4753-a5f3-3c6dd16bff2b tempest-AttachVolumeNegativeTest-1867820442 None] Volume volume-dbcb6c36-88c1-4f50-be13-5725ec76e44a (dbcb6c36-88c1-4f50-be13-5725ec76e44a): created successfully Aug 28 09:37:35 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7dc1fe0b-6c6c-4753-a5f3-3c6dd16bff2b tempest-AttachVolumeNegativeTest-1867820442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee002634-fd1f-453a-b11c-37ffa132170d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:37:35 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7dc1fe0b-6c6c-4753-a5f3-3c6dd16bff2b tempest-AttachVolumeNegativeTest-1867820442 None] Flow 'volume_create_manager' (5147b530-3a48-41ed-8091-f1174c53c6db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:37:35 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-7dc1fe0b-6c6c-4753-a5f3-3c6dd16bff2b tempest-AttachVolumeNegativeTest-1867820442 None] Created volume successfully. Aug 28 09:37:36 devstack sudo[94249]: pam_unix(sudo:session): session closed for user root Aug 28 09:37:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f3c34c06-4066-430b-bb08-4babaa5a8192 tempest-TestInstancesWithCinderVolumes-726122166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-eaf631df-7b08-4120-b4bd-71c5a659e9f2 1073741824" returned: 0 in 0.790s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:37:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f3c34c06-4066-430b-bb08-4babaa5a8192 tempest-TestInstancesWithCinderVolumes-726122166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-eaf631df-7b08-4120-b4bd-71c5a659e9f2 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:37:36 devstack sudo[94262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-eaf631df-7b08-4120-b4bd-71c5a659e9f2 Aug 28 09:37:36 devstack sudo[94262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:37:37 devstack sudo[94262]: pam_unix(sudo:session): session closed for user root Aug 28 09:37:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f3c34c06-4066-430b-bb08-4babaa5a8192 tempest-TestInstancesWithCinderVolumes-726122166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-eaf631df-7b08-4120-b4bd-71c5a659e9f2" returned: 0 in 0.549s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:37:37 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-f3c34c06-4066-430b-bb08-4babaa5a8192 tempest-TestInstancesWithCinderVolumes-726122166 None] <== create_volume: return (1411ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:37:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f3c34c06-4066-430b-bb08-4babaa5a8192 tempest-TestInstancesWithCinderVolumes-726122166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.418s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:37:37 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f3c34c06-4066-430b-bb08-4babaa5a8192 tempest-TestInstancesWithCinderVolumes-726122166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e64877e-5fe8-4aac-be56-c5b4e5126c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eaf631df-7b08-4120-b4bd-71c5a659e9f2', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:37:37 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f3c34c06-4066-430b-bb08-4babaa5a8192 tempest-TestInstancesWithCinderVolumes-726122166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ee03861-56f4-45cb-b939-4b52a4cf08d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:37:37 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-f3c34c06-4066-430b-bb08-4babaa5a8192 tempest-TestInstancesWithCinderVolumes-726122166 None] Volume volume-eaf631df-7b08-4120-b4bd-71c5a659e9f2 (eaf631df-7b08-4120-b4bd-71c5a659e9f2): created successfully Aug 28 09:37:37 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f3c34c06-4066-430b-bb08-4babaa5a8192 tempest-TestInstancesWithCinderVolumes-726122166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ee03861-56f4-45cb-b939-4b52a4cf08d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:37:37 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f3c34c06-4066-430b-bb08-4babaa5a8192 tempest-TestInstancesWithCinderVolumes-726122166 None] Flow 'volume_create_manager' (824998a4-af8a-45b6-907c-0cea77190213) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:37:37 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-f3c34c06-4066-430b-bb08-4babaa5a8192 tempest-TestInstancesWithCinderVolumes-726122166 None] Created volume successfully. Aug 28 09:37:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-e8575867-61f8-488c-a6f5-5f9f75113c00 req-31bbee31-9119-4c5f-91ff-da19ce57f343 tempest-AttachVolumeNegativeTest-1867820442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:37:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-e8575867-61f8-488c-a6f5-5f9f75113c00 req-31bbee31-9119-4c5f-91ff-da19ce57f343 tempest-AttachVolumeNegativeTest-1867820442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:37:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-e8575867-61f8-488c-a6f5-5f9f75113c00 req-31bbee31-9119-4c5f-91ff-da19ce57f343 tempest-AttachVolumeNegativeTest-1867820442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:37:37 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-e8575867-61f8-488c-a6f5-5f9f75113c00 req-31bbee31-9119-4c5f-91ff-da19ce57f343 tempest-AttachVolumeNegativeTest-1867820442 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b', 'name': 'volume-dbcb6c36-88c1-4f50-be13-5725ec76e44a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '083b73e7-90d5-465a-9545-8c55dc8c2686', 'enforce_multipath': True} {{(pid=86081) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 09:37:37 devstack cinder-volume[86081]: INFO cinder.volume.manager [req-e8575867-61f8-488c-a6f5-5f9f75113c00 req-31bbee31-9119-4c5f-91ff-da19ce57f343 tempest-AttachVolumeNegativeTest-1867820442 None] attachment_update completed successfully. Aug 28 09:37:38 devstack cinder-volume[86081]: DEBUG oslo_service.periodic_task [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86081) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:37:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:37:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:37:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:37:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:37:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:37:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:37:38 devstack sudo[94656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:37:38 devstack sudo[94656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:37:38 devstack sudo[94656]: pam_unix(sudo:session): session closed for user root Aug 28 09:37:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.648s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:37:38 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:37:38 devstack cinder-volume[86081]: DEBUG oslo_service.periodic_task [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running periodic task VolumeManager._thread_info {{(pid=86081) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:37:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] thread count: 28 {{(pid=86081) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 09:37:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] thread info: [<_MainThread(MainThread, started 129914189705344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86081) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 09:37:40 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1ec90e0d-ed0b-4525-a46b-75eb86b870df_j032sp2adevstack@QuobyteHD, size 20.69 MB, duration 5.67 sec {{(pid=86081) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 28 09:37:40 devstack cinder-volume[86081]: INFO cinder.image.image_utils [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] Image download 20.69 MB at 3.65 MB/s Aug 28 09:37:40 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a4db2c-db18-4ead-b124-465b34c8035c]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:37:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ec90e0d-ed0b-4525-a46b-75eb86b870df_j032sp2adevstack@QuobyteHD {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:37:40 devstack cinder-volume[86081]: INFO cinder.volume.manager [req-7a3b282d-9782-4478-9715-7f9b5bac8f03 req-d11147d2-312a-44f7-9ef8-030c045c6361 tempest-AttachVolumeNegativeTest-1867820442 None] Terminate volume connection completed successfully. Aug 28 09:37:40 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-7a3b282d-9782-4478-9715-7f9b5bac8f03 req-d11147d2-312a-44f7-9ef8-030c045c6361 tempest-AttachVolumeNegativeTest-1867820442 None] Deleting attachment 083b73e7-90d5-465a-9545-8c55dc8c2686. {{(pid=86081) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 09:37:40 devstack sudo[94690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ec90e0d-ed0b-4525-a46b-75eb86b870df_j032sp2adevstack@QuobyteHD Aug 28 09:37:40 devstack sudo[94690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:37:41 devstack sudo[94690]: pam_unix(sudo:session): session closed for user root Aug 28 09:37:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ec90e0d-ed0b-4525-a46b-75eb86b870df_j032sp2adevstack@QuobyteHD" returned: 0 in 0.419s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:37:41 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] Temporary image 1ec90e0d-ed0b-4525-a46b-75eb86b870df is fetched for user 9cc7df3a343e441dab998f1426b383d0. {{(pid=86081) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 28 09:37:41 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[21881bd5-f6d4-4b57-a26f-e852f521e2f5]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:37:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ec90e0d-ed0b-4525-a46b-75eb86b870df_j032sp2adevstack@QuobyteHD {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:37:41 devstack sudo[94695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ec90e0d-ed0b-4525-a46b-75eb86b870df_j032sp2adevstack@QuobyteHD Aug 28 09:37:41 devstack sudo[94695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:37:41 devstack sudo[94695]: pam_unix(sudo:session): session closed for user root Aug 28 09:37:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ec90e0d-ed0b-4525-a46b-75eb86b870df_j032sp2adevstack@QuobyteHD" returned: 0 in 0.409s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:37:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:37:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:37:41 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-705731739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3974ae1a-d297-40ff-accf-d7aaef93f562,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66704002cb684d12a8e442146089126e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:37:34Z,use_quota=True,user_id='9cc7df3a343e441dab998f1426b383d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f3ac4fe-7d22-4f13-8297-bf3bbe0444f6),volume_type_id=3f3ac4fe-7d22-4f13-8297-bf3bbe0444f6)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:37:41 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] Creating volume 3974ae1a-d297-40ff-accf-d7aaef93f562 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:37:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:37:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:37:41 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:37:41 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:37:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:37:41 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:37:41 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:37:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3974ae1a-d297-40ff-accf-d7aaef93f562 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:37:41 devstack sudo[94701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3974ae1a-d297-40ff-accf-d7aaef93f562 1073741824 Aug 28 09:37:41 devstack sudo[94701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:37:42 devstack sudo[94701]: pam_unix(sudo:session): session closed for user root Aug 28 09:37:42 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3974ae1a-d297-40ff-accf-d7aaef93f562 1073741824" returned: 0 in 1.013s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:37:42 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3974ae1a-d297-40ff-accf-d7aaef93f562 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:37:42 devstack sudo[94727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3974ae1a-d297-40ff-accf-d7aaef93f562 Aug 28 09:37:42 devstack sudo[94727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:37:43 devstack sudo[94727]: pam_unix(sudo:session): session closed for user root Aug 28 09:37:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3974ae1a-d297-40ff-accf-d7aaef93f562" returned: 0 in 0.357s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:37:43 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] <== create_volume: return (1443ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:37:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.446s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:37:43 devstack cinder-volume[86081]: DEBUG cinder.volume.volume_utils [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] Attempting download of 1ec90e0d-ed0b-4525-a46b-75eb86b870df ((None, [{'url': 'file:///opt/stack/data/glance/images/1ec90e0d-ed0b-4525-a46b-75eb86b870df', 'metadata': {}}])) to volume 3974ae1a-d297-40ff-accf-d7aaef93f562. {{(pid=86081) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 28 09:37:43 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac5346b-8273-42a6-9bb6-2fd91c219fb3]: (4, 'raw') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:37:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1ec90e0d-ed0b-4525-a46b-75eb86b870df_tsds11cl {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:37:43 devstack sudo[94730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1ec90e0d-ed0b-4525-a46b-75eb86b870df_tsds11cl Aug 28 09:37:43 devstack sudo[94730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:37:43 devstack sudo[94730]: pam_unix(sudo:session): session closed for user root Aug 28 09:37:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1ec90e0d-ed0b-4525-a46b-75eb86b870df_tsds11cl" returned: 0 in 0.487s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:37:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ec90e0d-ed0b-4525-a46b-75eb86b870df_tsds11cl {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:37:43 devstack sudo[94735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ec90e0d-ed0b-4525-a46b-75eb86b870df_tsds11cl Aug 28 09:37:43 devstack sudo[94735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:37:44 devstack sudo[94735]: pam_unix(sudo:session): session closed for user root Aug 28 09:37:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ec90e0d-ed0b-4525-a46b-75eb86b870df_tsds11cl" returned: 1 in 0.436s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:37:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ec90e0d-ed0b-4525-a46b-75eb86b870df_tsds11cl' failed. Not Retrying. {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 09:37:44 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf07350d-057e-4132-8e88-15bc8e39530c]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:37:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ec90e0d-ed0b-4525-a46b-75eb86b870df_j032sp2adevstack@QuobyteHD {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:37:44 devstack sudo[94741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ec90e0d-ed0b-4525-a46b-75eb86b870df_j032sp2adevstack@QuobyteHD Aug 28 09:37:44 devstack sudo[94741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:37:44 devstack sudo[94741]: pam_unix(sudo:session): session closed for user root Aug 28 09:37:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ec90e0d-ed0b-4525-a46b-75eb86b870df_j032sp2adevstack@QuobyteHD" returned: 0 in 0.545s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:37:44 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] 1ec90e0d-ed0b-4525-a46b-75eb86b870df was qcow2, converting to qcow2 {{(pid=86081) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 28 09:37:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1ec90e0d-ed0b-4525-a46b-75eb86b870df_j032sp2adevstack@QuobyteHD /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3974ae1a-d297-40ff-accf-d7aaef93f562 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:37:44 devstack sudo[94778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1ec90e0d-ed0b-4525-a46b-75eb86b870df_j032sp2adevstack@QuobyteHD /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3974ae1a-d297-40ff-accf-d7aaef93f562 Aug 28 09:37:44 devstack sudo[94778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:37:44 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [req-81cd085d-5ba1-4222-98d4-525a40f1854b req-a1b8ac7a-e810-45cd-8a82-1eba4aa5a909 tempest-VolumesSnapshotsTestJSON-1345560271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:37:44 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-81cd085d-5ba1-4222-98d4-525a40f1854b req-a1b8ac7a-e810-45cd-8a82-1eba4aa5a909 tempest-VolumesSnapshotsTestJSON-1345560271 None] Flow 'volume_create_manager' (8f7ef736-c509-46e9-bb7e-4a91e920bd01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:37:44 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-81cd085d-5ba1-4222-98d4-525a40f1854b req-a1b8ac7a-e810-45cd-8a82-1eba4aa5a909 tempest-VolumesSnapshotsTestJSON-1345560271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (815fb276-9cf7-47b8-9430-24e5b85f0d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:37:44 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-81cd085d-5ba1-4222-98d4-525a40f1854b req-a1b8ac7a-e810-45cd-8a82-1eba4aa5a909 tempest-VolumesSnapshotsTestJSON-1345560271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (815fb276-9cf7-47b8-9430-24e5b85f0d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:37:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1124360160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97c0b96b-7a90-425c-9f40-9f867255cc76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7fbc8cfc6d5440d99f92afb2f02c2ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:37:45Z,use_quota=True,user_id='ed5a668b7aed4433b0e680bf60321a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:37:44 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-81cd085d-5ba1-4222-98d4-525a40f1854b req-a1b8ac7a-e810-45cd-8a82-1eba4aa5a909 tempest-VolumesSnapshotsTestJSON-1345560271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a254ba74-0684-4ff4-9953-f2978ceafdc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:37:44 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-81cd085d-5ba1-4222-98d4-525a40f1854b req-a1b8ac7a-e810-45cd-8a82-1eba4aa5a909 tempest-VolumesSnapshotsTestJSON-1345560271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a254ba74-0684-4ff4-9953-f2978ceafdc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:37:44 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-81cd085d-5ba1-4222-98d4-525a40f1854b req-a1b8ac7a-e810-45cd-8a82-1eba4aa5a909 tempest-VolumesSnapshotsTestJSON-1345560271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e334a6cb-1825-411b-8cb4-e44c79eb5efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:37:44 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-81cd085d-5ba1-4222-98d4-525a40f1854b req-a1b8ac7a-e810-45cd-8a82-1eba4aa5a909 tempest-VolumesSnapshotsTestJSON-1345560271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e334a6cb-1825-411b-8cb4-e44c79eb5efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97c0b96b-7a90-425c-9f40-9f867255cc76', 'volume_name': 'volume-97c0b96b-7a90-425c-9f40-9f867255cc76', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:37:44 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-81cd085d-5ba1-4222-98d4-525a40f1854b req-a1b8ac7a-e810-45cd-8a82-1eba4aa5a909 tempest-VolumesSnapshotsTestJSON-1345560271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (935b28b8-8ba5-436b-894d-5f0b6179ca88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:37:44 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-81cd085d-5ba1-4222-98d4-525a40f1854b req-a1b8ac7a-e810-45cd-8a82-1eba4aa5a909 tempest-VolumesSnapshotsTestJSON-1345560271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (935b28b8-8ba5-436b-894d-5f0b6179ca88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:37:44 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-81cd085d-5ba1-4222-98d4-525a40f1854b req-a1b8ac7a-e810-45cd-8a82-1eba4aa5a909 tempest-VolumesSnapshotsTestJSON-1345560271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c54dfa05-d275-41a3-8ee1-d50aad61b29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:37:44 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [req-81cd085d-5ba1-4222-98d4-525a40f1854b req-a1b8ac7a-e810-45cd-8a82-1eba4aa5a909 tempest-VolumesSnapshotsTestJSON-1345560271 None] Volume 97c0b96b-7a90-425c-9f40-9f867255cc76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97c0b96b-7a90-425c-9f40-9f867255cc76', 'volume_size': 1} Aug 28 09:37:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-81cd085d-5ba1-4222-98d4-525a40f1854b req-a1b8ac7a-e810-45cd-8a82-1eba4aa5a909 tempest-VolumesSnapshotsTestJSON-1345560271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:37:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-81cd085d-5ba1-4222-98d4-525a40f1854b req-a1b8ac7a-e810-45cd-8a82-1eba4aa5a909 tempest-VolumesSnapshotsTestJSON-1345560271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:37:44 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [req-81cd085d-5ba1-4222-98d4-525a40f1854b req-a1b8ac7a-e810-45cd-8a82-1eba4aa5a909 tempest-VolumesSnapshotsTestJSON-1345560271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:37:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1124360160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97c0b96b-7a90-425c-9f40-9f867255cc76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7fbc8cfc6d5440d99f92afb2f02c2ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:37:45Z,use_quota=True,user_id='ed5a668b7aed4433b0e680bf60321a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:37:44 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [req-81cd085d-5ba1-4222-98d4-525a40f1854b req-a1b8ac7a-e810-45cd-8a82-1eba4aa5a909 tempest-VolumesSnapshotsTestJSON-1345560271 None] Creating volume 97c0b96b-7a90-425c-9f40-9f867255cc76 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:37:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-81cd085d-5ba1-4222-98d4-525a40f1854b req-a1b8ac7a-e810-45cd-8a82-1eba4aa5a909 tempest-VolumesSnapshotsTestJSON-1345560271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:37:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-81cd085d-5ba1-4222-98d4-525a40f1854b req-a1b8ac7a-e810-45cd-8a82-1eba4aa5a909 tempest-VolumesSnapshotsTestJSON-1345560271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:37:44 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [req-81cd085d-5ba1-4222-98d4-525a40f1854b req-a1b8ac7a-e810-45cd-8a82-1eba4aa5a909 tempest-VolumesSnapshotsTestJSON-1345560271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:37:44 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [req-81cd085d-5ba1-4222-98d4-525a40f1854b req-a1b8ac7a-e810-45cd-8a82-1eba4aa5a909 tempest-VolumesSnapshotsTestJSON-1345560271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:37:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-81cd085d-5ba1-4222-98d4-525a40f1854b req-a1b8ac7a-e810-45cd-8a82-1eba4aa5a909 tempest-VolumesSnapshotsTestJSON-1345560271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:37:44 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [req-81cd085d-5ba1-4222-98d4-525a40f1854b req-a1b8ac7a-e810-45cd-8a82-1eba4aa5a909 tempest-VolumesSnapshotsTestJSON-1345560271 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:37:44 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [req-81cd085d-5ba1-4222-98d4-525a40f1854b req-a1b8ac7a-e810-45cd-8a82-1eba4aa5a909 tempest-VolumesSnapshotsTestJSON-1345560271 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:37:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [req-81cd085d-5ba1-4222-98d4-525a40f1854b req-a1b8ac7a-e810-45cd-8a82-1eba4aa5a909 tempest-VolumesSnapshotsTestJSON-1345560271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97c0b96b-7a90-425c-9f40-9f867255cc76 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:37:44 devstack sudo[94780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97c0b96b-7a90-425c-9f40-9f867255cc76 1073741824 Aug 28 09:37:44 devstack sudo[94780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:37:45 devstack sudo[94780]: pam_unix(sudo:session): session closed for user root Aug 28 09:37:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [req-81cd085d-5ba1-4222-98d4-525a40f1854b req-a1b8ac7a-e810-45cd-8a82-1eba4aa5a909 tempest-VolumesSnapshotsTestJSON-1345560271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97c0b96b-7a90-425c-9f40-9f867255cc76 1073741824" returned: 0 in 0.482s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:37:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [req-81cd085d-5ba1-4222-98d4-525a40f1854b req-a1b8ac7a-e810-45cd-8a82-1eba4aa5a909 tempest-VolumesSnapshotsTestJSON-1345560271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97c0b96b-7a90-425c-9f40-9f867255cc76 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:37:45 devstack sudo[94791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97c0b96b-7a90-425c-9f40-9f867255cc76 Aug 28 09:37:45 devstack sudo[94791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:37:45 devstack sudo[94791]: pam_unix(sudo:session): session closed for user root Aug 28 09:37:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [req-81cd085d-5ba1-4222-98d4-525a40f1854b req-a1b8ac7a-e810-45cd-8a82-1eba4aa5a909 tempest-VolumesSnapshotsTestJSON-1345560271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97c0b96b-7a90-425c-9f40-9f867255cc76" returned: 0 in 0.252s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:37:45 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [req-81cd085d-5ba1-4222-98d4-525a40f1854b req-a1b8ac7a-e810-45cd-8a82-1eba4aa5a909 tempest-VolumesSnapshotsTestJSON-1345560271 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:37:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-81cd085d-5ba1-4222-98d4-525a40f1854b req-a1b8ac7a-e810-45cd-8a82-1eba4aa5a909 tempest-VolumesSnapshotsTestJSON-1345560271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:37:45 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-81cd085d-5ba1-4222-98d4-525a40f1854b req-a1b8ac7a-e810-45cd-8a82-1eba4aa5a909 tempest-VolumesSnapshotsTestJSON-1345560271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c54dfa05-d275-41a3-8ee1-d50aad61b29f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97c0b96b-7a90-425c-9f40-9f867255cc76', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:37:45 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-81cd085d-5ba1-4222-98d4-525a40f1854b req-a1b8ac7a-e810-45cd-8a82-1eba4aa5a909 tempest-VolumesSnapshotsTestJSON-1345560271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43ad5665-16e0-46b7-8a0f-258ab4665e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:37:45 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [req-81cd085d-5ba1-4222-98d4-525a40f1854b req-a1b8ac7a-e810-45cd-8a82-1eba4aa5a909 tempest-VolumesSnapshotsTestJSON-1345560271 None] Volume volume-97c0b96b-7a90-425c-9f40-9f867255cc76 (97c0b96b-7a90-425c-9f40-9f867255cc76): created successfully Aug 28 09:37:45 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-81cd085d-5ba1-4222-98d4-525a40f1854b req-a1b8ac7a-e810-45cd-8a82-1eba4aa5a909 tempest-VolumesSnapshotsTestJSON-1345560271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43ad5665-16e0-46b7-8a0f-258ab4665e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:37:45 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-81cd085d-5ba1-4222-98d4-525a40f1854b req-a1b8ac7a-e810-45cd-8a82-1eba4aa5a909 tempest-VolumesSnapshotsTestJSON-1345560271 None] Flow 'volume_create_manager' (8f7ef736-c509-46e9-bb7e-4a91e920bd01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:37:45 devstack cinder-volume[86081]: INFO cinder.volume.manager [req-81cd085d-5ba1-4222-98d4-525a40f1854b req-a1b8ac7a-e810-45cd-8a82-1eba4aa5a909 tempest-VolumesSnapshotsTestJSON-1345560271 None] Created volume successfully. Aug 28 09:37:46 devstack sudo[94778]: pam_unix(sudo:session): session closed for user root Aug 28 09:37:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1ec90e0d-ed0b-4525-a46b-75eb86b870df_j032sp2adevstack@QuobyteHD /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3974ae1a-d297-40ff-accf-d7aaef93f562" returned: 0 in 1.829s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:37:46 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1ec90e0d-ed0b-4525-a46b-75eb86b870df_j032sp2adevstack@QuobyteHD, size 112.00 MB, duration 1.83 sec, destination /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3974ae1a-d297-40ff-accf-d7aaef93f562 {{(pid=86081) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 09:37:46 devstack cinder-volume[86081]: INFO cinder.image.image_utils [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] Converted 112.00 MB image at 61.21 MB/s Aug 28 09:37:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3974ae1a-d297-40ff-accf-d7aaef93f562 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:37:46 devstack sudo[94795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3974ae1a-d297-40ff-accf-d7aaef93f562 1G Aug 28 09:37:46 devstack sudo[94795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:37:46 devstack sudo[94795]: pam_unix(sudo:session): session closed for user root Aug 28 09:37:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3974ae1a-d297-40ff-accf-d7aaef93f562 1G" returned: 0 in 0.343s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:37:46 devstack cinder-volume[86081]: DEBUG cinder.volume.volume_utils [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] Downloaded image 1ec90e0d-ed0b-4525-a46b-75eb86b870df ((None, [{'url': 'file:///opt/stack/data/glance/images/1ec90e0d-ed0b-4525-a46b-75eb86b870df', 'metadata': {}}])) to volume 3974ae1a-d297-40ff-accf-d7aaef93f562 successfully. {{(pid=86081) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 28 09:37:46 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] Temporary image 1ec90e0d-ed0b-4525-a46b-75eb86b870df for user 9cc7df3a343e441dab998f1426b383d0 is deleted. {{(pid=86081) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 28 09:37:46 devstack cinder-volume[86081]: DEBUG cinder.volume.volume_utils [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] Marking volume 3974ae1a-d297-40ff-accf-d7aaef93f562 as bootable. {{(pid=86081) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 28 09:37:46 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] Copying metadata from image 1ec90e0d-ed0b-4525-a46b-75eb86b870df to 3974ae1a-d297-40ff-accf-d7aaef93f562. {{(pid=86081) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 28 09:37:46 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] Creating volume glance metadata for volume 3974ae1a-d297-40ff-accf-d7aaef93f562 backed by image 1ec90e0d-ed0b-4525-a46b-75eb86b870df with: {'image_id': '1ec90e0d-ed0b-4525-a46b-75eb86b870df', 'image_name': 'tempest-scenario-img--455446455', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86081) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 28 09:37:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e639a221-d089-4d4b-ab22-64e95a45f5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3974ae1a-d297-40ff-accf-d7aaef93f562', 'volume_size': 1, 'image_id': '1ec90e0d-ed0b-4525-a46b-75eb86b870df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1ec90e0d-ed0b-4525-a46b-75eb86b870df', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--455446455', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '66704002cb684d12a8e442146089126e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1ec90e0d-ed0b-4525-a46b-75eb86b870df', 'created_at': datetime.datetime(2026, 8, 28, 7, 37, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 7, 37, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1ec90e0d-ed0b-4525-a46b-75eb86b870df/file', 'properties': {}}, 'image_service': }' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:37:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc71ab7f-308b-4f3c-9767-9b558702c414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:37:47 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] Volume volume-3974ae1a-d297-40ff-accf-d7aaef93f562 (3974ae1a-d297-40ff-accf-d7aaef93f562): created successfully Aug 28 09:37:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc71ab7f-308b-4f3c-9767-9b558702c414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:37:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] Flow 'volume_create_manager' (8771ff76-4d24-4b6d-b416-7832bb90b64f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:37:47 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-2a01ae5b-d02d-49be-853a-7c83f0ac82d1 tempest-TestInstancesWithCinderVolumes-726122166 None] Created volume successfully. Aug 28 09:37:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-e787bd0a-8cd2-48ef-8a8d-64d79b97c54b req-db5882b8-6d8d-4767-863d-5a6f16c8741e tempest-VolumesSnapshotsTestJSON-1345560271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:37:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-e787bd0a-8cd2-48ef-8a8d-64d79b97c54b req-db5882b8-6d8d-4767-863d-5a6f16c8741e tempest-VolumesSnapshotsTestJSON-1345560271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:37:47 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [req-e787bd0a-8cd2-48ef-8a8d-64d79b97c54b req-db5882b8-6d8d-4767-863d-5a6f16c8741e tempest-VolumesSnapshotsTestJSON-1345560271 None] Creating offline snapshot 384e1566-8294-4a28-ab4f-6cded4fc28a3 of volume 97c0b96b-7a90-425c-9f40-9f867255cc76 {{(pid=86081) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:37:47 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d586b03-aa01-45e0-a5c7-293f848a2a40]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:37:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [req-e787bd0a-8cd2-48ef-8a8d-64d79b97c54b req-db5882b8-6d8d-4767-863d-5a6f16c8741e tempest-VolumesSnapshotsTestJSON-1345560271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97c0b96b-7a90-425c-9f40-9f867255cc76 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:37:47 devstack sudo[94801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97c0b96b-7a90-425c-9f40-9f867255cc76 Aug 28 09:37:47 devstack sudo[94801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:37:47 devstack sudo[94801]: pam_unix(sudo:session): session closed for user root Aug 28 09:37:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [req-e787bd0a-8cd2-48ef-8a8d-64d79b97c54b req-db5882b8-6d8d-4767-863d-5a6f16c8741e tempest-VolumesSnapshotsTestJSON-1345560271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97c0b96b-7a90-425c-9f40-9f867255cc76" returned: 0 in 0.434s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:37:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [req-e787bd0a-8cd2-48ef-8a8d-64d79b97c54b req-db5882b8-6d8d-4767-863d-5a6f16c8741e tempest-VolumesSnapshotsTestJSON-1345560271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97c0b96b-7a90-425c-9f40-9f867255cc76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97c0b96b-7a90-425c-9f40-9f867255cc76.384e1566-8294-4a28-ab4f-6cded4fc28a3 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:37:47 devstack sudo[94806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97c0b96b-7a90-425c-9f40-9f867255cc76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97c0b96b-7a90-425c-9f40-9f867255cc76.384e1566-8294-4a28-ab4f-6cded4fc28a3 1G Aug 28 09:37:47 devstack sudo[94806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:37:48 devstack sudo[94806]: pam_unix(sudo:session): session closed for user root Aug 28 09:37:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [req-e787bd0a-8cd2-48ef-8a8d-64d79b97c54b req-db5882b8-6d8d-4767-863d-5a6f16c8741e tempest-VolumesSnapshotsTestJSON-1345560271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97c0b96b-7a90-425c-9f40-9f867255cc76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97c0b96b-7a90-425c-9f40-9f867255cc76.384e1566-8294-4a28-ab4f-6cded4fc28a3 1G" returned: 0 in 0.453s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:37:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [req-e787bd0a-8cd2-48ef-8a8d-64d79b97c54b req-db5882b8-6d8d-4767-863d-5a6f16c8741e tempest-VolumesSnapshotsTestJSON-1345560271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97c0b96b-7a90-425c-9f40-9f867255cc76 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97c0b96b-7a90-425c-9f40-9f867255cc76.384e1566-8294-4a28-ab4f-6cded4fc28a3 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:37:48 devstack sudo[94812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97c0b96b-7a90-425c-9f40-9f867255cc76 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97c0b96b-7a90-425c-9f40-9f867255cc76.384e1566-8294-4a28-ab4f-6cded4fc28a3 Aug 28 09:37:48 devstack sudo[94812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:37:48 devstack sudo[94812]: pam_unix(sudo:session): session closed for user root Aug 28 09:37:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [req-e787bd0a-8cd2-48ef-8a8d-64d79b97c54b req-db5882b8-6d8d-4767-863d-5a6f16c8741e tempest-VolumesSnapshotsTestJSON-1345560271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97c0b96b-7a90-425c-9f40-9f867255cc76 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97c0b96b-7a90-425c-9f40-9f867255cc76.384e1566-8294-4a28-ab4f-6cded4fc28a3" returned: 0 in 0.382s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:37:48 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [req-e787bd0a-8cd2-48ef-8a8d-64d79b97c54b req-db5882b8-6d8d-4767-863d-5a6f16c8741e tempest-VolumesSnapshotsTestJSON-1345560271 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97c0b96b-7a90-425c-9f40-9f867255cc76.384e1566-8294-4a28-ab4f-6cded4fc28a3 is being set with open permissions: ugo+rw Aug 28 09:37:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [req-e787bd0a-8cd2-48ef-8a8d-64d79b97c54b req-db5882b8-6d8d-4767-863d-5a6f16c8741e tempest-VolumesSnapshotsTestJSON-1345560271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97c0b96b-7a90-425c-9f40-9f867255cc76.384e1566-8294-4a28-ab4f-6cded4fc28a3 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:37:48 devstack sudo[94818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97c0b96b-7a90-425c-9f40-9f867255cc76.384e1566-8294-4a28-ab4f-6cded4fc28a3 Aug 28 09:37:48 devstack sudo[94818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:37:48 devstack sudo[94818]: pam_unix(sudo:session): session closed for user root Aug 28 09:37:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [req-e787bd0a-8cd2-48ef-8a8d-64d79b97c54b req-db5882b8-6d8d-4767-863d-5a6f16c8741e tempest-VolumesSnapshotsTestJSON-1345560271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97c0b96b-7a90-425c-9f40-9f867255cc76.384e1566-8294-4a28-ab4f-6cded4fc28a3" returned: 0 in 0.311s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:37:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [req-e787bd0a-8cd2-48ef-8a8d-64d79b97c54b req-db5882b8-6d8d-4767-863d-5a6f16c8741e tempest-VolumesSnapshotsTestJSON-1345560271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97c0b96b-7a90-425c-9f40-9f867255cc76.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:37:48 devstack sudo[94825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97c0b96b-7a90-425c-9f40-9f867255cc76.info Aug 28 09:37:48 devstack sudo[94825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:37:49 devstack sudo[94825]: pam_unix(sudo:session): session closed for user root Aug 28 09:37:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [req-e787bd0a-8cd2-48ef-8a8d-64d79b97c54b req-db5882b8-6d8d-4767-863d-5a6f16c8741e tempest-VolumesSnapshotsTestJSON-1345560271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97c0b96b-7a90-425c-9f40-9f867255cc76.info" returned: 0 in 0.288s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:37:49 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [req-e787bd0a-8cd2-48ef-8a8d-64d79b97c54b req-db5882b8-6d8d-4767-863d-5a6f16c8741e tempest-VolumesSnapshotsTestJSON-1345560271 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97c0b96b-7a90-425c-9f40-9f867255cc76.info is being set with open permissions: ugo+rw Aug 28 09:37:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [req-e787bd0a-8cd2-48ef-8a8d-64d79b97c54b req-db5882b8-6d8d-4767-863d-5a6f16c8741e tempest-VolumesSnapshotsTestJSON-1345560271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97c0b96b-7a90-425c-9f40-9f867255cc76.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:37:49 devstack sudo[94828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97c0b96b-7a90-425c-9f40-9f867255cc76.info Aug 28 09:37:49 devstack sudo[94828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:37:49 devstack sudo[94828]: pam_unix(sudo:session): session closed for user root Aug 28 09:37:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [req-e787bd0a-8cd2-48ef-8a8d-64d79b97c54b req-db5882b8-6d8d-4767-863d-5a6f16c8741e tempest-VolumesSnapshotsTestJSON-1345560271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97c0b96b-7a90-425c-9f40-9f867255cc76.info" returned: 0 in 0.286s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:37:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-e787bd0a-8cd2-48ef-8a8d-64d79b97c54b req-db5882b8-6d8d-4767-863d-5a6f16c8741e tempest-VolumesSnapshotsTestJSON-1345560271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.293s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:37:49 devstack cinder-volume[86081]: INFO cinder.volume.manager [req-e787bd0a-8cd2-48ef-8a8d-64d79b97c54b req-db5882b8-6d8d-4767-863d-5a6f16c8741e tempest-VolumesSnapshotsTestJSON-1345560271 None] Create snapshot completed successfully Aug 28 09:37:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-30c59eca-f306-4b08-825f-b663269ce43f req-6c3b4cf7-017c-47ad-87fe-73757deee92a tempest-TestInstancesWithCinderVolumes-726122166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:37:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-30c59eca-f306-4b08-825f-b663269ce43f req-6c3b4cf7-017c-47ad-87fe-73757deee92a tempest-TestInstancesWithCinderVolumes-726122166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:37:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-30c59eca-f306-4b08-825f-b663269ce43f req-6c3b4cf7-017c-47ad-87fe-73757deee92a tempest-TestInstancesWithCinderVolumes-726122166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:37:50 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-30c59eca-f306-4b08-825f-b663269ce43f req-6c3b4cf7-017c-47ad-87fe-73757deee92a tempest-TestInstancesWithCinderVolumes-726122166 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b', 'name': 'volume-3974ae1a-d297-40ff-accf-d7aaef93f562', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd6679a49-2d10-491a-aedf-225d8ed46b58', 'enforce_multipath': True} {{(pid=86081) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 09:37:50 devstack cinder-volume[86081]: INFO cinder.volume.manager [req-30c59eca-f306-4b08-825f-b663269ce43f req-6c3b4cf7-017c-47ad-87fe-73757deee92a tempest-TestInstancesWithCinderVolumes-726122166 None] attachment_update completed successfully. Aug 28 09:37:50 devstack cinder-volume[86081]: DEBUG cinder.coordination [req-572f49de-3b2e-42ad-ae92-126474dc9d78 req-8f70857f-e21f-4cb9-ab79-2f53b0315157 tempest-VolumesSnapshotsTestJSON-1345560271 None] Acquiring lock "cinder-384e1566-8294-4a28-ab4f-6cded4fc28a3-delete_snapshot" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:37:50 devstack cinder-volume[86081]: DEBUG cinder.coordination [req-572f49de-3b2e-42ad-ae92-126474dc9d78 req-8f70857f-e21f-4cb9-ab79-2f53b0315157 tempest-VolumesSnapshotsTestJSON-1345560271 None] Lock "cinder-384e1566-8294-4a28-ab4f-6cded4fc28a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:37:50 devstack cinder-volume[86081]: DEBUG cinder.coordination [req-572f49de-3b2e-42ad-ae92-126474dc9d78 req-8f70857f-e21f-4cb9-ab79-2f53b0315157 tempest-VolumesSnapshotsTestJSON-1345560271 None] Acquiring lock "cinder-quobyte-97c0b96b-7a90-425c-9f40-9f867255cc76" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:37:50 devstack cinder-volume[86081]: DEBUG cinder.coordination [req-572f49de-3b2e-42ad-ae92-126474dc9d78 req-8f70857f-e21f-4cb9-ab79-2f53b0315157 tempest-VolumesSnapshotsTestJSON-1345560271 None] Lock "cinder-quobyte-97c0b96b-7a90-425c-9f40-9f867255cc76" acquired by "delete_snapshot" :: waited 0.061s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:37:50 devstack cinder-volume[86081]: DEBUG cinder.coordination [req-572f49de-3b2e-42ad-ae92-126474dc9d78 req-8f70857f-e21f-4cb9-ab79-2f53b0315157 tempest-VolumesSnapshotsTestJSON-1345560271 None] Acquiring lock "cinder-quobyte-384e1566-8294-4a28-ab4f-6cded4fc28a3" by "_delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:37:50 devstack cinder-volume[86081]: DEBUG cinder.coordination [req-572f49de-3b2e-42ad-ae92-126474dc9d78 req-8f70857f-e21f-4cb9-ab79-2f53b0315157 tempest-VolumesSnapshotsTestJSON-1345560271 None] Lock "cinder-quobyte-384e1566-8294-4a28-ab4f-6cded4fc28a3" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:37:50 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [req-572f49de-3b2e-42ad-ae92-126474dc9d78 req-8f70857f-e21f-4cb9-ab79-2f53b0315157 tempest-VolumesSnapshotsTestJSON-1345560271 None] Deleting offline snapshot 384e1566-8294-4a28-ab4f-6cded4fc28a3 of volume 97c0b96b-7a90-425c-9f40-9f867255cc76 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:37:50 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [req-572f49de-3b2e-42ad-ae92-126474dc9d78 req-8f70857f-e21f-4cb9-ab79-2f53b0315157 tempest-VolumesSnapshotsTestJSON-1345560271 None] snapshot_file for this snap is: volume-97c0b96b-7a90-425c-9f40-9f867255cc76.384e1566-8294-4a28-ab4f-6cded4fc28a3 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:37:50 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe6cebb-37e6-4401-b73d-5a3a6bdfb377]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:37:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [req-572f49de-3b2e-42ad-ae92-126474dc9d78 req-8f70857f-e21f-4cb9-ab79-2f53b0315157 tempest-VolumesSnapshotsTestJSON-1345560271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97c0b96b-7a90-425c-9f40-9f867255cc76.384e1566-8294-4a28-ab4f-6cded4fc28a3 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:37:51 devstack sudo[94842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97c0b96b-7a90-425c-9f40-9f867255cc76.384e1566-8294-4a28-ab4f-6cded4fc28a3 Aug 28 09:37:51 devstack sudo[94842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:37:51 devstack sudo[94842]: pam_unix(sudo:session): session closed for user root Aug 28 09:37:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [req-572f49de-3b2e-42ad-ae92-126474dc9d78 req-8f70857f-e21f-4cb9-ab79-2f53b0315157 tempest-VolumesSnapshotsTestJSON-1345560271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97c0b96b-7a90-425c-9f40-9f867255cc76.384e1566-8294-4a28-ab4f-6cded4fc28a3" returned: 0 in 0.472s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:37:51 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [req-572f49de-3b2e-42ad-ae92-126474dc9d78 req-8f70857f-e21f-4cb9-ab79-2f53b0315157 tempest-VolumesSnapshotsTestJSON-1345560271 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97c0b96b-7a90-425c-9f40-9f867255cc76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:37:51 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99fa574-42e6-4be1-b847-7409b2c9a1e3]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:37:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [req-572f49de-3b2e-42ad-ae92-126474dc9d78 req-8f70857f-e21f-4cb9-ab79-2f53b0315157 tempest-VolumesSnapshotsTestJSON-1345560271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97c0b96b-7a90-425c-9f40-9f867255cc76 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:37:51 devstack sudo[94848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97c0b96b-7a90-425c-9f40-9f867255cc76 Aug 28 09:37:51 devstack sudo[94848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:37:52 devstack sudo[94848]: pam_unix(sudo:session): session closed for user root Aug 28 09:37:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [req-572f49de-3b2e-42ad-ae92-126474dc9d78 req-8f70857f-e21f-4cb9-ab79-2f53b0315157 tempest-VolumesSnapshotsTestJSON-1345560271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97c0b96b-7a90-425c-9f40-9f867255cc76" returned: 0 in 0.698s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:37:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [req-572f49de-3b2e-42ad-ae92-126474dc9d78 req-8f70857f-e21f-4cb9-ab79-2f53b0315157 tempest-VolumesSnapshotsTestJSON-1345560271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97c0b96b-7a90-425c-9f40-9f867255cc76.384e1566-8294-4a28-ab4f-6cded4fc28a3 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:37:52 devstack sudo[94853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97c0b96b-7a90-425c-9f40-9f867255cc76.384e1566-8294-4a28-ab4f-6cded4fc28a3 Aug 28 09:37:52 devstack sudo[94853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:37:52 devstack sudo[94853]: pam_unix(sudo:session): session closed for user root Aug 28 09:37:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [req-572f49de-3b2e-42ad-ae92-126474dc9d78 req-8f70857f-e21f-4cb9-ab79-2f53b0315157 tempest-VolumesSnapshotsTestJSON-1345560271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97c0b96b-7a90-425c-9f40-9f867255cc76.384e1566-8294-4a28-ab4f-6cded4fc28a3" returned: 0 in 0.721s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:37:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [req-572f49de-3b2e-42ad-ae92-126474dc9d78 req-8f70857f-e21f-4cb9-ab79-2f53b0315157 tempest-VolumesSnapshotsTestJSON-1345560271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97c0b96b-7a90-425c-9f40-9f867255cc76.384e1566-8294-4a28-ab4f-6cded4fc28a3 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:37:53 devstack sudo[94864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97c0b96b-7a90-425c-9f40-9f867255cc76.384e1566-8294-4a28-ab4f-6cded4fc28a3 Aug 28 09:37:53 devstack sudo[94864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:37:53 devstack sudo[94864]: pam_unix(sudo:session): session closed for user root Aug 28 09:37:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [req-572f49de-3b2e-42ad-ae92-126474dc9d78 req-8f70857f-e21f-4cb9-ab79-2f53b0315157 tempest-VolumesSnapshotsTestJSON-1345560271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97c0b96b-7a90-425c-9f40-9f867255cc76.384e1566-8294-4a28-ab4f-6cded4fc28a3" returned: 0 in 0.419s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:37:53 devstack cinder-volume[86081]: DEBUG cinder.coordination [req-572f49de-3b2e-42ad-ae92-126474dc9d78 req-8f70857f-e21f-4cb9-ab79-2f53b0315157 tempest-VolumesSnapshotsTestJSON-1345560271 None] Lock "cinder-quobyte-384e1566-8294-4a28-ab4f-6cded4fc28a3" released by "_delete_snapshot" :: held 2.516s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:37:53 devstack cinder-volume[86081]: DEBUG cinder.coordination [req-572f49de-3b2e-42ad-ae92-126474dc9d78 req-8f70857f-e21f-4cb9-ab79-2f53b0315157 tempest-VolumesSnapshotsTestJSON-1345560271 None] Lock "cinder-quobyte-97c0b96b-7a90-425c-9f40-9f867255cc76" released by "delete_snapshot" :: held 2.565s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:37:53 devstack cinder-volume[86081]: DEBUG cinder.quota [req-572f49de-3b2e-42ad-ae92-126474dc9d78 req-8f70857f-e21f-4cb9-ab79-2f53b0315157 tempest-VolumesSnapshotsTestJSON-1345560271 None] Created reservations ['a354fc65-1081-4df7-8aa6-9a741e907536', '86c2c872-b410-41fb-91a5-a1a4e6d8a6b1', '6676899b-9e7d-44d6-a4a2-243998df2014', '6b6bb53c-99cf-4891-bd72-066de8e0282f'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:37:53 devstack cinder-volume[86081]: INFO cinder.volume.manager [req-572f49de-3b2e-42ad-ae92-126474dc9d78 req-8f70857f-e21f-4cb9-ab79-2f53b0315157 tempest-VolumesSnapshotsTestJSON-1345560271 None] Delete snapshot completed successfully. Aug 28 09:37:53 devstack cinder-volume[86081]: DEBUG cinder.coordination [req-572f49de-3b2e-42ad-ae92-126474dc9d78 req-8f70857f-e21f-4cb9-ab79-2f53b0315157 tempest-VolumesSnapshotsTestJSON-1345560271 None] Lock "cinder-384e1566-8294-4a28-ab4f-6cded4fc28a3-delete_snapshot" released by "delete_snapshot" :: held 2.830s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:37:54 devstack cinder-volume[86081]: DEBUG cinder.coordination [req-82f34763-1955-496f-a953-5f877a819689 req-3f77d641-c84a-45dd-852e-9a5d051b693c tempest-VolumesSnapshotsTestJSON-1345560271 None] Acquiring lock "cinder-97c0b96b-7a90-425c-9f40-9f867255cc76-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:37:54 devstack cinder-volume[86081]: DEBUG cinder.coordination [req-82f34763-1955-496f-a953-5f877a819689 req-3f77d641-c84a-45dd-852e-9a5d051b693c tempest-VolumesSnapshotsTestJSON-1345560271 None] Lock "cinder-97c0b96b-7a90-425c-9f40-9f867255cc76-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:37:54 devstack cinder-volume[86081]: DEBUG cinder.coordination [req-82f34763-1955-496f-a953-5f877a819689 req-3f77d641-c84a-45dd-852e-9a5d051b693c tempest-VolumesSnapshotsTestJSON-1345560271 None] Acquiring lock "cinder-quobyte-97c0b96b-7a90-425c-9f40-9f867255cc76" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:37:54 devstack cinder-volume[86081]: DEBUG cinder.coordination [req-82f34763-1955-496f-a953-5f877a819689 req-3f77d641-c84a-45dd-852e-9a5d051b693c tempest-VolumesSnapshotsTestJSON-1345560271 None] Lock "cinder-quobyte-97c0b96b-7a90-425c-9f40-9f867255cc76" acquired by "delete_volume" :: waited 0.052s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:37:54 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[93bb77ae-93d9-4d9d-8b00-2feb27d9ca94]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:37:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [req-82f34763-1955-496f-a953-5f877a819689 req-3f77d641-c84a-45dd-852e-9a5d051b693c tempest-VolumesSnapshotsTestJSON-1345560271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97c0b96b-7a90-425c-9f40-9f867255cc76 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:37:54 devstack sudo[94963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97c0b96b-7a90-425c-9f40-9f867255cc76 Aug 28 09:37:54 devstack sudo[94963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:37:55 devstack sudo[94963]: pam_unix(sudo:session): session closed for user root Aug 28 09:37:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [req-82f34763-1955-496f-a953-5f877a819689 req-3f77d641-c84a-45dd-852e-9a5d051b693c tempest-VolumesSnapshotsTestJSON-1345560271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97c0b96b-7a90-425c-9f40-9f867255cc76" returned: 0 in 0.579s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:37:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [req-82f34763-1955-496f-a953-5f877a819689 req-3f77d641-c84a-45dd-852e-9a5d051b693c tempest-VolumesSnapshotsTestJSON-1345560271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97c0b96b-7a90-425c-9f40-9f867255cc76 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:37:55 devstack sudo[95320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97c0b96b-7a90-425c-9f40-9f867255cc76 Aug 28 09:37:55 devstack sudo[95320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:37:55 devstack sudo[95320]: pam_unix(sudo:session): session closed for user root Aug 28 09:37:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [req-82f34763-1955-496f-a953-5f877a819689 req-3f77d641-c84a-45dd-852e-9a5d051b693c tempest-VolumesSnapshotsTestJSON-1345560271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97c0b96b-7a90-425c-9f40-9f867255cc76" returned: 0 in 0.495s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:37:55 devstack cinder-volume[86081]: DEBUG cinder.coordination [req-82f34763-1955-496f-a953-5f877a819689 req-3f77d641-c84a-45dd-852e-9a5d051b693c tempest-VolumesSnapshotsTestJSON-1345560271 None] Lock "cinder-quobyte-97c0b96b-7a90-425c-9f40-9f867255cc76" released by "delete_volume" :: held 1.204s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:37:55 devstack cinder-volume[86081]: DEBUG cinder.quota [req-82f34763-1955-496f-a953-5f877a819689 req-3f77d641-c84a-45dd-852e-9a5d051b693c tempest-VolumesSnapshotsTestJSON-1345560271 None] Created reservations ['71ed760b-d42d-49b9-85a2-31fd9bbf1134', '8ff0eb5a-6629-4515-a001-cfdf74a26b2c', 'd637beb7-76fc-451a-91ad-0e241b2043e2', '16bd2c32-23e3-4806-80ca-d59475585649'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:37:56 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-24736048-aec5-4726-aabc-5947b462ef68 tempest-AttachVolumeTestJSON-601093567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:37:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-24736048-aec5-4726-aabc-5947b462ef68 tempest-AttachVolumeTestJSON-601093567 None] Flow 'volume_create_manager' (483a5178-808a-4e11-9e6c-d68947583376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:37:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-24736048-aec5-4726-aabc-5947b462ef68 tempest-AttachVolumeTestJSON-601093567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45a0b572-5c2b-4ada-afe4-6e9483410b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:37:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-82f34763-1955-496f-a953-5f877a819689 req-3f77d641-c84a-45dd-852e-9a5d051b693c tempest-VolumesSnapshotsTestJSON-1345560271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:37:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-82f34763-1955-496f-a953-5f877a819689 req-3f77d641-c84a-45dd-852e-9a5d051b693c tempest-VolumesSnapshotsTestJSON-1345560271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:37:56 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [req-82f34763-1955-496f-a953-5f877a819689 req-3f77d641-c84a-45dd-852e-9a5d051b693c tempest-VolumesSnapshotsTestJSON-1345560271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:37:56 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [req-82f34763-1955-496f-a953-5f877a819689 req-3f77d641-c84a-45dd-852e-9a5d051b693c tempest-VolumesSnapshotsTestJSON-1345560271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:37:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-82f34763-1955-496f-a953-5f877a819689 req-3f77d641-c84a-45dd-852e-9a5d051b693c tempest-VolumesSnapshotsTestJSON-1345560271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:37:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [req-82f34763-1955-496f-a953-5f877a819689 req-3f77d641-c84a-45dd-852e-9a5d051b693c tempest-VolumesSnapshotsTestJSON-1345560271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:37:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-24736048-aec5-4726-aabc-5947b462ef68 tempest-AttachVolumeTestJSON-601093567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45a0b572-5c2b-4ada-afe4-6e9483410b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-838271132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8885dcdd-ab7e-41e1-b1c6-2f714b230496,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f2c9303e4cb495cab8f1e097bf57338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:37:56Z,use_quota=True,user_id='1d3905384f6b452f8e13789416d869a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:37:56 devstack sudo[95334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:37:56 devstack sudo[95334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:37:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-24736048-aec5-4726-aabc-5947b462ef68 tempest-AttachVolumeTestJSON-601093567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (825c63be-32ad-4a85-b297-b9507f41b83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:37:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-24736048-aec5-4726-aabc-5947b462ef68 tempest-AttachVolumeTestJSON-601093567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (825c63be-32ad-4a85-b297-b9507f41b83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:37:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-24736048-aec5-4726-aabc-5947b462ef68 tempest-AttachVolumeTestJSON-601093567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c7da965-4c0f-438c-8aad-6e7b2caec686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:37:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-24736048-aec5-4726-aabc-5947b462ef68 tempest-AttachVolumeTestJSON-601093567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c7da965-4c0f-438c-8aad-6e7b2caec686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8885dcdd-ab7e-41e1-b1c6-2f714b230496', 'volume_name': 'volume-8885dcdd-ab7e-41e1-b1c6-2f714b230496', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:37:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-24736048-aec5-4726-aabc-5947b462ef68 tempest-AttachVolumeTestJSON-601093567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f443fc05-fe2f-4566-ac38-0d777ae2ba33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:37:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-24736048-aec5-4726-aabc-5947b462ef68 tempest-AttachVolumeTestJSON-601093567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f443fc05-fe2f-4566-ac38-0d777ae2ba33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:37:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-24736048-aec5-4726-aabc-5947b462ef68 tempest-AttachVolumeTestJSON-601093567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d8fca11-7d59-40c3-8624-d5578feb069c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:37:56 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-24736048-aec5-4726-aabc-5947b462ef68 tempest-AttachVolumeTestJSON-601093567 None] Volume 8885dcdd-ab7e-41e1-b1c6-2f714b230496: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8885dcdd-ab7e-41e1-b1c6-2f714b230496', 'volume_size': 1} Aug 28 09:37:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-24736048-aec5-4726-aabc-5947b462ef68 tempest-AttachVolumeTestJSON-601093567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:37:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-24736048-aec5-4726-aabc-5947b462ef68 tempest-AttachVolumeTestJSON-601093567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:37:56 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-24736048-aec5-4726-aabc-5947b462ef68 tempest-AttachVolumeTestJSON-601093567 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-838271132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8885dcdd-ab7e-41e1-b1c6-2f714b230496,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f2c9303e4cb495cab8f1e097bf57338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:37:56Z,use_quota=True,user_id='1d3905384f6b452f8e13789416d869a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:37:56 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-24736048-aec5-4726-aabc-5947b462ef68 tempest-AttachVolumeTestJSON-601093567 None] Creating volume 8885dcdd-ab7e-41e1-b1c6-2f714b230496 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:37:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-24736048-aec5-4726-aabc-5947b462ef68 tempest-AttachVolumeTestJSON-601093567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:37:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-24736048-aec5-4726-aabc-5947b462ef68 tempest-AttachVolumeTestJSON-601093567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:37:56 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-24736048-aec5-4726-aabc-5947b462ef68 tempest-AttachVolumeTestJSON-601093567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:37:56 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-24736048-aec5-4726-aabc-5947b462ef68 tempest-AttachVolumeTestJSON-601093567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:37:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-24736048-aec5-4726-aabc-5947b462ef68 tempest-AttachVolumeTestJSON-601093567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:37:56 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-24736048-aec5-4726-aabc-5947b462ef68 tempest-AttachVolumeTestJSON-601093567 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:37:56 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-24736048-aec5-4726-aabc-5947b462ef68 tempest-AttachVolumeTestJSON-601093567 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:37:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-24736048-aec5-4726-aabc-5947b462ef68 tempest-AttachVolumeTestJSON-601093567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8885dcdd-ab7e-41e1-b1c6-2f714b230496 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:37:56 devstack sudo[95336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8885dcdd-ab7e-41e1-b1c6-2f714b230496 1073741824 Aug 28 09:37:56 devstack sudo[95336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:37:56 devstack sudo[95334]: pam_unix(sudo:session): session closed for user root Aug 28 09:37:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [req-82f34763-1955-496f-a953-5f877a819689 req-3f77d641-c84a-45dd-852e-9a5d051b693c tempest-VolumesSnapshotsTestJSON-1345560271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.438s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:37:56 devstack cinder-volume[86081]: DEBUG cinder.manager [req-82f34763-1955-496f-a953-5f877a819689 req-3f77d641-c84a-45dd-852e-9a5d051b693c tempest-VolumesSnapshotsTestJSON-1345560271 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:37:56 devstack cinder-volume[86081]: INFO cinder.volume.manager [req-82f34763-1955-496f-a953-5f877a819689 req-3f77d641-c84a-45dd-852e-9a5d051b693c tempest-VolumesSnapshotsTestJSON-1345560271 None] Deleted volume successfully. Aug 28 09:37:56 devstack cinder-volume[86081]: DEBUG cinder.coordination [req-82f34763-1955-496f-a953-5f877a819689 req-3f77d641-c84a-45dd-852e-9a5d051b693c tempest-VolumesSnapshotsTestJSON-1345560271 None] Lock "cinder-97c0b96b-7a90-425c-9f40-9f867255cc76-delete_volume" released by "delete_volume" :: held 2.311s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:37:57 devstack sudo[95336]: pam_unix(sudo:session): session closed for user root Aug 28 09:37:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-24736048-aec5-4726-aabc-5947b462ef68 tempest-AttachVolumeTestJSON-601093567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8885dcdd-ab7e-41e1-b1c6-2f714b230496 1073741824" returned: 0 in 1.113s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:37:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-24736048-aec5-4726-aabc-5947b462ef68 tempest-AttachVolumeTestJSON-601093567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8885dcdd-ab7e-41e1-b1c6-2f714b230496 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:37:57 devstack sudo[95371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8885dcdd-ab7e-41e1-b1c6-2f714b230496 Aug 28 09:37:57 devstack sudo[95371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:37:58 devstack sudo[95371]: pam_unix(sudo:session): session closed for user root Aug 28 09:37:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-24736048-aec5-4726-aabc-5947b462ef68 tempest-AttachVolumeTestJSON-601093567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8885dcdd-ab7e-41e1-b1c6-2f714b230496" returned: 0 in 0.707s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:37:58 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-24736048-aec5-4726-aabc-5947b462ef68 tempest-AttachVolumeTestJSON-601093567 None] <== create_volume: return (1910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:37:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-24736048-aec5-4726-aabc-5947b462ef68 tempest-AttachVolumeTestJSON-601093567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.921s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:37:58 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-24736048-aec5-4726-aabc-5947b462ef68 tempest-AttachVolumeTestJSON-601093567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d8fca11-7d59-40c3-8624-d5578feb069c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8885dcdd-ab7e-41e1-b1c6-2f714b230496', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:37:58 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-24736048-aec5-4726-aabc-5947b462ef68 tempest-AttachVolumeTestJSON-601093567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdc49b3c-ea3b-4564-9e25-92ff491ed5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:37:58 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-24736048-aec5-4726-aabc-5947b462ef68 tempest-AttachVolumeTestJSON-601093567 None] Volume volume-8885dcdd-ab7e-41e1-b1c6-2f714b230496 (8885dcdd-ab7e-41e1-b1c6-2f714b230496): created successfully Aug 28 09:37:58 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-24736048-aec5-4726-aabc-5947b462ef68 tempest-AttachVolumeTestJSON-601093567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdc49b3c-ea3b-4564-9e25-92ff491ed5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:37:58 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-24736048-aec5-4726-aabc-5947b462ef68 tempest-AttachVolumeTestJSON-601093567 None] Flow 'volume_create_manager' (483a5178-808a-4e11-9e6c-d68947583376) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:37:58 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-24736048-aec5-4726-aabc-5947b462ef68 tempest-AttachVolumeTestJSON-601093567 None] Created volume successfully. Aug 28 09:38:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-33630041-73e0-4caa-a952-6bb711ec5a3f req-b5dba907-5f44-4853-90de-fadb06eab71c tempest-AttachVolumeTestJSON-601093567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:38:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-33630041-73e0-4caa-a952-6bb711ec5a3f req-b5dba907-5f44-4853-90de-fadb06eab71c tempest-AttachVolumeTestJSON-601093567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:38:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-33630041-73e0-4caa-a952-6bb711ec5a3f req-b5dba907-5f44-4853-90de-fadb06eab71c tempest-AttachVolumeTestJSON-601093567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:38:01 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-33630041-73e0-4caa-a952-6bb711ec5a3f req-b5dba907-5f44-4853-90de-fadb06eab71c tempest-AttachVolumeTestJSON-601093567 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b', 'name': 'volume-8885dcdd-ab7e-41e1-b1c6-2f714b230496', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '38e913f7-66fc-4f4d-9d6a-0cdcd78ff917', 'enforce_multipath': True} {{(pid=86081) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 09:38:01 devstack cinder-volume[86081]: INFO cinder.volume.manager [req-33630041-73e0-4caa-a952-6bb711ec5a3f req-b5dba907-5f44-4853-90de-fadb06eab71c tempest-AttachVolumeTestJSON-601093567 None] attachment_update completed successfully. Aug 28 09:38:04 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-81934059-834f-4416-932c-2a1a28190bb5 tempest-AttachVolumeTestJSON-601093567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:38:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-81934059-834f-4416-932c-2a1a28190bb5 tempest-AttachVolumeTestJSON-601093567 None] Flow 'volume_create_manager' (a48a4133-e6f1-45e0-b451-d1f8fa37fd21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:38:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-81934059-834f-4416-932c-2a1a28190bb5 tempest-AttachVolumeTestJSON-601093567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d7be368-5c55-4efb-83e7-d200f3ce48db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:38:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-81934059-834f-4416-932c-2a1a28190bb5 tempest-AttachVolumeTestJSON-601093567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d7be368-5c55-4efb-83e7-d200f3ce48db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:38:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1058379818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09f7c8c3-8f3d-4e46-ad37-ad607453732e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f2c9303e4cb495cab8f1e097bf57338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:38:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:38:05Z,use_quota=True,user_id='1d3905384f6b452f8e13789416d869a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:38:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-81934059-834f-4416-932c-2a1a28190bb5 tempest-AttachVolumeTestJSON-601093567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05473fe2-a15a-45e2-a9dc-f31df9da3477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:38:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-81934059-834f-4416-932c-2a1a28190bb5 tempest-AttachVolumeTestJSON-601093567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05473fe2-a15a-45e2-a9dc-f31df9da3477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:38:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-81934059-834f-4416-932c-2a1a28190bb5 tempest-AttachVolumeTestJSON-601093567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c810a329-362b-486c-b832-f3ad92433343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:38:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-81934059-834f-4416-932c-2a1a28190bb5 tempest-AttachVolumeTestJSON-601093567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c810a329-362b-486c-b832-f3ad92433343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09f7c8c3-8f3d-4e46-ad37-ad607453732e', 'volume_name': 'volume-09f7c8c3-8f3d-4e46-ad37-ad607453732e', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:38:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-81934059-834f-4416-932c-2a1a28190bb5 tempest-AttachVolumeTestJSON-601093567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95688e36-d32e-4384-8cca-de205a9fd2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:38:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-81934059-834f-4416-932c-2a1a28190bb5 tempest-AttachVolumeTestJSON-601093567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95688e36-d32e-4384-8cca-de205a9fd2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:38:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-81934059-834f-4416-932c-2a1a28190bb5 tempest-AttachVolumeTestJSON-601093567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1b964a4-786f-4164-9807-bc67eeae24b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:38:04 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-81934059-834f-4416-932c-2a1a28190bb5 tempest-AttachVolumeTestJSON-601093567 None] Volume 09f7c8c3-8f3d-4e46-ad37-ad607453732e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09f7c8c3-8f3d-4e46-ad37-ad607453732e', 'volume_size': 1} Aug 28 09:38:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-81934059-834f-4416-932c-2a1a28190bb5 tempest-AttachVolumeTestJSON-601093567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:38:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-81934059-834f-4416-932c-2a1a28190bb5 tempest-AttachVolumeTestJSON-601093567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:38:05 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-81934059-834f-4416-932c-2a1a28190bb5 tempest-AttachVolumeTestJSON-601093567 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:38:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1058379818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09f7c8c3-8f3d-4e46-ad37-ad607453732e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f2c9303e4cb495cab8f1e097bf57338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:38:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:38:05Z,use_quota=True,user_id='1d3905384f6b452f8e13789416d869a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:38:05 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-81934059-834f-4416-932c-2a1a28190bb5 tempest-AttachVolumeTestJSON-601093567 None] Creating volume 09f7c8c3-8f3d-4e46-ad37-ad607453732e {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:38:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-81934059-834f-4416-932c-2a1a28190bb5 tempest-AttachVolumeTestJSON-601093567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:38:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-81934059-834f-4416-932c-2a1a28190bb5 tempest-AttachVolumeTestJSON-601093567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:38:05 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-81934059-834f-4416-932c-2a1a28190bb5 tempest-AttachVolumeTestJSON-601093567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:38:05 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-81934059-834f-4416-932c-2a1a28190bb5 tempest-AttachVolumeTestJSON-601093567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:38:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-81934059-834f-4416-932c-2a1a28190bb5 tempest-AttachVolumeTestJSON-601093567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:38:05 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-81934059-834f-4416-932c-2a1a28190bb5 tempest-AttachVolumeTestJSON-601093567 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:38:05 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-81934059-834f-4416-932c-2a1a28190bb5 tempest-AttachVolumeTestJSON-601093567 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:38:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-81934059-834f-4416-932c-2a1a28190bb5 tempest-AttachVolumeTestJSON-601093567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-09f7c8c3-8f3d-4e46-ad37-ad607453732e 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:05 devstack sudo[95435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-09f7c8c3-8f3d-4e46-ad37-ad607453732e 1073741824 Aug 28 09:38:05 devstack sudo[95435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:06 devstack sudo[95435]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-81934059-834f-4416-932c-2a1a28190bb5 tempest-AttachVolumeTestJSON-601093567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-09f7c8c3-8f3d-4e46-ad37-ad607453732e 1073741824" returned: 0 in 1.314s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-81934059-834f-4416-932c-2a1a28190bb5 tempest-AttachVolumeTestJSON-601093567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-09f7c8c3-8f3d-4e46-ad37-ad607453732e {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:06 devstack sudo[95481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-09f7c8c3-8f3d-4e46-ad37-ad607453732e Aug 28 09:38:06 devstack sudo[95481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:07 devstack sudo[95481]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-81934059-834f-4416-932c-2a1a28190bb5 tempest-AttachVolumeTestJSON-601093567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-09f7c8c3-8f3d-4e46-ad37-ad607453732e" returned: 0 in 0.588s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:07 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-81934059-834f-4416-932c-2a1a28190bb5 tempest-AttachVolumeTestJSON-601093567 None] <== create_volume: return (2085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:38:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-81934059-834f-4416-932c-2a1a28190bb5 tempest-AttachVolumeTestJSON-601093567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.098s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:38:07 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-81934059-834f-4416-932c-2a1a28190bb5 tempest-AttachVolumeTestJSON-601093567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1b964a4-786f-4164-9807-bc67eeae24b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09f7c8c3-8f3d-4e46-ad37-ad607453732e', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:38:07 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-81934059-834f-4416-932c-2a1a28190bb5 tempest-AttachVolumeTestJSON-601093567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3d58d3e-fb12-4bbd-81fd-bf61d371dd50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:38:07 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-81934059-834f-4416-932c-2a1a28190bb5 tempest-AttachVolumeTestJSON-601093567 None] Volume volume-09f7c8c3-8f3d-4e46-ad37-ad607453732e (09f7c8c3-8f3d-4e46-ad37-ad607453732e): created successfully Aug 28 09:38:07 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-81934059-834f-4416-932c-2a1a28190bb5 tempest-AttachVolumeTestJSON-601093567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3d58d3e-fb12-4bbd-81fd-bf61d371dd50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:38:07 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-81934059-834f-4416-932c-2a1a28190bb5 tempest-AttachVolumeTestJSON-601093567 None] Flow 'volume_create_manager' (a48a4133-e6f1-45e0-b451-d1f8fa37fd21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:38:07 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-81934059-834f-4416-932c-2a1a28190bb5 tempest-AttachVolumeTestJSON-601093567 None] Created volume successfully. Aug 28 09:38:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-5e390cf3-4842-4e38-b00e-e5a4cf989456 req-7474eca4-e8b1-4613-8e9d-f0357f00cdda tempest-AttachVolumeTestJSON-601093567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:38:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-5e390cf3-4842-4e38-b00e-e5a4cf989456 req-7474eca4-e8b1-4613-8e9d-f0357f00cdda tempest-AttachVolumeTestJSON-601093567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:38:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-5e390cf3-4842-4e38-b00e-e5a4cf989456 req-7474eca4-e8b1-4613-8e9d-f0357f00cdda tempest-AttachVolumeTestJSON-601093567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:38:09 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-5e390cf3-4842-4e38-b00e-e5a4cf989456 req-7474eca4-e8b1-4613-8e9d-f0357f00cdda tempest-AttachVolumeTestJSON-601093567 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b', 'name': 'volume-09f7c8c3-8f3d-4e46-ad37-ad607453732e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '86198ef4-3a88-4359-b50a-134457ea4802', 'enforce_multipath': True} {{(pid=86081) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 09:38:09 devstack cinder-volume[86081]: INFO cinder.volume.manager [req-5e390cf3-4842-4e38-b00e-e5a4cf989456 req-7474eca4-e8b1-4613-8e9d-f0357f00cdda tempest-AttachVolumeTestJSON-601093567 None] attachment_update completed successfully. Aug 28 09:38:13 devstack cinder-volume[86081]: INFO cinder.volume.manager [req-87423c65-87d6-4510-9d8b-0987aa22c202 req-8b1d3f8a-e99f-4fdb-b591-e16a6fa717ef tempest-AttachVolumeTestJSON-601093567 None] Terminate volume connection completed successfully. Aug 28 09:38:13 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-87423c65-87d6-4510-9d8b-0987aa22c202 req-8b1d3f8a-e99f-4fdb-b591-e16a6fa717ef tempest-AttachVolumeTestJSON-601093567 None] Deleting attachment 38e913f7-66fc-4f4d-9d6a-0cdcd78ff917. {{(pid=86081) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 09:38:14 devstack cinder-volume[86081]: INFO cinder.volume.manager [req-48a5823b-2621-4182-ab2f-619e13757d09 req-773fe072-d6e3-4dc9-91ff-7a765a59f023 tempest-AttachVolumeTestJSON-601093567 None] Terminate volume connection completed successfully. Aug 28 09:38:14 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-48a5823b-2621-4182-ab2f-619e13757d09 req-773fe072-d6e3-4dc9-91ff-7a765a59f023 tempest-AttachVolumeTestJSON-601093567 None] Deleting attachment 86198ef4-3a88-4359-b50a-134457ea4802. {{(pid=86081) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 09:38:18 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-79d05f2b-3e02-4091-8e30-b9978aac0abe tempest-VolumeQuotasAdminTestJSON-923854183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:38:18 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-79d05f2b-3e02-4091-8e30-b9978aac0abe tempest-VolumeQuotasAdminTestJSON-923854183 None] Flow 'volume_create_manager' (2bbe5b62-21f1-46c7-ad4b-7b92da9f8dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:38:18 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-79d05f2b-3e02-4091-8e30-b9978aac0abe tempest-VolumeQuotasAdminTestJSON-923854183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (545a61d2-c0ae-416c-8e48-bcfd3f7365da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:38:18 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-79d05f2b-3e02-4091-8e30-b9978aac0abe tempest-VolumeQuotasAdminTestJSON-923854183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (545a61d2-c0ae-416c-8e48-bcfd3f7365da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1903928992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd292e34-d4e1-49f8-8258-7395edb17058,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccf242ead78f438db667185c6e6cf5d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:38:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:38:19Z,use_quota=True,user_id='6968f0ed28ce4080a888def13ec98bd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:38:18 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-79d05f2b-3e02-4091-8e30-b9978aac0abe tempest-VolumeQuotasAdminTestJSON-923854183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43a001a3-969d-49f2-a99e-3ff6ff25a52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:38:18 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-79d05f2b-3e02-4091-8e30-b9978aac0abe tempest-VolumeQuotasAdminTestJSON-923854183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43a001a3-969d-49f2-a99e-3ff6ff25a52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:38:18 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-79d05f2b-3e02-4091-8e30-b9978aac0abe tempest-VolumeQuotasAdminTestJSON-923854183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c5b8e12-1746-4809-8089-227bf5de9d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:38:18 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-79d05f2b-3e02-4091-8e30-b9978aac0abe tempest-VolumeQuotasAdminTestJSON-923854183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c5b8e12-1746-4809-8089-227bf5de9d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd292e34-d4e1-49f8-8258-7395edb17058', 'volume_name': 'volume-cd292e34-d4e1-49f8-8258-7395edb17058', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:38:18 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-79d05f2b-3e02-4091-8e30-b9978aac0abe tempest-VolumeQuotasAdminTestJSON-923854183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (942138ce-8708-4d29-843c-e2e0d238ac42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:38:18 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-79d05f2b-3e02-4091-8e30-b9978aac0abe tempest-VolumeQuotasAdminTestJSON-923854183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (942138ce-8708-4d29-843c-e2e0d238ac42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:38:18 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-79d05f2b-3e02-4091-8e30-b9978aac0abe tempest-VolumeQuotasAdminTestJSON-923854183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (529391c0-1155-4286-a4f4-813e87de3b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:38:18 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-79d05f2b-3e02-4091-8e30-b9978aac0abe tempest-VolumeQuotasAdminTestJSON-923854183 None] Volume cd292e34-d4e1-49f8-8258-7395edb17058: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd292e34-d4e1-49f8-8258-7395edb17058', 'volume_size': 1} Aug 28 09:38:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-79d05f2b-3e02-4091-8e30-b9978aac0abe tempest-VolumeQuotasAdminTestJSON-923854183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:38:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-79d05f2b-3e02-4091-8e30-b9978aac0abe tempest-VolumeQuotasAdminTestJSON-923854183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:38:18 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-79d05f2b-3e02-4091-8e30-b9978aac0abe tempest-VolumeQuotasAdminTestJSON-923854183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1903928992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd292e34-d4e1-49f8-8258-7395edb17058,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccf242ead78f438db667185c6e6cf5d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:38:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:38:19Z,use_quota=True,user_id='6968f0ed28ce4080a888def13ec98bd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:38:18 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-79d05f2b-3e02-4091-8e30-b9978aac0abe tempest-VolumeQuotasAdminTestJSON-923854183 None] Creating volume cd292e34-d4e1-49f8-8258-7395edb17058 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:38:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-79d05f2b-3e02-4091-8e30-b9978aac0abe tempest-VolumeQuotasAdminTestJSON-923854183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:38:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-79d05f2b-3e02-4091-8e30-b9978aac0abe tempest-VolumeQuotasAdminTestJSON-923854183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:38:18 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-79d05f2b-3e02-4091-8e30-b9978aac0abe tempest-VolumeQuotasAdminTestJSON-923854183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:38:18 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-79d05f2b-3e02-4091-8e30-b9978aac0abe tempest-VolumeQuotasAdminTestJSON-923854183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:38:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-79d05f2b-3e02-4091-8e30-b9978aac0abe tempest-VolumeQuotasAdminTestJSON-923854183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:38:18 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-79d05f2b-3e02-4091-8e30-b9978aac0abe tempest-VolumeQuotasAdminTestJSON-923854183 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:38:18 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-79d05f2b-3e02-4091-8e30-b9978aac0abe tempest-VolumeQuotasAdminTestJSON-923854183 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:38:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-79d05f2b-3e02-4091-8e30-b9978aac0abe tempest-VolumeQuotasAdminTestJSON-923854183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd292e34-d4e1-49f8-8258-7395edb17058 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:18 devstack sudo[95587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd292e34-d4e1-49f8-8258-7395edb17058 1073741824 Aug 28 09:38:18 devstack sudo[95587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:19 devstack sudo[95587]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-79d05f2b-3e02-4091-8e30-b9978aac0abe tempest-VolumeQuotasAdminTestJSON-923854183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd292e34-d4e1-49f8-8258-7395edb17058 1073741824" returned: 0 in 0.499s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-79d05f2b-3e02-4091-8e30-b9978aac0abe tempest-VolumeQuotasAdminTestJSON-923854183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd292e34-d4e1-49f8-8258-7395edb17058 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:19 devstack sudo[95594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd292e34-d4e1-49f8-8258-7395edb17058 Aug 28 09:38:19 devstack sudo[95594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:19 devstack sudo[95594]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-79d05f2b-3e02-4091-8e30-b9978aac0abe tempest-VolumeQuotasAdminTestJSON-923854183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd292e34-d4e1-49f8-8258-7395edb17058" returned: 0 in 0.283s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:19 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-79d05f2b-3e02-4091-8e30-b9978aac0abe tempest-VolumeQuotasAdminTestJSON-923854183 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:38:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-79d05f2b-3e02-4091-8e30-b9978aac0abe tempest-VolumeQuotasAdminTestJSON-923854183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:38:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-79d05f2b-3e02-4091-8e30-b9978aac0abe tempest-VolumeQuotasAdminTestJSON-923854183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (529391c0-1155-4286-a4f4-813e87de3b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd292e34-d4e1-49f8-8258-7395edb17058', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:38:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-79d05f2b-3e02-4091-8e30-b9978aac0abe tempest-VolumeQuotasAdminTestJSON-923854183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64934f2f-aab2-4c9d-9593-67b149874f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:38:19 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-79d05f2b-3e02-4091-8e30-b9978aac0abe tempest-VolumeQuotasAdminTestJSON-923854183 None] Volume volume-cd292e34-d4e1-49f8-8258-7395edb17058 (cd292e34-d4e1-49f8-8258-7395edb17058): created successfully Aug 28 09:38:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-79d05f2b-3e02-4091-8e30-b9978aac0abe tempest-VolumeQuotasAdminTestJSON-923854183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64934f2f-aab2-4c9d-9593-67b149874f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:38:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-79d05f2b-3e02-4091-8e30-b9978aac0abe tempest-VolumeQuotasAdminTestJSON-923854183 None] Flow 'volume_create_manager' (2bbe5b62-21f1-46c7-ad4b-7b92da9f8dd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:38:19 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-79d05f2b-3e02-4091-8e30-b9978aac0abe tempest-VolumeQuotasAdminTestJSON-923854183 None] Created volume successfully. Aug 28 09:38:20 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-882ce67f-bba2-48a2-ab18-76d96b72847d tempest-AttachVolumeTestJSON-601093567 None] Acquiring lock "cinder-09f7c8c3-8f3d-4e46-ad37-ad607453732e-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:38:20 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-882ce67f-bba2-48a2-ab18-76d96b72847d tempest-AttachVolumeTestJSON-601093567 None] Lock "cinder-09f7c8c3-8f3d-4e46-ad37-ad607453732e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:38:20 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-882ce67f-bba2-48a2-ab18-76d96b72847d tempest-AttachVolumeTestJSON-601093567 None] Acquiring lock "cinder-quobyte-09f7c8c3-8f3d-4e46-ad37-ad607453732e" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:38:20 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-882ce67f-bba2-48a2-ab18-76d96b72847d tempest-AttachVolumeTestJSON-601093567 None] Lock "cinder-quobyte-09f7c8c3-8f3d-4e46-ad37-ad607453732e" acquired by "delete_volume" :: waited 0.015s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:38:20 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b26149-3dc2-492b-b73b-8aeaa04e7a1a]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:38:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-882ce67f-bba2-48a2-ab18-76d96b72847d tempest-AttachVolumeTestJSON-601093567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-09f7c8c3-8f3d-4e46-ad37-ad607453732e {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:20 devstack sudo[95597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-09f7c8c3-8f3d-4e46-ad37-ad607453732e Aug 28 09:38:20 devstack sudo[95597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:20 devstack sudo[95597]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-882ce67f-bba2-48a2-ab18-76d96b72847d tempest-AttachVolumeTestJSON-601093567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-09f7c8c3-8f3d-4e46-ad37-ad607453732e" returned: 0 in 0.357s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-882ce67f-bba2-48a2-ab18-76d96b72847d tempest-AttachVolumeTestJSON-601093567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-09f7c8c3-8f3d-4e46-ad37-ad607453732e {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:20 devstack sudo[95602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-09f7c8c3-8f3d-4e46-ad37-ad607453732e Aug 28 09:38:20 devstack sudo[95602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:20 devstack sudo[95602]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-882ce67f-bba2-48a2-ab18-76d96b72847d tempest-AttachVolumeTestJSON-601093567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-09f7c8c3-8f3d-4e46-ad37-ad607453732e" returned: 0 in 0.246s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:20 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-882ce67f-bba2-48a2-ab18-76d96b72847d tempest-AttachVolumeTestJSON-601093567 None] Lock "cinder-quobyte-09f7c8c3-8f3d-4e46-ad37-ad607453732e" released by "delete_volume" :: held 0.643s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:38:20 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-b9d55b91-5eb9-4d06-8161-0c3db602a627 tempest-VolumeQuotasAdminTestJSON-923854183 None] Acquiring lock "cinder-cd292e34-d4e1-49f8-8258-7395edb17058-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:38:20 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-b9d55b91-5eb9-4d06-8161-0c3db602a627 tempest-VolumeQuotasAdminTestJSON-923854183 None] Lock "cinder-cd292e34-d4e1-49f8-8258-7395edb17058-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:38:20 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-882ce67f-bba2-48a2-ab18-76d96b72847d tempest-AttachVolumeTestJSON-601093567 None] Created reservations ['70f8685b-a195-4107-8dcf-4ca0b70ae720', '1227a7a9-187d-461f-87e3-e35180192fc9', 'dc990e85-2874-43a2-b08c-910a442802bf', '89b82517-7b56-458d-b7c1-f05638cc71b8'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:38:20 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-b9d55b91-5eb9-4d06-8161-0c3db602a627 tempest-VolumeQuotasAdminTestJSON-923854183 None] Acquiring lock "cinder-quobyte-cd292e34-d4e1-49f8-8258-7395edb17058" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:38:20 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-b9d55b91-5eb9-4d06-8161-0c3db602a627 tempest-VolumeQuotasAdminTestJSON-923854183 None] Lock "cinder-quobyte-cd292e34-d4e1-49f8-8258-7395edb17058" acquired by "delete_volume" :: waited 0.022s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:38:20 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[0add7157-ca8c-465e-836d-3b32644b26a3]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:38:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b9d55b91-5eb9-4d06-8161-0c3db602a627 tempest-VolumeQuotasAdminTestJSON-923854183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd292e34-d4e1-49f8-8258-7395edb17058 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-882ce67f-bba2-48a2-ab18-76d96b72847d tempest-AttachVolumeTestJSON-601093567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:38:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-882ce67f-bba2-48a2-ab18-76d96b72847d tempest-AttachVolumeTestJSON-601093567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:38:21 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-882ce67f-bba2-48a2-ab18-76d96b72847d tempest-AttachVolumeTestJSON-601093567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:38:21 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-882ce67f-bba2-48a2-ab18-76d96b72847d tempest-AttachVolumeTestJSON-601093567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:38:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-882ce67f-bba2-48a2-ab18-76d96b72847d tempest-AttachVolumeTestJSON-601093567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:38:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-882ce67f-bba2-48a2-ab18-76d96b72847d tempest-AttachVolumeTestJSON-601093567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:21 devstack sudo[95606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:38:21 devstack sudo[95606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:21 devstack sudo[95605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd292e34-d4e1-49f8-8258-7395edb17058 Aug 28 09:38:21 devstack sudo[95605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:21 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-aece7d0e-c410-4340-99f2-4f8db2a5d7f8 tempest-AttachVolumeTestJSON-601093567 None] Acquiring lock "cinder-8885dcdd-ab7e-41e1-b1c6-2f714b230496-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:38:21 devstack sudo[95606]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:21 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-aece7d0e-c410-4340-99f2-4f8db2a5d7f8 tempest-AttachVolumeTestJSON-601093567 None] Lock "cinder-8885dcdd-ab7e-41e1-b1c6-2f714b230496-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:38:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-882ce67f-bba2-48a2-ab18-76d96b72847d tempest-AttachVolumeTestJSON-601093567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.286s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:21 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-882ce67f-bba2-48a2-ab18-76d96b72847d tempest-AttachVolumeTestJSON-601093567 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:38:21 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-882ce67f-bba2-48a2-ab18-76d96b72847d tempest-AttachVolumeTestJSON-601093567 None] Deleted volume successfully. Aug 28 09:38:21 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-882ce67f-bba2-48a2-ab18-76d96b72847d tempest-AttachVolumeTestJSON-601093567 None] Lock "cinder-09f7c8c3-8f3d-4e46-ad37-ad607453732e-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:38:21 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-aece7d0e-c410-4340-99f2-4f8db2a5d7f8 tempest-AttachVolumeTestJSON-601093567 None] Acquiring lock "cinder-quobyte-8885dcdd-ab7e-41e1-b1c6-2f714b230496" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:38:21 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-aece7d0e-c410-4340-99f2-4f8db2a5d7f8 tempest-AttachVolumeTestJSON-601093567 None] Lock "cinder-quobyte-8885dcdd-ab7e-41e1-b1c6-2f714b230496" acquired by "delete_volume" :: waited 0.021s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:38:21 devstack sudo[95605]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b9d55b91-5eb9-4d06-8161-0c3db602a627 tempest-VolumeQuotasAdminTestJSON-923854183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd292e34-d4e1-49f8-8258-7395edb17058" returned: 0 in 0.408s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b9d55b91-5eb9-4d06-8161-0c3db602a627 tempest-VolumeQuotasAdminTestJSON-923854183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd292e34-d4e1-49f8-8258-7395edb17058 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:21 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b79525a-7c9b-4129-9517-5ad70e744417]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:38:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-aece7d0e-c410-4340-99f2-4f8db2a5d7f8 tempest-AttachVolumeTestJSON-601093567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8885dcdd-ab7e-41e1-b1c6-2f714b230496 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:21 devstack sudo[95613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd292e34-d4e1-49f8-8258-7395edb17058 Aug 28 09:38:21 devstack sudo[95613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:21 devstack sudo[95614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8885dcdd-ab7e-41e1-b1c6-2f714b230496 Aug 28 09:38:21 devstack sudo[95614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:21 devstack sudo[95613]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b9d55b91-5eb9-4d06-8161-0c3db602a627 tempest-VolumeQuotasAdminTestJSON-923854183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd292e34-d4e1-49f8-8258-7395edb17058" returned: 0 in 0.252s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:21 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-b9d55b91-5eb9-4d06-8161-0c3db602a627 tempest-VolumeQuotasAdminTestJSON-923854183 None] Lock "cinder-quobyte-cd292e34-d4e1-49f8-8258-7395edb17058" released by "delete_volume" :: held 0.706s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:38:21 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-b9d55b91-5eb9-4d06-8161-0c3db602a627 tempest-VolumeQuotasAdminTestJSON-923854183 None] Created reservations ['9d2c5416-8b0f-452e-be0b-d04322942cf5', '9c37b726-8b20-4516-8497-f48fb6cac0c9', 'ba9c2a0f-4a1c-40d9-ac2b-9af479c52dca', '5a82ee8e-058c-4d8a-b2c7-e72de036466c'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:38:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b9d55b91-5eb9-4d06-8161-0c3db602a627 tempest-VolumeQuotasAdminTestJSON-923854183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:38:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b9d55b91-5eb9-4d06-8161-0c3db602a627 tempest-VolumeQuotasAdminTestJSON-923854183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:38:21 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-b9d55b91-5eb9-4d06-8161-0c3db602a627 tempest-VolumeQuotasAdminTestJSON-923854183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:38:21 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-b9d55b91-5eb9-4d06-8161-0c3db602a627 tempest-VolumeQuotasAdminTestJSON-923854183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:38:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b9d55b91-5eb9-4d06-8161-0c3db602a627 tempest-VolumeQuotasAdminTestJSON-923854183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:38:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b9d55b91-5eb9-4d06-8161-0c3db602a627 tempest-VolumeQuotasAdminTestJSON-923854183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:21 devstack sudo[95614]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-aece7d0e-c410-4340-99f2-4f8db2a5d7f8 tempest-AttachVolumeTestJSON-601093567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8885dcdd-ab7e-41e1-b1c6-2f714b230496" returned: 0 in 0.380s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-aece7d0e-c410-4340-99f2-4f8db2a5d7f8 tempest-AttachVolumeTestJSON-601093567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8885dcdd-ab7e-41e1-b1c6-2f714b230496 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:21 devstack sudo[95621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:38:21 devstack sudo[95621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:21 devstack sudo[95622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8885dcdd-ab7e-41e1-b1c6-2f714b230496 Aug 28 09:38:21 devstack sudo[95622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:22 devstack sudo[95621]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b9d55b91-5eb9-4d06-8161-0c3db602a627 tempest-VolumeQuotasAdminTestJSON-923854183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.259s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:22 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-b9d55b91-5eb9-4d06-8161-0c3db602a627 tempest-VolumeQuotasAdminTestJSON-923854183 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:38:22 devstack sudo[95622]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:22 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-b9d55b91-5eb9-4d06-8161-0c3db602a627 tempest-VolumeQuotasAdminTestJSON-923854183 None] Deleted volume successfully. Aug 28 09:38:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-aece7d0e-c410-4340-99f2-4f8db2a5d7f8 tempest-AttachVolumeTestJSON-601093567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8885dcdd-ab7e-41e1-b1c6-2f714b230496" returned: 0 in 0.262s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:22 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-aece7d0e-c410-4340-99f2-4f8db2a5d7f8 tempest-AttachVolumeTestJSON-601093567 None] Lock "cinder-quobyte-8885dcdd-ab7e-41e1-b1c6-2f714b230496" released by "delete_volume" :: held 0.695s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:38:22 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-b9d55b91-5eb9-4d06-8161-0c3db602a627 tempest-VolumeQuotasAdminTestJSON-923854183 None] Lock "cinder-cd292e34-d4e1-49f8-8258-7395edb17058-delete_volume" released by "delete_volume" :: held 1.198s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:38:22 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-aece7d0e-c410-4340-99f2-4f8db2a5d7f8 tempest-AttachVolumeTestJSON-601093567 None] Created reservations ['93a9a55c-483d-4506-bbdb-f1a8c58522e3', '6f6d0f54-9edb-4979-b7e6-3c7c9810d349', 'be843456-0446-4499-ac33-b84f89d89eae', 'e1219c12-98bf-4208-8947-ceb08e86d43d'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:38:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-aece7d0e-c410-4340-99f2-4f8db2a5d7f8 tempest-AttachVolumeTestJSON-601093567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:38:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-aece7d0e-c410-4340-99f2-4f8db2a5d7f8 tempest-AttachVolumeTestJSON-601093567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:38:22 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-aece7d0e-c410-4340-99f2-4f8db2a5d7f8 tempest-AttachVolumeTestJSON-601093567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:38:22 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-aece7d0e-c410-4340-99f2-4f8db2a5d7f8 tempest-AttachVolumeTestJSON-601093567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:38:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-aece7d0e-c410-4340-99f2-4f8db2a5d7f8 tempest-AttachVolumeTestJSON-601093567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:38:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-aece7d0e-c410-4340-99f2-4f8db2a5d7f8 tempest-AttachVolumeTestJSON-601093567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:22 devstack sudo[95627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:38:22 devstack sudo[95627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:22 devstack sudo[95627]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-aece7d0e-c410-4340-99f2-4f8db2a5d7f8 tempest-AttachVolumeTestJSON-601093567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.255s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:22 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-aece7d0e-c410-4340-99f2-4f8db2a5d7f8 tempest-AttachVolumeTestJSON-601093567 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:38:22 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-aece7d0e-c410-4340-99f2-4f8db2a5d7f8 tempest-AttachVolumeTestJSON-601093567 None] Deleted volume successfully. Aug 28 09:38:22 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-aece7d0e-c410-4340-99f2-4f8db2a5d7f8 tempest-AttachVolumeTestJSON-601093567 None] Lock "cinder-8885dcdd-ab7e-41e1-b1c6-2f714b230496-delete_volume" released by "delete_volume" :: held 1.198s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:38:22 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-be57c710-2bba-4f14-ab65-df9aa023a6ee tempest-AttachVolumeTestJSON-601093567 None] Acquiring lock "cinder-6097feec-ae6a-48a3-b80a-623e358517b8-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:38:22 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-be57c710-2bba-4f14-ab65-df9aa023a6ee tempest-AttachVolumeTestJSON-601093567 None] Lock "cinder-6097feec-ae6a-48a3-b80a-623e358517b8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:38:22 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-caabeed1-9e6f-4b24-ab5a-d79bc2efae25 tempest-VolumeQuotasAdminTestJSON-923854183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:38:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-caabeed1-9e6f-4b24-ab5a-d79bc2efae25 tempest-VolumeQuotasAdminTestJSON-923854183 None] Flow 'volume_create_manager' (52c70b49-ff8b-4676-a673-271795ec0e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:38:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-caabeed1-9e6f-4b24-ab5a-d79bc2efae25 tempest-VolumeQuotasAdminTestJSON-923854183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6a1de06-929c-47f0-a6f1-30cd10017225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:38:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-caabeed1-9e6f-4b24-ab5a-d79bc2efae25 tempest-VolumeQuotasAdminTestJSON-923854183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6a1de06-929c-47f0-a6f1-30cd10017225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:38:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-472874886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=908b2702-ece4-427c-bc4a-382a653083f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccf242ead78f438db667185c6e6cf5d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:38:23Z,use_quota=True,user_id='6968f0ed28ce4080a888def13ec98bd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:38:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-caabeed1-9e6f-4b24-ab5a-d79bc2efae25 tempest-VolumeQuotasAdminTestJSON-923854183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f33cf61-f644-438e-8b25-84bcae7b242d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:38:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-caabeed1-9e6f-4b24-ab5a-d79bc2efae25 tempest-VolumeQuotasAdminTestJSON-923854183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f33cf61-f644-438e-8b25-84bcae7b242d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:38:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-caabeed1-9e6f-4b24-ab5a-d79bc2efae25 tempest-VolumeQuotasAdminTestJSON-923854183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d58a28a-10e7-4860-94fb-779d2bf4c341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:38:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-caabeed1-9e6f-4b24-ab5a-d79bc2efae25 tempest-VolumeQuotasAdminTestJSON-923854183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d58a28a-10e7-4860-94fb-779d2bf4c341) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '908b2702-ece4-427c-bc4a-382a653083f3', 'volume_name': 'volume-908b2702-ece4-427c-bc4a-382a653083f3', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:38:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-caabeed1-9e6f-4b24-ab5a-d79bc2efae25 tempest-VolumeQuotasAdminTestJSON-923854183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60035c4f-006f-4fec-aee5-9073d8425016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:38:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-caabeed1-9e6f-4b24-ab5a-d79bc2efae25 tempest-VolumeQuotasAdminTestJSON-923854183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60035c4f-006f-4fec-aee5-9073d8425016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:38:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-caabeed1-9e6f-4b24-ab5a-d79bc2efae25 tempest-VolumeQuotasAdminTestJSON-923854183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4530b82c-0e83-4b5f-8714-3afefb640f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:38:22 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-caabeed1-9e6f-4b24-ab5a-d79bc2efae25 tempest-VolumeQuotasAdminTestJSON-923854183 None] Volume 908b2702-ece4-427c-bc4a-382a653083f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-908b2702-ece4-427c-bc4a-382a653083f3', 'volume_size': 1} Aug 28 09:38:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-caabeed1-9e6f-4b24-ab5a-d79bc2efae25 tempest-VolumeQuotasAdminTestJSON-923854183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:38:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-caabeed1-9e6f-4b24-ab5a-d79bc2efae25 tempest-VolumeQuotasAdminTestJSON-923854183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:38:22 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-caabeed1-9e6f-4b24-ab5a-d79bc2efae25 tempest-VolumeQuotasAdminTestJSON-923854183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:38:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-472874886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=908b2702-ece4-427c-bc4a-382a653083f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccf242ead78f438db667185c6e6cf5d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:38:23Z,use_quota=True,user_id='6968f0ed28ce4080a888def13ec98bd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:38:22 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-caabeed1-9e6f-4b24-ab5a-d79bc2efae25 tempest-VolumeQuotasAdminTestJSON-923854183 None] Creating volume 908b2702-ece4-427c-bc4a-382a653083f3 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:38:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-caabeed1-9e6f-4b24-ab5a-d79bc2efae25 tempest-VolumeQuotasAdminTestJSON-923854183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:38:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-caabeed1-9e6f-4b24-ab5a-d79bc2efae25 tempest-VolumeQuotasAdminTestJSON-923854183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:38:22 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-caabeed1-9e6f-4b24-ab5a-d79bc2efae25 tempest-VolumeQuotasAdminTestJSON-923854183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:38:22 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-caabeed1-9e6f-4b24-ab5a-d79bc2efae25 tempest-VolumeQuotasAdminTestJSON-923854183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:38:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-caabeed1-9e6f-4b24-ab5a-d79bc2efae25 tempest-VolumeQuotasAdminTestJSON-923854183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:38:22 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-caabeed1-9e6f-4b24-ab5a-d79bc2efae25 tempest-VolumeQuotasAdminTestJSON-923854183 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:38:22 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-caabeed1-9e6f-4b24-ab5a-d79bc2efae25 tempest-VolumeQuotasAdminTestJSON-923854183 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:38:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-caabeed1-9e6f-4b24-ab5a-d79bc2efae25 tempest-VolumeQuotasAdminTestJSON-923854183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-908b2702-ece4-427c-bc4a-382a653083f3 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:22 devstack sudo[95630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-908b2702-ece4-427c-bc4a-382a653083f3 1073741824 Aug 28 09:38:22 devstack sudo[95630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:22 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-be57c710-2bba-4f14-ab65-df9aa023a6ee tempest-AttachVolumeTestJSON-601093567 None] Acquiring lock "cinder-quobyte-6097feec-ae6a-48a3-b80a-623e358517b8" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:38:22 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-be57c710-2bba-4f14-ab65-df9aa023a6ee tempest-AttachVolumeTestJSON-601093567 None] Lock "cinder-quobyte-6097feec-ae6a-48a3-b80a-623e358517b8" acquired by "delete_volume" :: waited 0.016s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:38:22 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ddd414-7d07-4f12-b62d-89428af455ec]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:38:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-be57c710-2bba-4f14-ab65-df9aa023a6ee tempest-AttachVolumeTestJSON-601093567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6097feec-ae6a-48a3-b80a-623e358517b8 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:22 devstack sudo[95632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6097feec-ae6a-48a3-b80a-623e358517b8 Aug 28 09:38:22 devstack sudo[95632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:23 devstack sudo[95630]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-caabeed1-9e6f-4b24-ab5a-d79bc2efae25 tempest-VolumeQuotasAdminTestJSON-923854183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-908b2702-ece4-427c-bc4a-382a653083f3 1073741824" returned: 0 in 0.431s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:23 devstack sudo[95632]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-be57c710-2bba-4f14-ab65-df9aa023a6ee tempest-AttachVolumeTestJSON-601093567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6097feec-ae6a-48a3-b80a-623e358517b8" returned: 0 in 0.381s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-be57c710-2bba-4f14-ab65-df9aa023a6ee tempest-AttachVolumeTestJSON-601093567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6097feec-ae6a-48a3-b80a-623e358517b8 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-caabeed1-9e6f-4b24-ab5a-d79bc2efae25 tempest-VolumeQuotasAdminTestJSON-923854183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-908b2702-ece4-427c-bc4a-382a653083f3 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:23 devstack sudo[95640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6097feec-ae6a-48a3-b80a-623e358517b8 Aug 28 09:38:23 devstack sudo[95640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:23 devstack sudo[95641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-908b2702-ece4-427c-bc4a-382a653083f3 Aug 28 09:38:23 devstack sudo[95641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:23 devstack sudo[95640]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-be57c710-2bba-4f14-ab65-df9aa023a6ee tempest-AttachVolumeTestJSON-601093567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6097feec-ae6a-48a3-b80a-623e358517b8" returned: 0 in 0.251s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:23 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-be57c710-2bba-4f14-ab65-df9aa023a6ee tempest-AttachVolumeTestJSON-601093567 None] Lock "cinder-quobyte-6097feec-ae6a-48a3-b80a-623e358517b8" released by "delete_volume" :: held 0.677s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:38:23 devstack sudo[95641]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-caabeed1-9e6f-4b24-ab5a-d79bc2efae25 tempest-VolumeQuotasAdminTestJSON-923854183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-908b2702-ece4-427c-bc4a-382a653083f3" returned: 0 in 0.253s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:23 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-caabeed1-9e6f-4b24-ab5a-d79bc2efae25 tempest-VolumeQuotasAdminTestJSON-923854183 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:38:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-caabeed1-9e6f-4b24-ab5a-d79bc2efae25 tempest-VolumeQuotasAdminTestJSON-923854183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:38:23 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-caabeed1-9e6f-4b24-ab5a-d79bc2efae25 tempest-VolumeQuotasAdminTestJSON-923854183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4530b82c-0e83-4b5f-8714-3afefb640f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-908b2702-ece4-427c-bc4a-382a653083f3', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:38:23 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-caabeed1-9e6f-4b24-ab5a-d79bc2efae25 tempest-VolumeQuotasAdminTestJSON-923854183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27a33370-450a-407d-8492-fe20dbaae02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:38:23 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-caabeed1-9e6f-4b24-ab5a-d79bc2efae25 tempest-VolumeQuotasAdminTestJSON-923854183 None] Volume volume-908b2702-ece4-427c-bc4a-382a653083f3 (908b2702-ece4-427c-bc4a-382a653083f3): created successfully Aug 28 09:38:23 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-caabeed1-9e6f-4b24-ab5a-d79bc2efae25 tempest-VolumeQuotasAdminTestJSON-923854183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27a33370-450a-407d-8492-fe20dbaae02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:38:23 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-caabeed1-9e6f-4b24-ab5a-d79bc2efae25 tempest-VolumeQuotasAdminTestJSON-923854183 None] Flow 'volume_create_manager' (52c70b49-ff8b-4676-a673-271795ec0e9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:38:23 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-caabeed1-9e6f-4b24-ab5a-d79bc2efae25 tempest-VolumeQuotasAdminTestJSON-923854183 None] Created volume successfully. Aug 28 09:38:23 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-be57c710-2bba-4f14-ab65-df9aa023a6ee tempest-AttachVolumeTestJSON-601093567 None] Created reservations ['9cd4e3f0-65c7-467d-8e78-5e7d0c76a9a7', 'f3365fd1-9181-4fff-9e82-8ec98235b447', '8a48669e-cea7-4519-989d-d799fab264c2', '75073f88-291d-4468-b7b0-163f89913a1f'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:38:23 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writing DB stats cinder:UPDATE=87,cinder:SELECT=86,cinder:INSERT=26,cinder:DELETE=5 {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:38:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-be57c710-2bba-4f14-ab65-df9aa023a6ee tempest-AttachVolumeTestJSON-601093567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:38:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-be57c710-2bba-4f14-ab65-df9aa023a6ee tempest-AttachVolumeTestJSON-601093567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:38:23 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-be57c710-2bba-4f14-ab65-df9aa023a6ee tempest-AttachVolumeTestJSON-601093567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:38:23 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-be57c710-2bba-4f14-ab65-df9aa023a6ee tempest-AttachVolumeTestJSON-601093567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:38:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-be57c710-2bba-4f14-ab65-df9aa023a6ee tempest-AttachVolumeTestJSON-601093567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:38:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-be57c710-2bba-4f14-ab65-df9aa023a6ee tempest-AttachVolumeTestJSON-601093567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:23 devstack sudo[95646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:38:23 devstack sudo[95646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:23 devstack sudo[95646]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-be57c710-2bba-4f14-ab65-df9aa023a6ee tempest-AttachVolumeTestJSON-601093567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.316s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:23 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-be57c710-2bba-4f14-ab65-df9aa023a6ee tempest-AttachVolumeTestJSON-601093567 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:38:23 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-be57c710-2bba-4f14-ab65-df9aa023a6ee tempest-AttachVolumeTestJSON-601093567 None] Deleted volume successfully. Aug 28 09:38:23 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-be57c710-2bba-4f14-ab65-df9aa023a6ee tempest-AttachVolumeTestJSON-601093567 None] Lock "cinder-6097feec-ae6a-48a3-b80a-623e358517b8-delete_volume" released by "delete_volume" :: held 1.349s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:38:24 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writing DB stats cinder:SELECT=99,cinder:INSERT=21,cinder:UPDATE=93,cinder:DELETE=10 {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:38:24 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-9886213a-cbe6-4a3d-b820-cc33d6494f32 tempest-VolumeQuotasAdminTestJSON-177566747 None] Transfer volume completed successfully. Aug 28 09:38:24 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-7c1703d5-9e39-49a2-8ffc-91ce70bd9227 tempest-VolumeQuotasAdminTestJSON-1678958287 None] Acquiring lock "cinder-908b2702-ece4-427c-bc4a-382a653083f3-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:38:24 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-7c1703d5-9e39-49a2-8ffc-91ce70bd9227 tempest-VolumeQuotasAdminTestJSON-1678958287 None] Lock "cinder-908b2702-ece4-427c-bc4a-382a653083f3-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:38:25 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-7c1703d5-9e39-49a2-8ffc-91ce70bd9227 tempest-VolumeQuotasAdminTestJSON-1678958287 None] Acquiring lock "cinder-quobyte-908b2702-ece4-427c-bc4a-382a653083f3" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:38:25 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-7c1703d5-9e39-49a2-8ffc-91ce70bd9227 tempest-VolumeQuotasAdminTestJSON-1678958287 None] Lock "cinder-quobyte-908b2702-ece4-427c-bc4a-382a653083f3" acquired by "delete_volume" :: waited 0.015s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:38:25 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[05de6c30-6f6a-49fe-9731-078d934d404a]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:38:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7c1703d5-9e39-49a2-8ffc-91ce70bd9227 tempest-VolumeQuotasAdminTestJSON-1678958287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-908b2702-ece4-427c-bc4a-382a653083f3 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:25 devstack sudo[95649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-908b2702-ece4-427c-bc4a-382a653083f3 Aug 28 09:38:25 devstack sudo[95649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:25 devstack sudo[95649]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7c1703d5-9e39-49a2-8ffc-91ce70bd9227 tempest-VolumeQuotasAdminTestJSON-1678958287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-908b2702-ece4-427c-bc4a-382a653083f3" returned: 0 in 0.521s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7c1703d5-9e39-49a2-8ffc-91ce70bd9227 tempest-VolumeQuotasAdminTestJSON-1678958287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-908b2702-ece4-427c-bc4a-382a653083f3 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:25 devstack sudo[95655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-908b2702-ece4-427c-bc4a-382a653083f3 Aug 28 09:38:25 devstack sudo[95655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:25 devstack sudo[95655]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7c1703d5-9e39-49a2-8ffc-91ce70bd9227 tempest-VolumeQuotasAdminTestJSON-1678958287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-908b2702-ece4-427c-bc4a-382a653083f3" returned: 0 in 0.396s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:25 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-7c1703d5-9e39-49a2-8ffc-91ce70bd9227 tempest-VolumeQuotasAdminTestJSON-1678958287 None] Lock "cinder-quobyte-908b2702-ece4-427c-bc4a-382a653083f3" released by "delete_volume" :: held 0.978s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:38:26 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-7c1703d5-9e39-49a2-8ffc-91ce70bd9227 tempest-VolumeQuotasAdminTestJSON-1678958287 None] Created reservations ['489146b4-21cc-44e8-b8c7-7a4fb992dfdf', '0513b500-e232-4a72-9ae9-f1c8a233093b', 'b673c3ae-3d4f-4804-b887-bbf2921f13d1', '5b35da16-a19c-42a7-acc5-dfe6c424de0f'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:38:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-7c1703d5-9e39-49a2-8ffc-91ce70bd9227 tempest-VolumeQuotasAdminTestJSON-1678958287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:38:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-7c1703d5-9e39-49a2-8ffc-91ce70bd9227 tempest-VolumeQuotasAdminTestJSON-1678958287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:38:26 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-7c1703d5-9e39-49a2-8ffc-91ce70bd9227 tempest-VolumeQuotasAdminTestJSON-1678958287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:38:26 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-7c1703d5-9e39-49a2-8ffc-91ce70bd9227 tempest-VolumeQuotasAdminTestJSON-1678958287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:38:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-7c1703d5-9e39-49a2-8ffc-91ce70bd9227 tempest-VolumeQuotasAdminTestJSON-1678958287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:38:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7c1703d5-9e39-49a2-8ffc-91ce70bd9227 tempest-VolumeQuotasAdminTestJSON-1678958287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:26 devstack sudo[95670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:38:26 devstack sudo[95670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:26 devstack sudo[95670]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7c1703d5-9e39-49a2-8ffc-91ce70bd9227 tempest-VolumeQuotasAdminTestJSON-1678958287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.433s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:26 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-7c1703d5-9e39-49a2-8ffc-91ce70bd9227 tempest-VolumeQuotasAdminTestJSON-1678958287 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:38:26 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-7c1703d5-9e39-49a2-8ffc-91ce70bd9227 tempest-VolumeQuotasAdminTestJSON-1678958287 None] Deleted volume successfully. Aug 28 09:38:26 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-7c1703d5-9e39-49a2-8ffc-91ce70bd9227 tempest-VolumeQuotasAdminTestJSON-1678958287 None] Lock "cinder-908b2702-ece4-427c-bc4a-382a653083f3-delete_volume" released by "delete_volume" :: held 1.836s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:38:26 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8c0eb34-7918-47c5-ba13-f06e12b8204c tempest-AttachVolumeNegativeTest-1867820442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:38:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b8c0eb34-7918-47c5-ba13-f06e12b8204c tempest-AttachVolumeNegativeTest-1867820442 None] Flow 'volume_create_manager' (09f97a7c-f75f-4303-908d-bc6fb97f6c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:38:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b8c0eb34-7918-47c5-ba13-f06e12b8204c tempest-AttachVolumeNegativeTest-1867820442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c06049b2-216d-4565-b468-8f71e6b7093a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:38:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b8c0eb34-7918-47c5-ba13-f06e12b8204c tempest-AttachVolumeNegativeTest-1867820442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c06049b2-216d-4565-b468-8f71e6b7093a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:38:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-945522530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42cbc235-8f5c-4559-8c65-4c062cc2a1ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44a80d5e47094bc58d0bce329e32f15e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:38:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:38:27Z,use_quota=True,user_id='74867e4ae611477aa97b45f6b6fb70b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:38:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b8c0eb34-7918-47c5-ba13-f06e12b8204c tempest-AttachVolumeNegativeTest-1867820442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f419c1f3-1538-4c31-9853-f0aa422f5f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:38:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b8c0eb34-7918-47c5-ba13-f06e12b8204c tempest-AttachVolumeNegativeTest-1867820442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f419c1f3-1538-4c31-9853-f0aa422f5f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:38:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b8c0eb34-7918-47c5-ba13-f06e12b8204c tempest-AttachVolumeNegativeTest-1867820442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c906f991-5894-4a68-b7f7-1ca40426f422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:38:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b8c0eb34-7918-47c5-ba13-f06e12b8204c tempest-AttachVolumeNegativeTest-1867820442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c906f991-5894-4a68-b7f7-1ca40426f422) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42cbc235-8f5c-4559-8c65-4c062cc2a1ba', 'volume_name': 'volume-42cbc235-8f5c-4559-8c65-4c062cc2a1ba', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:38:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b8c0eb34-7918-47c5-ba13-f06e12b8204c tempest-AttachVolumeNegativeTest-1867820442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55e00412-f9bd-4abb-bb0e-1a4264357c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:38:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b8c0eb34-7918-47c5-ba13-f06e12b8204c tempest-AttachVolumeNegativeTest-1867820442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55e00412-f9bd-4abb-bb0e-1a4264357c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:38:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b8c0eb34-7918-47c5-ba13-f06e12b8204c tempest-AttachVolumeNegativeTest-1867820442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a559745-f6a6-4aaa-aa89-9528782f44bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:38:27 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-b8c0eb34-7918-47c5-ba13-f06e12b8204c tempest-AttachVolumeNegativeTest-1867820442 None] Volume 42cbc235-8f5c-4559-8c65-4c062cc2a1ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42cbc235-8f5c-4559-8c65-4c062cc2a1ba', 'volume_size': 1} Aug 28 09:38:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b8c0eb34-7918-47c5-ba13-f06e12b8204c tempest-AttachVolumeNegativeTest-1867820442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:38:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b8c0eb34-7918-47c5-ba13-f06e12b8204c tempest-AttachVolumeNegativeTest-1867820442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:38:27 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-b8c0eb34-7918-47c5-ba13-f06e12b8204c tempest-AttachVolumeNegativeTest-1867820442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:38:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-945522530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42cbc235-8f5c-4559-8c65-4c062cc2a1ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44a80d5e47094bc58d0bce329e32f15e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:38:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:38:27Z,use_quota=True,user_id='74867e4ae611477aa97b45f6b6fb70b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:38:27 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-b8c0eb34-7918-47c5-ba13-f06e12b8204c tempest-AttachVolumeNegativeTest-1867820442 None] Creating volume 42cbc235-8f5c-4559-8c65-4c062cc2a1ba {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:38:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b8c0eb34-7918-47c5-ba13-f06e12b8204c tempest-AttachVolumeNegativeTest-1867820442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:38:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b8c0eb34-7918-47c5-ba13-f06e12b8204c tempest-AttachVolumeNegativeTest-1867820442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:38:27 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-b8c0eb34-7918-47c5-ba13-f06e12b8204c tempest-AttachVolumeNegativeTest-1867820442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:38:27 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-b8c0eb34-7918-47c5-ba13-f06e12b8204c tempest-AttachVolumeNegativeTest-1867820442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:38:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b8c0eb34-7918-47c5-ba13-f06e12b8204c tempest-AttachVolumeNegativeTest-1867820442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:38:27 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-b8c0eb34-7918-47c5-ba13-f06e12b8204c tempest-AttachVolumeNegativeTest-1867820442 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:38:27 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-b8c0eb34-7918-47c5-ba13-f06e12b8204c tempest-AttachVolumeNegativeTest-1867820442 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:38:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b8c0eb34-7918-47c5-ba13-f06e12b8204c tempest-AttachVolumeNegativeTest-1867820442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-42cbc235-8f5c-4559-8c65-4c062cc2a1ba 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:27 devstack sudo[95673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-42cbc235-8f5c-4559-8c65-4c062cc2a1ba 1073741824 Aug 28 09:38:27 devstack sudo[95673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:27 devstack sudo[95673]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b8c0eb34-7918-47c5-ba13-f06e12b8204c tempest-AttachVolumeNegativeTest-1867820442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-42cbc235-8f5c-4559-8c65-4c062cc2a1ba 1073741824" returned: 0 in 0.523s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b8c0eb34-7918-47c5-ba13-f06e12b8204c tempest-AttachVolumeNegativeTest-1867820442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-42cbc235-8f5c-4559-8c65-4c062cc2a1ba {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:27 devstack sudo[95685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-42cbc235-8f5c-4559-8c65-4c062cc2a1ba Aug 28 09:38:27 devstack sudo[95685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:27 devstack sudo[95685]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b8c0eb34-7918-47c5-ba13-f06e12b8204c tempest-AttachVolumeNegativeTest-1867820442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-42cbc235-8f5c-4559-8c65-4c062cc2a1ba" returned: 0 in 0.270s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:27 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-b8c0eb34-7918-47c5-ba13-f06e12b8204c tempest-AttachVolumeNegativeTest-1867820442 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:38:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b8c0eb34-7918-47c5-ba13-f06e12b8204c tempest-AttachVolumeNegativeTest-1867820442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:38:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b8c0eb34-7918-47c5-ba13-f06e12b8204c tempest-AttachVolumeNegativeTest-1867820442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a559745-f6a6-4aaa-aa89-9528782f44bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42cbc235-8f5c-4559-8c65-4c062cc2a1ba', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:38:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b8c0eb34-7918-47c5-ba13-f06e12b8204c tempest-AttachVolumeNegativeTest-1867820442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad165213-215a-4352-bf0f-47a8178b0cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:38:27 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-b8c0eb34-7918-47c5-ba13-f06e12b8204c tempest-AttachVolumeNegativeTest-1867820442 None] Volume volume-42cbc235-8f5c-4559-8c65-4c062cc2a1ba (42cbc235-8f5c-4559-8c65-4c062cc2a1ba): created successfully Aug 28 09:38:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b8c0eb34-7918-47c5-ba13-f06e12b8204c tempest-AttachVolumeNegativeTest-1867820442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad165213-215a-4352-bf0f-47a8178b0cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:38:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b8c0eb34-7918-47c5-ba13-f06e12b8204c tempest-AttachVolumeNegativeTest-1867820442 None] Flow 'volume_create_manager' (09f97a7c-f75f-4303-908d-bc6fb97f6c6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:38:27 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-b8c0eb34-7918-47c5-ba13-f06e12b8204c tempest-AttachVolumeNegativeTest-1867820442 None] Created volume successfully. Aug 28 09:38:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-670c7240-daa2-4d83-a0af-c7c4f50a28be req-83acbf47-666e-418c-a55b-e46a2146b68e tempest-AttachVolumeNegativeTest-1867820442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:38:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-670c7240-daa2-4d83-a0af-c7c4f50a28be req-83acbf47-666e-418c-a55b-e46a2146b68e tempest-AttachVolumeNegativeTest-1867820442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:38:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-670c7240-daa2-4d83-a0af-c7c4f50a28be req-83acbf47-666e-418c-a55b-e46a2146b68e tempest-AttachVolumeNegativeTest-1867820442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:38:29 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-670c7240-daa2-4d83-a0af-c7c4f50a28be req-83acbf47-666e-418c-a55b-e46a2146b68e tempest-AttachVolumeNegativeTest-1867820442 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b', 'name': 'volume-42cbc235-8f5c-4559-8c65-4c062cc2a1ba', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fca7802f-8c14-451d-ac28-48ef4e166efe', 'enforce_multipath': True} {{(pid=86081) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 09:38:29 devstack cinder-volume[86081]: INFO cinder.volume.manager [req-670c7240-daa2-4d83-a0af-c7c4f50a28be req-83acbf47-666e-418c-a55b-e46a2146b68e tempest-AttachVolumeNegativeTest-1867820442 None] attachment_update completed successfully. Aug 28 09:38:31 devstack cinder-volume[86081]: INFO cinder.volume.manager [req-75d1d3e5-721b-4aeb-931a-306395bfabc5 req-c3dcc70e-2e5c-4796-a536-2350bd448ad9 tempest-AttachVolumeNegativeTest-1867820442 None] Terminate volume connection completed successfully. Aug 28 09:38:31 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-75d1d3e5-721b-4aeb-931a-306395bfabc5 req-c3dcc70e-2e5c-4796-a536-2350bd448ad9 tempest-AttachVolumeNegativeTest-1867820442 None] Deleting attachment fca7802f-8c14-451d-ac28-48ef4e166efe. {{(pid=86081) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 09:38:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-ee7b1fae-29fb-40d6-80bd-069945b8fdd4 req-660bfaa0-3b7f-4ec7-a98a-b09db630f72d tempest-TestInstancesWithCinderVolumes-726122166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:38:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-ee7b1fae-29fb-40d6-80bd-069945b8fdd4 req-660bfaa0-3b7f-4ec7-a98a-b09db630f72d tempest-TestInstancesWithCinderVolumes-726122166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:38:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-ee7b1fae-29fb-40d6-80bd-069945b8fdd4 req-660bfaa0-3b7f-4ec7-a98a-b09db630f72d tempest-TestInstancesWithCinderVolumes-726122166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:38:34 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-ee7b1fae-29fb-40d6-80bd-069945b8fdd4 req-660bfaa0-3b7f-4ec7-a98a-b09db630f72d tempest-TestInstancesWithCinderVolumes-726122166 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b', 'name': 'volume-8b456b25-c720-412f-a299-fbb9ad5db242', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd78e9c7d-9782-4da5-a7ff-60c3f9e71115', 'enforce_multipath': True} {{(pid=86081) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 09:38:34 devstack cinder-volume[86081]: INFO cinder.volume.manager [req-ee7b1fae-29fb-40d6-80bd-069945b8fdd4 req-660bfaa0-3b7f-4ec7-a98a-b09db630f72d tempest-TestInstancesWithCinderVolumes-726122166 None] attachment_update completed successfully. Aug 28 09:38:36 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-573448f5-f910-48c7-81f2-2aebd0ac2d3b tempest-VolumesServicesTestJSON-1401455818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:38:36 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-573448f5-f910-48c7-81f2-2aebd0ac2d3b tempest-VolumesServicesTestJSON-1401455818 None] Flow 'volume_create_manager' (2f332203-f9ee-4934-98cb-81937005306b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:38:36 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-573448f5-f910-48c7-81f2-2aebd0ac2d3b tempest-VolumesServicesTestJSON-1401455818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c502157f-3d22-49e6-a00e-46ecdce99fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:38:36 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-573448f5-f910-48c7-81f2-2aebd0ac2d3b tempest-VolumesServicesTestJSON-1401455818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c502157f-3d22-49e6-a00e-46ecdce99fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:38:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1808897808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1d80db5-856f-4641-bdd8-41715142e6c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='540dab0984e04804b6028fc7cde9a47f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:38:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:38:36Z,use_quota=True,user_id='fc91db03d2844f68a342bd58429c0f83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:38:36 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-573448f5-f910-48c7-81f2-2aebd0ac2d3b tempest-VolumesServicesTestJSON-1401455818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (357b5b62-c78e-4909-a41b-9d360495431c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:38:36 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-573448f5-f910-48c7-81f2-2aebd0ac2d3b tempest-VolumesServicesTestJSON-1401455818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (357b5b62-c78e-4909-a41b-9d360495431c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:38:36 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-573448f5-f910-48c7-81f2-2aebd0ac2d3b tempest-VolumesServicesTestJSON-1401455818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbefc3b9-4882-4627-8565-71c449d87ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:38:36 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-573448f5-f910-48c7-81f2-2aebd0ac2d3b tempest-VolumesServicesTestJSON-1401455818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbefc3b9-4882-4627-8565-71c449d87ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1d80db5-856f-4641-bdd8-41715142e6c3', 'volume_name': 'volume-c1d80db5-856f-4641-bdd8-41715142e6c3', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:38:36 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-573448f5-f910-48c7-81f2-2aebd0ac2d3b tempest-VolumesServicesTestJSON-1401455818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a126317-7b04-4541-b9d7-a09c37493f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:38:36 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-573448f5-f910-48c7-81f2-2aebd0ac2d3b tempest-VolumesServicesTestJSON-1401455818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a126317-7b04-4541-b9d7-a09c37493f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:38:36 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-573448f5-f910-48c7-81f2-2aebd0ac2d3b tempest-VolumesServicesTestJSON-1401455818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02f86154-292b-4727-b12f-b4b7079c41fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:38:36 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-573448f5-f910-48c7-81f2-2aebd0ac2d3b tempest-VolumesServicesTestJSON-1401455818 None] Volume c1d80db5-856f-4641-bdd8-41715142e6c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1d80db5-856f-4641-bdd8-41715142e6c3', 'volume_size': 1} Aug 28 09:38:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-573448f5-f910-48c7-81f2-2aebd0ac2d3b tempest-VolumesServicesTestJSON-1401455818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:38:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-573448f5-f910-48c7-81f2-2aebd0ac2d3b tempest-VolumesServicesTestJSON-1401455818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:38:36 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-573448f5-f910-48c7-81f2-2aebd0ac2d3b tempest-VolumesServicesTestJSON-1401455818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:38:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1808897808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1d80db5-856f-4641-bdd8-41715142e6c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='540dab0984e04804b6028fc7cde9a47f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:38:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:38:36Z,use_quota=True,user_id='fc91db03d2844f68a342bd58429c0f83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:38:36 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-573448f5-f910-48c7-81f2-2aebd0ac2d3b tempest-VolumesServicesTestJSON-1401455818 None] Creating volume c1d80db5-856f-4641-bdd8-41715142e6c3 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:38:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-573448f5-f910-48c7-81f2-2aebd0ac2d3b tempest-VolumesServicesTestJSON-1401455818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:38:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-573448f5-f910-48c7-81f2-2aebd0ac2d3b tempest-VolumesServicesTestJSON-1401455818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:38:36 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-573448f5-f910-48c7-81f2-2aebd0ac2d3b tempest-VolumesServicesTestJSON-1401455818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:38:36 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-573448f5-f910-48c7-81f2-2aebd0ac2d3b tempest-VolumesServicesTestJSON-1401455818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:38:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-573448f5-f910-48c7-81f2-2aebd0ac2d3b tempest-VolumesServicesTestJSON-1401455818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:38:36 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-573448f5-f910-48c7-81f2-2aebd0ac2d3b tempest-VolumesServicesTestJSON-1401455818 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:38:36 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-573448f5-f910-48c7-81f2-2aebd0ac2d3b tempest-VolumesServicesTestJSON-1401455818 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:38:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-573448f5-f910-48c7-81f2-2aebd0ac2d3b tempest-VolumesServicesTestJSON-1401455818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c1d80db5-856f-4641-bdd8-41715142e6c3 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:36 devstack sudo[95750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c1d80db5-856f-4641-bdd8-41715142e6c3 1073741824 Aug 28 09:38:36 devstack sudo[95750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:37 devstack sudo[95750]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-573448f5-f910-48c7-81f2-2aebd0ac2d3b tempest-VolumesServicesTestJSON-1401455818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c1d80db5-856f-4641-bdd8-41715142e6c3 1073741824" returned: 0 in 0.594s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-573448f5-f910-48c7-81f2-2aebd0ac2d3b tempest-VolumesServicesTestJSON-1401455818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c1d80db5-856f-4641-bdd8-41715142e6c3 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:37 devstack sudo[95761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c1d80db5-856f-4641-bdd8-41715142e6c3 Aug 28 09:38:37 devstack sudo[95761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:37 devstack sudo[95761]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-573448f5-f910-48c7-81f2-2aebd0ac2d3b tempest-VolumesServicesTestJSON-1401455818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c1d80db5-856f-4641-bdd8-41715142e6c3" returned: 0 in 0.357s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:37 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-573448f5-f910-48c7-81f2-2aebd0ac2d3b tempest-VolumesServicesTestJSON-1401455818 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:38:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-573448f5-f910-48c7-81f2-2aebd0ac2d3b tempest-VolumesServicesTestJSON-1401455818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:38:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-3ecef43d-b441-4e67-9cbd-1abf8b4b5a7e req-0b4d25a3-2281-4bf3-b6f4-9fe94beca140 tempest-TestInstancesWithCinderVolumes-726122166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:38:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-3ecef43d-b441-4e67-9cbd-1abf8b4b5a7e req-0b4d25a3-2281-4bf3-b6f4-9fe94beca140 tempest-TestInstancesWithCinderVolumes-726122166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:38:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-3ecef43d-b441-4e67-9cbd-1abf8b4b5a7e req-0b4d25a3-2281-4bf3-b6f4-9fe94beca140 tempest-TestInstancesWithCinderVolumes-726122166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:38:37 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-573448f5-f910-48c7-81f2-2aebd0ac2d3b tempest-VolumesServicesTestJSON-1401455818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02f86154-292b-4727-b12f-b4b7079c41fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1d80db5-856f-4641-bdd8-41715142e6c3', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:38:37 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-573448f5-f910-48c7-81f2-2aebd0ac2d3b tempest-VolumesServicesTestJSON-1401455818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a6816a8-4ff2-43df-b77c-a609d3750b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:38:37 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-573448f5-f910-48c7-81f2-2aebd0ac2d3b tempest-VolumesServicesTestJSON-1401455818 None] Volume volume-c1d80db5-856f-4641-bdd8-41715142e6c3 (c1d80db5-856f-4641-bdd8-41715142e6c3): created successfully Aug 28 09:38:37 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-573448f5-f910-48c7-81f2-2aebd0ac2d3b tempest-VolumesServicesTestJSON-1401455818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a6816a8-4ff2-43df-b77c-a609d3750b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:38:37 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-573448f5-f910-48c7-81f2-2aebd0ac2d3b tempest-VolumesServicesTestJSON-1401455818 None] Flow 'volume_create_manager' (2f332203-f9ee-4934-98cb-81937005306b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:38:37 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-3ecef43d-b441-4e67-9cbd-1abf8b4b5a7e req-0b4d25a3-2281-4bf3-b6f4-9fe94beca140 tempest-TestInstancesWithCinderVolumes-726122166 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b', 'name': 'volume-eaf631df-7b08-4120-b4bd-71c5a659e9f2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '288f5029-cf69-49e8-b1c1-58b1d7bb6ca4', 'enforce_multipath': True} {{(pid=86081) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 09:38:37 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-573448f5-f910-48c7-81f2-2aebd0ac2d3b tempest-VolumesServicesTestJSON-1401455818 None] Created volume successfully. Aug 28 09:38:37 devstack cinder-volume[86081]: INFO cinder.volume.manager [req-3ecef43d-b441-4e67-9cbd-1abf8b4b5a7e req-0b4d25a3-2281-4bf3-b6f4-9fe94beca140 tempest-TestInstancesWithCinderVolumes-726122166 None] attachment_update completed successfully. Aug 28 09:38:37 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a1fe7e0f-7b2d-4438-a062-0c43d1652559 tempest-AttachVolumeNegativeTest-1867820442 None] Acquiring lock "cinder-42cbc235-8f5c-4559-8c65-4c062cc2a1ba-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:38:37 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a1fe7e0f-7b2d-4438-a062-0c43d1652559 tempest-AttachVolumeNegativeTest-1867820442 None] Lock "cinder-42cbc235-8f5c-4559-8c65-4c062cc2a1ba-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:38:38 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a1fe7e0f-7b2d-4438-a062-0c43d1652559 tempest-AttachVolumeNegativeTest-1867820442 None] Acquiring lock "cinder-quobyte-42cbc235-8f5c-4559-8c65-4c062cc2a1ba" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:38:38 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a1fe7e0f-7b2d-4438-a062-0c43d1652559 tempest-AttachVolumeNegativeTest-1867820442 None] Lock "cinder-quobyte-42cbc235-8f5c-4559-8c65-4c062cc2a1ba" acquired by "delete_volume" :: waited 0.015s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:38:38 devstack cinder-volume[86081]: DEBUG oslo_service.periodic_task [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86081) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:38:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:38:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:38:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:38:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:38:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:38:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:38 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde662d7-bc8c-485e-94ee-16131d9816f6]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:38:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a1fe7e0f-7b2d-4438-a062-0c43d1652559 tempest-AttachVolumeNegativeTest-1867820442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-42cbc235-8f5c-4559-8c65-4c062cc2a1ba {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:38 devstack sudo[95774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:38:38 devstack sudo[95774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:38 devstack sudo[95775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-42cbc235-8f5c-4559-8c65-4c062cc2a1ba Aug 28 09:38:38 devstack sudo[95775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:38 devstack sudo[95774]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.355s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:38 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:38:38 devstack cinder-volume[86081]: DEBUG oslo_service.periodic_task [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running periodic task VolumeManager._thread_info {{(pid=86081) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:38:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] thread count: 28 {{(pid=86081) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 09:38:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] thread info: [<_MainThread(MainThread, started 129914189705344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86081) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 09:38:38 devstack sudo[95775]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a1fe7e0f-7b2d-4438-a062-0c43d1652559 tempest-AttachVolumeNegativeTest-1867820442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-42cbc235-8f5c-4559-8c65-4c062cc2a1ba" returned: 0 in 0.493s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a1fe7e0f-7b2d-4438-a062-0c43d1652559 tempest-AttachVolumeNegativeTest-1867820442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-42cbc235-8f5c-4559-8c65-4c062cc2a1ba {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:38 devstack sudo[95786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-42cbc235-8f5c-4559-8c65-4c062cc2a1ba Aug 28 09:38:38 devstack sudo[95786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:38 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8f146950-6e32-4f36-9abd-1800061a7e99 tempest-VolumesServicesTestJSON-1401455818 None] Acquiring lock "cinder-c1d80db5-856f-4641-bdd8-41715142e6c3-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:38:38 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8f146950-6e32-4f36-9abd-1800061a7e99 tempest-VolumesServicesTestJSON-1401455818 None] Lock "cinder-c1d80db5-856f-4641-bdd8-41715142e6c3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:38:38 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8f146950-6e32-4f36-9abd-1800061a7e99 tempest-VolumesServicesTestJSON-1401455818 None] Acquiring lock "cinder-quobyte-c1d80db5-856f-4641-bdd8-41715142e6c3" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:38:38 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8f146950-6e32-4f36-9abd-1800061a7e99 tempest-VolumesServicesTestJSON-1401455818 None] Lock "cinder-quobyte-c1d80db5-856f-4641-bdd8-41715142e6c3" acquired by "delete_volume" :: waited 0.030s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:38:38 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eeb468d-b63d-4c58-b0df-2aa691f9321d]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:38:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8f146950-6e32-4f36-9abd-1800061a7e99 tempest-VolumesServicesTestJSON-1401455818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c1d80db5-856f-4641-bdd8-41715142e6c3 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:38 devstack sudo[95786]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a1fe7e0f-7b2d-4438-a062-0c43d1652559 tempest-AttachVolumeNegativeTest-1867820442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-42cbc235-8f5c-4559-8c65-4c062cc2a1ba" returned: 0 in 0.334s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:38 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a1fe7e0f-7b2d-4438-a062-0c43d1652559 tempest-AttachVolumeNegativeTest-1867820442 None] Lock "cinder-quobyte-42cbc235-8f5c-4559-8c65-4c062cc2a1ba" released by "delete_volume" :: held 0.908s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:38:39 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-a1fe7e0f-7b2d-4438-a062-0c43d1652559 tempest-AttachVolumeNegativeTest-1867820442 None] Created reservations ['5859cfb3-6740-4065-8b0d-cd563937c636', 'a835e0a8-74a0-4536-8938-086acdf0528f', 'cad1609d-5502-416a-ada0-941ff14d5f32', '3ba1b665-4f32-4cf1-a466-aae97622085b'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:38:39 devstack sudo[95794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c1d80db5-856f-4641-bdd8-41715142e6c3 Aug 28 09:38:39 devstack sudo[95794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a1fe7e0f-7b2d-4438-a062-0c43d1652559 tempest-AttachVolumeNegativeTest-1867820442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:38:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a1fe7e0f-7b2d-4438-a062-0c43d1652559 tempest-AttachVolumeNegativeTest-1867820442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:38:39 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-a1fe7e0f-7b2d-4438-a062-0c43d1652559 tempest-AttachVolumeNegativeTest-1867820442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:38:39 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-a1fe7e0f-7b2d-4438-a062-0c43d1652559 tempest-AttachVolumeNegativeTest-1867820442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:38:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a1fe7e0f-7b2d-4438-a062-0c43d1652559 tempest-AttachVolumeNegativeTest-1867820442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:38:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a1fe7e0f-7b2d-4438-a062-0c43d1652559 tempest-AttachVolumeNegativeTest-1867820442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:39 devstack sudo[95796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:38:39 devstack sudo[95796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:39 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-814e6045-f02c-41c1-a0e6-c3c4acff8da7 tempest-GroupSnapshotsV319Test-614711240 None] Group tempest-GroupSnapshotsV319Test-Group-1275340132: creating Aug 28 09:38:39 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-814e6045-f02c-41c1-a0e6-c3c4acff8da7 tempest-GroupSnapshotsV319Test-614711240 None] Group tempest-GroupSnapshotsV319Test-Group-1275340132: created successfully Aug 28 09:38:39 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-814e6045-f02c-41c1-a0e6-c3c4acff8da7 tempest-GroupSnapshotsV319Test-614711240 None] Create group completed successfully. Aug 28 09:38:39 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-18fe565f-deda-4dd1-b73b-83f3a9c3fc8c tempest-AttachVolumeNegativeTest-1867820442 None] Acquiring lock "cinder-dbcb6c36-88c1-4f50-be13-5725ec76e44a-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:38:39 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-18fe565f-deda-4dd1-b73b-83f3a9c3fc8c tempest-AttachVolumeNegativeTest-1867820442 None] Lock "cinder-dbcb6c36-88c1-4f50-be13-5725ec76e44a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:38:39 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-18fe565f-deda-4dd1-b73b-83f3a9c3fc8c tempest-AttachVolumeNegativeTest-1867820442 None] Acquiring lock "cinder-quobyte-dbcb6c36-88c1-4f50-be13-5725ec76e44a" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:38:39 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-18fe565f-deda-4dd1-b73b-83f3a9c3fc8c tempest-AttachVolumeNegativeTest-1867820442 None] Lock "cinder-quobyte-dbcb6c36-88c1-4f50-be13-5725ec76e44a" acquired by "delete_volume" :: waited 0.021s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:38:39 devstack sudo[95794]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8f146950-6e32-4f36-9abd-1800061a7e99 tempest-VolumesServicesTestJSON-1401455818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c1d80db5-856f-4641-bdd8-41715142e6c3" returned: 0 in 0.547s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8f146950-6e32-4f36-9abd-1800061a7e99 tempest-VolumesServicesTestJSON-1401455818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c1d80db5-856f-4641-bdd8-41715142e6c3 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:39 devstack sudo[95796]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a1fe7e0f-7b2d-4438-a062-0c43d1652559 tempest-AttachVolumeNegativeTest-1867820442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.348s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:39 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-a1fe7e0f-7b2d-4438-a062-0c43d1652559 tempest-AttachVolumeNegativeTest-1867820442 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:38:39 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eea85cb-0530-4452-8a12-3d7bf6f7509c]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:38:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-18fe565f-deda-4dd1-b73b-83f3a9c3fc8c tempest-AttachVolumeNegativeTest-1867820442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-dbcb6c36-88c1-4f50-be13-5725ec76e44a {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:39 devstack sudo[95802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c1d80db5-856f-4641-bdd8-41715142e6c3 Aug 28 09:38:39 devstack sudo[95802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:39 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-a1fe7e0f-7b2d-4438-a062-0c43d1652559 tempest-AttachVolumeNegativeTest-1867820442 None] Deleted volume successfully. Aug 28 09:38:39 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a1fe7e0f-7b2d-4438-a062-0c43d1652559 tempest-AttachVolumeNegativeTest-1867820442 None] Lock "cinder-42cbc235-8f5c-4559-8c65-4c062cc2a1ba-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:38:39 devstack sudo[95804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-dbcb6c36-88c1-4f50-be13-5725ec76e44a Aug 28 09:38:39 devstack sudo[95804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:39 devstack sudo[95802]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8f146950-6e32-4f36-9abd-1800061a7e99 tempest-VolumesServicesTestJSON-1401455818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c1d80db5-856f-4641-bdd8-41715142e6c3" returned: 0 in 0.269s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:39 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8f146950-6e32-4f36-9abd-1800061a7e99 tempest-VolumesServicesTestJSON-1401455818 None] Lock "cinder-quobyte-c1d80db5-856f-4641-bdd8-41715142e6c3" released by "delete_volume" :: held 0.871s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:38:39 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-8f146950-6e32-4f36-9abd-1800061a7e99 tempest-VolumesServicesTestJSON-1401455818 None] Created reservations ['4bca1094-93b2-4ced-aa20-bbf04d613581', '3c9db7f6-cf72-4334-ab36-da123a62918a', '65cdf6df-412b-41b6-8fff-3769bd915279', '0aef5bf1-7419-46d6-9b5c-eaa1931f1092'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:38:39 devstack sudo[95804]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8f146950-6e32-4f36-9abd-1800061a7e99 tempest-VolumesServicesTestJSON-1401455818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:38:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8f146950-6e32-4f36-9abd-1800061a7e99 tempest-VolumesServicesTestJSON-1401455818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:38:39 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-8f146950-6e32-4f36-9abd-1800061a7e99 tempest-VolumesServicesTestJSON-1401455818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:38:39 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-8f146950-6e32-4f36-9abd-1800061a7e99 tempest-VolumesServicesTestJSON-1401455818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:38:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8f146950-6e32-4f36-9abd-1800061a7e99 tempest-VolumesServicesTestJSON-1401455818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:38:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8f146950-6e32-4f36-9abd-1800061a7e99 tempest-VolumesServicesTestJSON-1401455818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-18fe565f-deda-4dd1-b73b-83f3a9c3fc8c tempest-AttachVolumeNegativeTest-1867820442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-dbcb6c36-88c1-4f50-be13-5725ec76e44a" returned: 0 in 0.422s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-18fe565f-deda-4dd1-b73b-83f3a9c3fc8c tempest-AttachVolumeNegativeTest-1867820442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-dbcb6c36-88c1-4f50-be13-5725ec76e44a {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:39 devstack sudo[95810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:38:39 devstack sudo[95810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:39 devstack sudo[95811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-dbcb6c36-88c1-4f50-be13-5725ec76e44a Aug 28 09:38:39 devstack sudo[95811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:40 devstack sudo[95810]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8f146950-6e32-4f36-9abd-1800061a7e99 tempest-VolumesServicesTestJSON-1401455818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.270s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:40 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-8f146950-6e32-4f36-9abd-1800061a7e99 tempest-VolumesServicesTestJSON-1401455818 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:38:40 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-8f146950-6e32-4f36-9abd-1800061a7e99 tempest-VolumesServicesTestJSON-1401455818 None] Deleted volume successfully. Aug 28 09:38:40 devstack sudo[95811]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-18fe565f-deda-4dd1-b73b-83f3a9c3fc8c tempest-AttachVolumeNegativeTest-1867820442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-dbcb6c36-88c1-4f50-be13-5725ec76e44a" returned: 0 in 0.282s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:40 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-18fe565f-deda-4dd1-b73b-83f3a9c3fc8c tempest-AttachVolumeNegativeTest-1867820442 None] Lock "cinder-quobyte-dbcb6c36-88c1-4f50-be13-5725ec76e44a" released by "delete_volume" :: held 0.779s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:38:40 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8f146950-6e32-4f36-9abd-1800061a7e99 tempest-VolumesServicesTestJSON-1401455818 None] Lock "cinder-c1d80db5-856f-4641-bdd8-41715142e6c3-delete_volume" released by "delete_volume" :: held 1.418s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:38:40 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-18fe565f-deda-4dd1-b73b-83f3a9c3fc8c tempest-AttachVolumeNegativeTest-1867820442 None] Created reservations ['94234282-079d-4ae8-a5ba-ffb201e6b8e3', 'c72b957d-80ea-45e9-9139-e4bae5d45031', '183685e1-5113-485a-897d-41b4d9eb0807', '12a7e5f8-713a-42a1-95fb-c3ba7e448e05'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:38:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-18fe565f-deda-4dd1-b73b-83f3a9c3fc8c tempest-AttachVolumeNegativeTest-1867820442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:38:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-18fe565f-deda-4dd1-b73b-83f3a9c3fc8c tempest-AttachVolumeNegativeTest-1867820442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:38:40 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-18fe565f-deda-4dd1-b73b-83f3a9c3fc8c tempest-AttachVolumeNegativeTest-1867820442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:38:40 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-18fe565f-deda-4dd1-b73b-83f3a9c3fc8c tempest-AttachVolumeNegativeTest-1867820442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:38:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-18fe565f-deda-4dd1-b73b-83f3a9c3fc8c tempest-AttachVolumeNegativeTest-1867820442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:38:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-18fe565f-deda-4dd1-b73b-83f3a9c3fc8c tempest-AttachVolumeNegativeTest-1867820442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:40 devstack sudo[95816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:38:40 devstack sudo[95816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:40 devstack sudo[95816]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-18fe565f-deda-4dd1-b73b-83f3a9c3fc8c tempest-AttachVolumeNegativeTest-1867820442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.341s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:40 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-18fe565f-deda-4dd1-b73b-83f3a9c3fc8c tempest-AttachVolumeNegativeTest-1867820442 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:38:40 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-18fe565f-deda-4dd1-b73b-83f3a9c3fc8c tempest-AttachVolumeNegativeTest-1867820442 None] Deleted volume successfully. Aug 28 09:38:40 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-18fe565f-deda-4dd1-b73b-83f3a9c3fc8c tempest-AttachVolumeNegativeTest-1867820442 None] Lock "cinder-dbcb6c36-88c1-4f50-be13-5725ec76e44a-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:38:40 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2c9d995f-ab79-42f8-857d-5a9b6ebdd66a tempest-AttachVolumeNegativeTest-1867820442 None] Acquiring lock "cinder-12a443d5-4f71-4ff1-915b-675f664703a4-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:38:40 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2c9d995f-ab79-42f8-857d-5a9b6ebdd66a tempest-AttachVolumeNegativeTest-1867820442 None] Lock "cinder-12a443d5-4f71-4ff1-915b-675f664703a4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:38:40 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2c9d995f-ab79-42f8-857d-5a9b6ebdd66a tempest-AttachVolumeNegativeTest-1867820442 None] Acquiring lock "cinder-quobyte-12a443d5-4f71-4ff1-915b-675f664703a4" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:38:41 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2c9d995f-ab79-42f8-857d-5a9b6ebdd66a tempest-AttachVolumeNegativeTest-1867820442 None] Lock "cinder-quobyte-12a443d5-4f71-4ff1-915b-675f664703a4" acquired by "delete_volume" :: waited 0.021s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:38:41 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[6197cbc6-0c7a-4877-9fd9-68b2724d9304]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:38:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2c9d995f-ab79-42f8-857d-5a9b6ebdd66a tempest-AttachVolumeNegativeTest-1867820442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-12a443d5-4f71-4ff1-915b-675f664703a4 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:41 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d4f91d4-00ac-4f95-81be-c41a95f2f14b tempest-GroupSnapshotsV319Test-614711240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:38:41 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0d4f91d4-00ac-4f95-81be-c41a95f2f14b tempest-GroupSnapshotsV319Test-614711240 None] Flow 'volume_create_manager' (56d4a0e3-36a7-4b4b-9f91-1e8e26856fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:38:41 devstack sudo[95821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-12a443d5-4f71-4ff1-915b-675f664703a4 Aug 28 09:38:41 devstack sudo[95821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:41 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0d4f91d4-00ac-4f95-81be-c41a95f2f14b tempest-GroupSnapshotsV319Test-614711240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (787e3805-9bb2-4c06-9e13-69c403213ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:38:41 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0d4f91d4-00ac-4f95-81be-c41a95f2f14b tempest-GroupSnapshotsV319Test-614711240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (787e3805-9bb2-4c06-9e13-69c403213ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:38:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1675893778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e9a5b6d2-5650-4b9d-94e4-d69f876b8064,host='devstack@QuobyteHD#QuobyteHD',id=20cec352-ab50-464d-9938-75dbd24947ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29f9436ad4db4934ac54a3686186c803',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:38:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:38:41Z,use_quota=True,user_id='b9064cafa1e3454786b93972a1939ec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2d2fe4c-7c4f-45fa-8364-1fd172e1117f),volume_type_id=f2d2fe4c-7c4f-45fa-8364-1fd172e1117f)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:38:41 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0d4f91d4-00ac-4f95-81be-c41a95f2f14b tempest-GroupSnapshotsV319Test-614711240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12c99eac-14f9-460b-99c6-aa93b3d6a4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:38:41 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0d4f91d4-00ac-4f95-81be-c41a95f2f14b tempest-GroupSnapshotsV319Test-614711240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12c99eac-14f9-460b-99c6-aa93b3d6a4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:38:41 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0d4f91d4-00ac-4f95-81be-c41a95f2f14b tempest-GroupSnapshotsV319Test-614711240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd824ad7-5111-46b2-b21d-9ca14b304a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:38:41 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0d4f91d4-00ac-4f95-81be-c41a95f2f14b tempest-GroupSnapshotsV319Test-614711240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd824ad7-5111-46b2-b21d-9ca14b304a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20cec352-ab50-464d-9938-75dbd24947ca', 'volume_name': 'volume-20cec352-ab50-464d-9938-75dbd24947ca', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:38:41 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0d4f91d4-00ac-4f95-81be-c41a95f2f14b tempest-GroupSnapshotsV319Test-614711240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c545a26-e511-4ab8-8138-40f2932517f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:38:41 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0d4f91d4-00ac-4f95-81be-c41a95f2f14b tempest-GroupSnapshotsV319Test-614711240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c545a26-e511-4ab8-8138-40f2932517f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:38:41 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0d4f91d4-00ac-4f95-81be-c41a95f2f14b tempest-GroupSnapshotsV319Test-614711240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (893505ab-e83f-4d81-bdc5-07af64e9eed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:38:41 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-0d4f91d4-00ac-4f95-81be-c41a95f2f14b tempest-GroupSnapshotsV319Test-614711240 None] Volume 20cec352-ab50-464d-9938-75dbd24947ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20cec352-ab50-464d-9938-75dbd24947ca', 'volume_size': 1} Aug 28 09:38:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0d4f91d4-00ac-4f95-81be-c41a95f2f14b tempest-GroupSnapshotsV319Test-614711240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:38:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0d4f91d4-00ac-4f95-81be-c41a95f2f14b tempest-GroupSnapshotsV319Test-614711240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:38:41 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0d4f91d4-00ac-4f95-81be-c41a95f2f14b tempest-GroupSnapshotsV319Test-614711240 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e9a5b6d2-5650-4b9d-94e4-d69f876b8064,created_at=2026-08-28T07:38:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1675893778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e9a5b6d2-5650-4b9d-94e4-d69f876b8064,host='devstack@QuobyteHD#QuobyteHD',id=20cec352-ab50-464d-9938-75dbd24947ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29f9436ad4db4934ac54a3686186c803',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:38:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:38:41Z,use_quota=True,user_id='b9064cafa1e3454786b93972a1939ec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2d2fe4c-7c4f-45fa-8364-1fd172e1117f),volume_type_id=f2d2fe4c-7c4f-45fa-8364-1fd172e1117f)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:38:41 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-0d4f91d4-00ac-4f95-81be-c41a95f2f14b tempest-GroupSnapshotsV319Test-614711240 None] Creating volume 20cec352-ab50-464d-9938-75dbd24947ca {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:38:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0d4f91d4-00ac-4f95-81be-c41a95f2f14b tempest-GroupSnapshotsV319Test-614711240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:38:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0d4f91d4-00ac-4f95-81be-c41a95f2f14b tempest-GroupSnapshotsV319Test-614711240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:38:41 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0d4f91d4-00ac-4f95-81be-c41a95f2f14b tempest-GroupSnapshotsV319Test-614711240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:38:41 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0d4f91d4-00ac-4f95-81be-c41a95f2f14b tempest-GroupSnapshotsV319Test-614711240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:38:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0d4f91d4-00ac-4f95-81be-c41a95f2f14b tempest-GroupSnapshotsV319Test-614711240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:38:41 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0d4f91d4-00ac-4f95-81be-c41a95f2f14b tempest-GroupSnapshotsV319Test-614711240 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:38:41 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-0d4f91d4-00ac-4f95-81be-c41a95f2f14b tempest-GroupSnapshotsV319Test-614711240 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:38:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0d4f91d4-00ac-4f95-81be-c41a95f2f14b tempest-GroupSnapshotsV319Test-614711240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-20cec352-ab50-464d-9938-75dbd24947ca 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:41 devstack sudo[95827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-20cec352-ab50-464d-9938-75dbd24947ca 1073741824 Aug 28 09:38:41 devstack sudo[95827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:41 devstack sudo[95821]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2c9d995f-ab79-42f8-857d-5a9b6ebdd66a tempest-AttachVolumeNegativeTest-1867820442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-12a443d5-4f71-4ff1-915b-675f664703a4" returned: 0 in 0.477s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2c9d995f-ab79-42f8-857d-5a9b6ebdd66a tempest-AttachVolumeNegativeTest-1867820442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-12a443d5-4f71-4ff1-915b-675f664703a4 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:41 devstack sudo[95836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-12a443d5-4f71-4ff1-915b-675f664703a4 Aug 28 09:38:41 devstack sudo[95836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:41 devstack sudo[95836]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2c9d995f-ab79-42f8-857d-5a9b6ebdd66a tempest-AttachVolumeNegativeTest-1867820442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-12a443d5-4f71-4ff1-915b-675f664703a4" returned: 0 in 0.309s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:41 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2c9d995f-ab79-42f8-857d-5a9b6ebdd66a tempest-AttachVolumeNegativeTest-1867820442 None] Lock "cinder-quobyte-12a443d5-4f71-4ff1-915b-675f664703a4" released by "delete_volume" :: held 0.872s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:38:41 devstack sudo[95827]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0d4f91d4-00ac-4f95-81be-c41a95f2f14b tempest-GroupSnapshotsV319Test-614711240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-20cec352-ab50-464d-9938-75dbd24947ca 1073741824" returned: 0 in 0.632s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:41 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-2c9d995f-ab79-42f8-857d-5a9b6ebdd66a tempest-AttachVolumeNegativeTest-1867820442 None] Created reservations ['1bf247ab-36fb-49dd-a206-834b007d5eab', 'b9c42e87-1255-4da2-b03e-a51d745cb302', 'ec7c89f4-4493-4300-8226-8f2687c51524', 'da1778e8-2df9-44b4-bda8-a688ffc3dd09'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:38:42 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0d4f91d4-00ac-4f95-81be-c41a95f2f14b tempest-GroupSnapshotsV319Test-614711240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-20cec352-ab50-464d-9938-75dbd24947ca {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:42 devstack sudo[95852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-20cec352-ab50-464d-9938-75dbd24947ca Aug 28 09:38:42 devstack sudo[95852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:42 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-2c9d995f-ab79-42f8-857d-5a9b6ebdd66a tempest-AttachVolumeNegativeTest-1867820442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:38:42 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-2c9d995f-ab79-42f8-857d-5a9b6ebdd66a tempest-AttachVolumeNegativeTest-1867820442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:38:42 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-2c9d995f-ab79-42f8-857d-5a9b6ebdd66a tempest-AttachVolumeNegativeTest-1867820442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:38:42 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-2c9d995f-ab79-42f8-857d-5a9b6ebdd66a tempest-AttachVolumeNegativeTest-1867820442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:38:42 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-2c9d995f-ab79-42f8-857d-5a9b6ebdd66a tempest-AttachVolumeNegativeTest-1867820442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:38:42 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2c9d995f-ab79-42f8-857d-5a9b6ebdd66a tempest-AttachVolumeNegativeTest-1867820442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:42 devstack sudo[95856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:38:42 devstack sudo[95856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:42 devstack sudo[95852]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:42 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0d4f91d4-00ac-4f95-81be-c41a95f2f14b tempest-GroupSnapshotsV319Test-614711240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-20cec352-ab50-464d-9938-75dbd24947ca" returned: 0 in 0.393s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:42 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0d4f91d4-00ac-4f95-81be-c41a95f2f14b tempest-GroupSnapshotsV319Test-614711240 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:38:42 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0d4f91d4-00ac-4f95-81be-c41a95f2f14b tempest-GroupSnapshotsV319Test-614711240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:38:42 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0d4f91d4-00ac-4f95-81be-c41a95f2f14b tempest-GroupSnapshotsV319Test-614711240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (893505ab-e83f-4d81-bdc5-07af64e9eed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20cec352-ab50-464d-9938-75dbd24947ca', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:38:42 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0d4f91d4-00ac-4f95-81be-c41a95f2f14b tempest-GroupSnapshotsV319Test-614711240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4062730b-ad69-47d6-b547-91c5d6a5e567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:38:42 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-0d4f91d4-00ac-4f95-81be-c41a95f2f14b tempest-GroupSnapshotsV319Test-614711240 None] Volume volume-20cec352-ab50-464d-9938-75dbd24947ca (20cec352-ab50-464d-9938-75dbd24947ca): created successfully Aug 28 09:38:42 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0d4f91d4-00ac-4f95-81be-c41a95f2f14b tempest-GroupSnapshotsV319Test-614711240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4062730b-ad69-47d6-b547-91c5d6a5e567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:38:42 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0d4f91d4-00ac-4f95-81be-c41a95f2f14b tempest-GroupSnapshotsV319Test-614711240 None] Flow 'volume_create_manager' (56d4a0e3-36a7-4b4b-9f91-1e8e26856fd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:38:42 devstack sudo[95856]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:42 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2c9d995f-ab79-42f8-857d-5a9b6ebdd66a tempest-AttachVolumeNegativeTest-1867820442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.469s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:42 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-2c9d995f-ab79-42f8-857d-5a9b6ebdd66a tempest-AttachVolumeNegativeTest-1867820442 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:38:42 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-0d4f91d4-00ac-4f95-81be-c41a95f2f14b tempest-GroupSnapshotsV319Test-614711240 None] Created volume successfully. Aug 28 09:38:42 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-2c9d995f-ab79-42f8-857d-5a9b6ebdd66a tempest-AttachVolumeNegativeTest-1867820442 None] Deleted volume successfully. Aug 28 09:38:42 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2c9d995f-ab79-42f8-857d-5a9b6ebdd66a tempest-AttachVolumeNegativeTest-1867820442 None] Lock "cinder-12a443d5-4f71-4ff1-915b-675f664703a4-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:38:43 devstack cinder-volume[86081]: INFO cinder.volume.manager [req-3450ad2e-2ba7-4290-bfce-c53fffbe7d70 req-affa8c36-4051-4424-a6bd-491a38e9f263 tempest-TestInstancesWithCinderVolumes-726122166 None] Terminate volume connection completed successfully. Aug 28 09:38:43 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-3450ad2e-2ba7-4290-bfce-c53fffbe7d70 req-affa8c36-4051-4424-a6bd-491a38e9f263 tempest-TestInstancesWithCinderVolumes-726122166 None] Deleting attachment d78e9c7d-9782-4da5-a7ff-60c3f9e71115. {{(pid=86081) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 09:38:43 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-fb6be390-6141-4eb8-899c-1d02d9a5e474 tempest-GroupSnapshotsV319Test-614711240 None] GroupSnapshot 2d8198f9-624d-4af7-b63e-0d21300efdd6: creating. Aug 28 09:38:43 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-fb6be390-6141-4eb8-899c-1d02d9a5e474 tempest-GroupSnapshotsV319Test-614711240 None] Group snapshot 2d8198f9-624d-4af7-b63e-0d21300efdd6: creating. {{(pid=86081) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 28 09:38:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-fb6be390-6141-4eb8-899c-1d02d9a5e474 tempest-GroupSnapshotsV319Test-614711240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:38:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-fb6be390-6141-4eb8-899c-1d02d9a5e474 tempest-GroupSnapshotsV319Test-614711240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:38:44 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-fb6be390-6141-4eb8-899c-1d02d9a5e474 tempest-GroupSnapshotsV319Test-614711240 None] Creating offline snapshot 430e6833-8d64-4dad-9f36-b7d2839e90f0 of volume 20cec352-ab50-464d-9938-75dbd24947ca {{(pid=86081) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:38:44 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26040cb-058a-42ec-aa16-9b9b3742094e]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:38:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fb6be390-6141-4eb8-899c-1d02d9a5e474 tempest-GroupSnapshotsV319Test-614711240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-20cec352-ab50-464d-9938-75dbd24947ca {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:44 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-72211440-c8ad-4210-9921-f73b88af2366 tempest-TestInstancesWithCinderVolumes-726122166 None] Acquiring lock "cinder-8b456b25-c720-412f-a299-fbb9ad5db242-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:38:44 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-72211440-c8ad-4210-9921-f73b88af2366 tempest-TestInstancesWithCinderVolumes-726122166 None] Lock "cinder-8b456b25-c720-412f-a299-fbb9ad5db242-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:38:44 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-72211440-c8ad-4210-9921-f73b88af2366 tempest-TestInstancesWithCinderVolumes-726122166 None] Acquiring lock "cinder-quobyte-8b456b25-c720-412f-a299-fbb9ad5db242" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:38:44 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-72211440-c8ad-4210-9921-f73b88af2366 tempest-TestInstancesWithCinderVolumes-726122166 None] Lock "cinder-quobyte-8b456b25-c720-412f-a299-fbb9ad5db242" acquired by "delete_volume" :: waited 0.021s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:38:44 devstack sudo[95867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-20cec352-ab50-464d-9938-75dbd24947ca Aug 28 09:38:44 devstack sudo[95867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:44 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c796c6-e80f-44b0-a9c8-e22c5ed2b934]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:38:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-72211440-c8ad-4210-9921-f73b88af2366 tempest-TestInstancesWithCinderVolumes-726122166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8b456b25-c720-412f-a299-fbb9ad5db242 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:44 devstack sudo[95872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8b456b25-c720-412f-a299-fbb9ad5db242 Aug 28 09:38:44 devstack sudo[95872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:44 devstack sudo[95867]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fb6be390-6141-4eb8-899c-1d02d9a5e474 tempest-GroupSnapshotsV319Test-614711240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-20cec352-ab50-464d-9938-75dbd24947ca" returned: 0 in 0.529s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fb6be390-6141-4eb8-899c-1d02d9a5e474 tempest-GroupSnapshotsV319Test-614711240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-20cec352-ab50-464d-9938-75dbd24947ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-20cec352-ab50-464d-9938-75dbd24947ca.430e6833-8d64-4dad-9f36-b7d2839e90f0 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:44 devstack sudo[95878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-20cec352-ab50-464d-9938-75dbd24947ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-20cec352-ab50-464d-9938-75dbd24947ca.430e6833-8d64-4dad-9f36-b7d2839e90f0 1G Aug 28 09:38:44 devstack sudo[95878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:44 devstack sudo[95872]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-72211440-c8ad-4210-9921-f73b88af2366 tempest-TestInstancesWithCinderVolumes-726122166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8b456b25-c720-412f-a299-fbb9ad5db242" returned: 0 in 0.515s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-72211440-c8ad-4210-9921-f73b88af2366 tempest-TestInstancesWithCinderVolumes-726122166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8b456b25-c720-412f-a299-fbb9ad5db242 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:44 devstack sudo[95883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8b456b25-c720-412f-a299-fbb9ad5db242 Aug 28 09:38:44 devstack sudo[95883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:45 devstack sudo[95883]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-72211440-c8ad-4210-9921-f73b88af2366 tempest-TestInstancesWithCinderVolumes-726122166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8b456b25-c720-412f-a299-fbb9ad5db242" returned: 0 in 0.318s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:45 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-72211440-c8ad-4210-9921-f73b88af2366 tempest-TestInstancesWithCinderVolumes-726122166 None] Lock "cinder-quobyte-8b456b25-c720-412f-a299-fbb9ad5db242" released by "delete_volume" :: held 0.887s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:38:45 devstack cinder-volume[86081]: WARNING cinder.quota [None req-72211440-c8ad-4210-9921-f73b88af2366 tempest-TestInstancesWithCinderVolumes-726122166 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-731943318-1491018773 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-731943318-1491018773, it is now deprecated. Please use the default quota class for default quota. Aug 28 09:38:45 devstack cinder-volume[86081]: WARNING cinder.quota [None req-72211440-c8ad-4210-9921-f73b88af2366 tempest-TestInstancesWithCinderVolumes-726122166 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-731943318-1491018773 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-731943318-1491018773, it is now deprecated. Please use the default quota class for default quota. Aug 28 09:38:45 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-72211440-c8ad-4210-9921-f73b88af2366 tempest-TestInstancesWithCinderVolumes-726122166 None] Created reservations ['a7ab9245-4697-4344-811d-20c5b9b68485', '2fbd0680-b435-467e-9c62-2c3ddd59d39f', '8b8073d3-1116-4911-96dc-66417efbf40b', '91c75813-601c-44d5-b0bb-1f15f0f850d8'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:38:45 devstack sudo[95878]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fb6be390-6141-4eb8-899c-1d02d9a5e474 tempest-GroupSnapshotsV319Test-614711240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-20cec352-ab50-464d-9938-75dbd24947ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-20cec352-ab50-464d-9938-75dbd24947ca.430e6833-8d64-4dad-9f36-b7d2839e90f0 1G" returned: 0 in 0.639s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fb6be390-6141-4eb8-899c-1d02d9a5e474 tempest-GroupSnapshotsV319Test-614711240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20cec352-ab50-464d-9938-75dbd24947ca -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-20cec352-ab50-464d-9938-75dbd24947ca.430e6833-8d64-4dad-9f36-b7d2839e90f0 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:45 devstack sudo[95889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20cec352-ab50-464d-9938-75dbd24947ca -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-20cec352-ab50-464d-9938-75dbd24947ca.430e6833-8d64-4dad-9f36-b7d2839e90f0 Aug 28 09:38:45 devstack sudo[95889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-72211440-c8ad-4210-9921-f73b88af2366 tempest-TestInstancesWithCinderVolumes-726122166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:38:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-72211440-c8ad-4210-9921-f73b88af2366 tempest-TestInstancesWithCinderVolumes-726122166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:38:45 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-72211440-c8ad-4210-9921-f73b88af2366 tempest-TestInstancesWithCinderVolumes-726122166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:38:45 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-72211440-c8ad-4210-9921-f73b88af2366 tempest-TestInstancesWithCinderVolumes-726122166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:38:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-72211440-c8ad-4210-9921-f73b88af2366 tempest-TestInstancesWithCinderVolumes-726122166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:38:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-72211440-c8ad-4210-9921-f73b88af2366 tempest-TestInstancesWithCinderVolumes-726122166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:45 devstack sudo[95891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:38:45 devstack sudo[95891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:45 devstack sudo[95891]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-72211440-c8ad-4210-9921-f73b88af2366 tempest-TestInstancesWithCinderVolumes-726122166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.364s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:45 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-72211440-c8ad-4210-9921-f73b88af2366 tempest-TestInstancesWithCinderVolumes-726122166 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:38:45 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-72211440-c8ad-4210-9921-f73b88af2366 tempest-TestInstancesWithCinderVolumes-726122166 None] Deleted volume successfully. Aug 28 09:38:45 devstack sudo[95889]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fb6be390-6141-4eb8-899c-1d02d9a5e474 tempest-GroupSnapshotsV319Test-614711240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20cec352-ab50-464d-9938-75dbd24947ca -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-20cec352-ab50-464d-9938-75dbd24947ca.430e6833-8d64-4dad-9f36-b7d2839e90f0" returned: 0 in 0.480s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:45 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-fb6be390-6141-4eb8-899c-1d02d9a5e474 tempest-GroupSnapshotsV319Test-614711240 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-20cec352-ab50-464d-9938-75dbd24947ca.430e6833-8d64-4dad-9f36-b7d2839e90f0 is being set with open permissions: ugo+rw: NotImplementedError Aug 28 09:38:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fb6be390-6141-4eb8-899c-1d02d9a5e474 tempest-GroupSnapshotsV319Test-614711240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-20cec352-ab50-464d-9938-75dbd24947ca.430e6833-8d64-4dad-9f36-b7d2839e90f0 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:45 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-72211440-c8ad-4210-9921-f73b88af2366 tempest-TestInstancesWithCinderVolumes-726122166 None] Lock "cinder-8b456b25-c720-412f-a299-fbb9ad5db242-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:38:45 devstack sudo[95897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-20cec352-ab50-464d-9938-75dbd24947ca.430e6833-8d64-4dad-9f36-b7d2839e90f0 Aug 28 09:38:45 devstack sudo[95897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:45 devstack sudo[95897]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fb6be390-6141-4eb8-899c-1d02d9a5e474 tempest-GroupSnapshotsV319Test-614711240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-20cec352-ab50-464d-9938-75dbd24947ca.430e6833-8d64-4dad-9f36-b7d2839e90f0" returned: 0 in 0.299s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fb6be390-6141-4eb8-899c-1d02d9a5e474 tempest-GroupSnapshotsV319Test-614711240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-20cec352-ab50-464d-9938-75dbd24947ca.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:46 devstack sudo[95900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-20cec352-ab50-464d-9938-75dbd24947ca.info Aug 28 09:38:46 devstack sudo[95900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:46 devstack sudo[95900]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fb6be390-6141-4eb8-899c-1d02d9a5e474 tempest-GroupSnapshotsV319Test-614711240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-20cec352-ab50-464d-9938-75dbd24947ca.info" returned: 0 in 0.294s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:46 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-fb6be390-6141-4eb8-899c-1d02d9a5e474 tempest-GroupSnapshotsV319Test-614711240 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-20cec352-ab50-464d-9938-75dbd24947ca.info is being set with open permissions: ugo+rw: NotImplementedError Aug 28 09:38:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fb6be390-6141-4eb8-899c-1d02d9a5e474 tempest-GroupSnapshotsV319Test-614711240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-20cec352-ab50-464d-9938-75dbd24947ca.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:46 devstack sudo[95903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-20cec352-ab50-464d-9938-75dbd24947ca.info Aug 28 09:38:46 devstack sudo[95903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:46 devstack sudo[95903]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fb6be390-6141-4eb8-899c-1d02d9a5e474 tempest-GroupSnapshotsV319Test-614711240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-20cec352-ab50-464d-9938-75dbd24947ca.info" returned: 0 in 0.290s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-fb6be390-6141-4eb8-899c-1d02d9a5e474 tempest-GroupSnapshotsV319Test-614711240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.673s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:38:46 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-fb6be390-6141-4eb8-899c-1d02d9a5e474 tempest-GroupSnapshotsV319Test-614711240 None] group_snapshot 2d8198f9-624d-4af7-b63e-0d21300efdd6: created successfully Aug 28 09:38:47 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-33cabea3-6693-414a-8b54-9cd4c8c1ddf9 tempest-GroupSnapshotsV319Test-614711240 None] group_snapshot 2d8198f9-624d-4af7-b63e-0d21300efdd6: deleting Aug 28 09:38:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-33cabea3-6693-414a-8b54-9cd4c8c1ddf9 tempest-GroupSnapshotsV319Test-614711240 None] group_snapshot 2d8198f9-624d-4af7-b63e-0d21300efdd6: deleting {{(pid=86081) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 28 09:38:47 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-33cabea3-6693-414a-8b54-9cd4c8c1ddf9 tempest-GroupSnapshotsV319Test-614711240 None] Acquiring lock "cinder-quobyte-20cec352-ab50-464d-9938-75dbd24947ca" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:38:47 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-33cabea3-6693-414a-8b54-9cd4c8c1ddf9 tempest-GroupSnapshotsV319Test-614711240 None] Lock "cinder-quobyte-20cec352-ab50-464d-9938-75dbd24947ca" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:38:47 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-33cabea3-6693-414a-8b54-9cd4c8c1ddf9 tempest-GroupSnapshotsV319Test-614711240 None] Acquiring lock "cinder-quobyte-430e6833-8d64-4dad-9f36-b7d2839e90f0" by "_delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:38:47 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-33cabea3-6693-414a-8b54-9cd4c8c1ddf9 tempest-GroupSnapshotsV319Test-614711240 None] Lock "cinder-quobyte-430e6833-8d64-4dad-9f36-b7d2839e90f0" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:38:47 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-33cabea3-6693-414a-8b54-9cd4c8c1ddf9 tempest-GroupSnapshotsV319Test-614711240 None] Deleting offline snapshot 430e6833-8d64-4dad-9f36-b7d2839e90f0 of volume 20cec352-ab50-464d-9938-75dbd24947ca {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:38:48 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-33cabea3-6693-414a-8b54-9cd4c8c1ddf9 tempest-GroupSnapshotsV319Test-614711240 None] snapshot_file for this snap is: volume-20cec352-ab50-464d-9938-75dbd24947ca.430e6833-8d64-4dad-9f36-b7d2839e90f0 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:38:48 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae67b656-f8cb-4b9f-8bc7-8a5696bd0536]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:38:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-33cabea3-6693-414a-8b54-9cd4c8c1ddf9 tempest-GroupSnapshotsV319Test-614711240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-20cec352-ab50-464d-9938-75dbd24947ca.430e6833-8d64-4dad-9f36-b7d2839e90f0 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:48 devstack sudo[95927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-20cec352-ab50-464d-9938-75dbd24947ca.430e6833-8d64-4dad-9f36-b7d2839e90f0 Aug 28 09:38:48 devstack sudo[95927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:48 devstack sudo[95927]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-33cabea3-6693-414a-8b54-9cd4c8c1ddf9 tempest-GroupSnapshotsV319Test-614711240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-20cec352-ab50-464d-9938-75dbd24947ca.430e6833-8d64-4dad-9f36-b7d2839e90f0" returned: 0 in 0.652s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:48 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-33cabea3-6693-414a-8b54-9cd4c8c1ddf9 tempest-GroupSnapshotsV319Test-614711240 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20cec352-ab50-464d-9938-75dbd24947ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:38:48 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[4969478a-427f-4bb7-a5d7-b9ddc21ffac8]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:38:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-33cabea3-6693-414a-8b54-9cd4c8c1ddf9 tempest-GroupSnapshotsV319Test-614711240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-20cec352-ab50-464d-9938-75dbd24947ca {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:48 devstack cinder-volume[86081]: INFO cinder.volume.manager [req-661bad6e-2de0-4f9b-b6dd-1a8d4458ee25 req-641b5b40-4002-49b4-95f1-9244ca29b6aa tempest-TestInstancesWithCinderVolumes-726122166 None] Terminate volume connection completed successfully. Aug 28 09:38:48 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-661bad6e-2de0-4f9b-b6dd-1a8d4458ee25 req-641b5b40-4002-49b4-95f1-9244ca29b6aa tempest-TestInstancesWithCinderVolumes-726122166 None] Deleting attachment 288f5029-cf69-49e8-b1c1-58b1d7bb6ca4. {{(pid=86081) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 09:38:48 devstack sudo[95936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-20cec352-ab50-464d-9938-75dbd24947ca Aug 28 09:38:48 devstack sudo[95936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:49 devstack sudo[95936]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-33cabea3-6693-414a-8b54-9cd4c8c1ddf9 tempest-GroupSnapshotsV319Test-614711240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-20cec352-ab50-464d-9938-75dbd24947ca" returned: 0 in 0.483s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-33cabea3-6693-414a-8b54-9cd4c8c1ddf9 tempest-GroupSnapshotsV319Test-614711240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-20cec352-ab50-464d-9938-75dbd24947ca.430e6833-8d64-4dad-9f36-b7d2839e90f0 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:49 devstack sudo[95941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-20cec352-ab50-464d-9938-75dbd24947ca.430e6833-8d64-4dad-9f36-b7d2839e90f0 Aug 28 09:38:49 devstack sudo[95941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:49 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-efe1c90e-877d-47c0-b149-41c41bf70337 tempest-TestInstancesWithCinderVolumes-726122166 None] Acquiring lock "cinder-eaf631df-7b08-4120-b4bd-71c5a659e9f2-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:38:49 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-efe1c90e-877d-47c0-b149-41c41bf70337 tempest-TestInstancesWithCinderVolumes-726122166 None] Lock "cinder-eaf631df-7b08-4120-b4bd-71c5a659e9f2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:38:49 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-efe1c90e-877d-47c0-b149-41c41bf70337 tempest-TestInstancesWithCinderVolumes-726122166 None] Acquiring lock "cinder-quobyte-eaf631df-7b08-4120-b4bd-71c5a659e9f2" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:38:49 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-efe1c90e-877d-47c0-b149-41c41bf70337 tempest-TestInstancesWithCinderVolumes-726122166 None] Lock "cinder-quobyte-eaf631df-7b08-4120-b4bd-71c5a659e9f2" acquired by "delete_volume" :: waited 0.018s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:38:49 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[11592c17-e747-4afc-bbde-55f4b958fca7]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:38:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-efe1c90e-877d-47c0-b149-41c41bf70337 tempest-TestInstancesWithCinderVolumes-726122166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-eaf631df-7b08-4120-b4bd-71c5a659e9f2 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:49 devstack sudo[95941]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-33cabea3-6693-414a-8b54-9cd4c8c1ddf9 tempest-GroupSnapshotsV319Test-614711240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-20cec352-ab50-464d-9938-75dbd24947ca.430e6833-8d64-4dad-9f36-b7d2839e90f0" returned: 0 in 0.529s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-33cabea3-6693-414a-8b54-9cd4c8c1ddf9 tempest-GroupSnapshotsV319Test-614711240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-20cec352-ab50-464d-9938-75dbd24947ca.430e6833-8d64-4dad-9f36-b7d2839e90f0 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:49 devstack sudo[95947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-20cec352-ab50-464d-9938-75dbd24947ca.430e6833-8d64-4dad-9f36-b7d2839e90f0 Aug 28 09:38:49 devstack sudo[95947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:49 devstack sudo[95946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-eaf631df-7b08-4120-b4bd-71c5a659e9f2 Aug 28 09:38:49 devstack sudo[95946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:50 devstack sudo[95947]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-33cabea3-6693-414a-8b54-9cd4c8c1ddf9 tempest-GroupSnapshotsV319Test-614711240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-20cec352-ab50-464d-9938-75dbd24947ca.430e6833-8d64-4dad-9f36-b7d2839e90f0" returned: 0 in 0.363s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:50 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-33cabea3-6693-414a-8b54-9cd4c8c1ddf9 tempest-GroupSnapshotsV319Test-614711240 None] Lock "cinder-quobyte-430e6833-8d64-4dad-9f36-b7d2839e90f0" released by "_delete_snapshot" :: held 2.218s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:38:50 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-33cabea3-6693-414a-8b54-9cd4c8c1ddf9 tempest-GroupSnapshotsV319Test-614711240 None] Lock "cinder-quobyte-20cec352-ab50-464d-9938-75dbd24947ca" released by "delete_snapshot" :: held 2.260s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:38:50 devstack sudo[95946]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-efe1c90e-877d-47c0-b149-41c41bf70337 tempest-TestInstancesWithCinderVolumes-726122166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-eaf631df-7b08-4120-b4bd-71c5a659e9f2" returned: 0 in 0.505s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-efe1c90e-877d-47c0-b149-41c41bf70337 tempest-TestInstancesWithCinderVolumes-726122166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-eaf631df-7b08-4120-b4bd-71c5a659e9f2 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:50 devstack sudo[95954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-eaf631df-7b08-4120-b4bd-71c5a659e9f2 Aug 28 09:38:50 devstack sudo[95954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:50 devstack cinder-volume[86081]: WARNING cinder.quota [None req-33cabea3-6693-414a-8b54-9cd4c8c1ddf9 tempest-GroupSnapshotsV319Test-614711240 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-862724767 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-862724767, it is now deprecated. Please use the default quota class for default quota. Aug 28 09:38:50 devstack cinder-volume[86081]: WARNING cinder.quota [None req-33cabea3-6693-414a-8b54-9cd4c8c1ddf9 tempest-GroupSnapshotsV319Test-614711240 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-862724767 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-862724767, it is now deprecated. Please use the default quota class for default quota. Aug 28 09:38:50 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-33cabea3-6693-414a-8b54-9cd4c8c1ddf9 tempest-GroupSnapshotsV319Test-614711240 None] Created reservations ['62a2c448-53d1-4cf8-9f74-97dcbfcc5708', 'a17a3743-d171-49a0-9339-46454dd17399', '597bf278-92b3-4c22-ad34-1def42b5174f', '1b9704c8-e401-43d2-a5d0-2cd68c6a45c5'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:38:50 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-33cabea3-6693-414a-8b54-9cd4c8c1ddf9 tempest-GroupSnapshotsV319Test-614711240 None] group_snapshot 2d8198f9-624d-4af7-b63e-0d21300efdd6: deleted successfully Aug 28 09:38:50 devstack sudo[95954]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-efe1c90e-877d-47c0-b149-41c41bf70337 tempest-TestInstancesWithCinderVolumes-726122166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-eaf631df-7b08-4120-b4bd-71c5a659e9f2" returned: 0 in 0.463s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:50 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-efe1c90e-877d-47c0-b149-41c41bf70337 tempest-TestInstancesWithCinderVolumes-726122166 None] Lock "cinder-quobyte-eaf631df-7b08-4120-b4bd-71c5a659e9f2" released by "delete_volume" :: held 1.034s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:38:50 devstack cinder-volume[86081]: WARNING cinder.quota [None req-efe1c90e-877d-47c0-b149-41c41bf70337 tempest-TestInstancesWithCinderVolumes-726122166 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-868709294-1389061933 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-868709294-1389061933, it is now deprecated. Please use the default quota class for default quota. Aug 28 09:38:50 devstack cinder-volume[86081]: WARNING cinder.quota [None req-efe1c90e-877d-47c0-b149-41c41bf70337 tempest-TestInstancesWithCinderVolumes-726122166 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-868709294-1389061933 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-868709294-1389061933, it is now deprecated. Please use the default quota class for default quota. Aug 28 09:38:50 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-efe1c90e-877d-47c0-b149-41c41bf70337 tempest-TestInstancesWithCinderVolumes-726122166 None] Created reservations ['a03c8257-d516-4afc-b3b9-6185b2911f36', '09bf9525-bf2c-449d-8521-32e5a9e0bbc0', 'f41f937d-171a-43dd-b807-6f4073776a6e', 'fa449682-aa70-4bcd-ab88-752169daee90'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:38:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-efe1c90e-877d-47c0-b149-41c41bf70337 tempest-TestInstancesWithCinderVolumes-726122166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:38:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-efe1c90e-877d-47c0-b149-41c41bf70337 tempest-TestInstancesWithCinderVolumes-726122166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:38:50 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-efe1c90e-877d-47c0-b149-41c41bf70337 tempest-TestInstancesWithCinderVolumes-726122166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:38:50 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-efe1c90e-877d-47c0-b149-41c41bf70337 tempest-TestInstancesWithCinderVolumes-726122166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:38:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-efe1c90e-877d-47c0-b149-41c41bf70337 tempest-TestInstancesWithCinderVolumes-726122166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:38:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-efe1c90e-877d-47c0-b149-41c41bf70337 tempest-TestInstancesWithCinderVolumes-726122166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:50 devstack sudo[95957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:38:50 devstack sudo[95957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:51 devstack sudo[95957]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-efe1c90e-877d-47c0-b149-41c41bf70337 tempest-TestInstancesWithCinderVolumes-726122166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.345s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:51 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-efe1c90e-877d-47c0-b149-41c41bf70337 tempest-TestInstancesWithCinderVolumes-726122166 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:38:51 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-efe1c90e-877d-47c0-b149-41c41bf70337 tempest-TestInstancesWithCinderVolumes-726122166 None] Deleted volume successfully. Aug 28 09:38:51 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-efe1c90e-877d-47c0-b149-41c41bf70337 tempest-TestInstancesWithCinderVolumes-726122166 None] Lock "cinder-eaf631df-7b08-4120-b4bd-71c5a659e9f2-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:38:51 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-3180e1c8-72d3-4a61-86f1-64445674ff35 tempest-GroupSnapshotsV319Test-614711240 None] Acquiring lock "cinder-quobyte-20cec352-ab50-464d-9938-75dbd24947ca" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:38:51 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-3180e1c8-72d3-4a61-86f1-64445674ff35 tempest-GroupSnapshotsV319Test-614711240 None] Lock "cinder-quobyte-20cec352-ab50-464d-9938-75dbd24947ca" acquired by "delete_volume" :: waited 0.032s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:38:51 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[d207769e-4484-4e53-a5aa-656585ad6334]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:38:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3180e1c8-72d3-4a61-86f1-64445674ff35 tempest-GroupSnapshotsV319Test-614711240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-20cec352-ab50-464d-9938-75dbd24947ca {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:52 devstack sudo[95961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-20cec352-ab50-464d-9938-75dbd24947ca Aug 28 09:38:52 devstack sudo[95961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:52 devstack sudo[95961]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3180e1c8-72d3-4a61-86f1-64445674ff35 tempest-GroupSnapshotsV319Test-614711240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-20cec352-ab50-464d-9938-75dbd24947ca" returned: 0 in 0.511s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3180e1c8-72d3-4a61-86f1-64445674ff35 tempest-GroupSnapshotsV319Test-614711240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-20cec352-ab50-464d-9938-75dbd24947ca {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:52 devstack sudo[95966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-20cec352-ab50-464d-9938-75dbd24947ca Aug 28 09:38:52 devstack sudo[95966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:52 devstack sudo[95966]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3180e1c8-72d3-4a61-86f1-64445674ff35 tempest-GroupSnapshotsV319Test-614711240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-20cec352-ab50-464d-9938-75dbd24947ca" returned: 0 in 0.452s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:52 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-3180e1c8-72d3-4a61-86f1-64445674ff35 tempest-GroupSnapshotsV319Test-614711240 None] Lock "cinder-quobyte-20cec352-ab50-464d-9938-75dbd24947ca" released by "delete_volume" :: held 1.078s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:38:53 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-3180e1c8-72d3-4a61-86f1-64445674ff35 tempest-GroupSnapshotsV319Test-614711240 None] Created reservations ['57d219c7-9f87-40ee-9898-f13d5ca796ad'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:38:53 devstack cinder-volume[86081]: WARNING cinder.quota [None req-3180e1c8-72d3-4a61-86f1-64445674ff35 tempest-GroupSnapshotsV319Test-614711240 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-862724767 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-862724767, it is now deprecated. Please use the default quota class for default quota. Aug 28 09:38:53 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [req-bdab2561-da06-4539-bf3c-c256e6a8b50b req-58f0b646-0507-43df-af52-f55127427530 tempest-VolumesGetTestJSON-1146670904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:38:53 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-bdab2561-da06-4539-bf3c-c256e6a8b50b req-58f0b646-0507-43df-af52-f55127427530 tempest-VolumesGetTestJSON-1146670904 None] Flow 'volume_create_manager' (ff0179de-6fc8-47f1-8c98-c67b29f85744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:38:53 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-bdab2561-da06-4539-bf3c-c256e6a8b50b req-58f0b646-0507-43df-af52-f55127427530 tempest-VolumesGetTestJSON-1146670904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce94ffac-c739-4fdc-b3ce-b4ea2f8e214c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:38:53 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-bdab2561-da06-4539-bf3c-c256e6a8b50b req-58f0b646-0507-43df-af52-f55127427530 tempest-VolumesGetTestJSON-1146670904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce94ffac-c739-4fdc-b3ce-b4ea2f8e214c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:38:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-721727061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4087e29e-b8af-49af-ad29-bd7831191e08,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4762c3d65c7d403e8a644ac8402128c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:38:53Z,use_quota=True,user_id='5bfe021944b141fe93a5dc05045551a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:38:53 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-bdab2561-da06-4539-bf3c-c256e6a8b50b req-58f0b646-0507-43df-af52-f55127427530 tempest-VolumesGetTestJSON-1146670904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3ef21c7-ccc6-4fe9-b4c9-d1517afe23bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:38:53 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-bdab2561-da06-4539-bf3c-c256e6a8b50b req-58f0b646-0507-43df-af52-f55127427530 tempest-VolumesGetTestJSON-1146670904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3ef21c7-ccc6-4fe9-b4c9-d1517afe23bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:38:53 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-bdab2561-da06-4539-bf3c-c256e6a8b50b req-58f0b646-0507-43df-af52-f55127427530 tempest-VolumesGetTestJSON-1146670904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24ba815a-8e7f-41c2-9063-0a922cce527a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:38:53 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-bdab2561-da06-4539-bf3c-c256e6a8b50b req-58f0b646-0507-43df-af52-f55127427530 tempest-VolumesGetTestJSON-1146670904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24ba815a-8e7f-41c2-9063-0a922cce527a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4087e29e-b8af-49af-ad29-bd7831191e08', 'volume_name': 'volume-4087e29e-b8af-49af-ad29-bd7831191e08', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:38:53 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-bdab2561-da06-4539-bf3c-c256e6a8b50b req-58f0b646-0507-43df-af52-f55127427530 tempest-VolumesGetTestJSON-1146670904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6b6d190-2ae5-4b4e-a497-0a948fb885d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:38:53 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-bdab2561-da06-4539-bf3c-c256e6a8b50b req-58f0b646-0507-43df-af52-f55127427530 tempest-VolumesGetTestJSON-1146670904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6b6d190-2ae5-4b4e-a497-0a948fb885d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:38:53 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-bdab2561-da06-4539-bf3c-c256e6a8b50b req-58f0b646-0507-43df-af52-f55127427530 tempest-VolumesGetTestJSON-1146670904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3e6d04e-f1f6-41f0-bf51-08569a969af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:38:53 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [req-bdab2561-da06-4539-bf3c-c256e6a8b50b req-58f0b646-0507-43df-af52-f55127427530 tempest-VolumesGetTestJSON-1146670904 None] Volume 4087e29e-b8af-49af-ad29-bd7831191e08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4087e29e-b8af-49af-ad29-bd7831191e08', 'volume_size': 1} Aug 28 09:38:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-bdab2561-da06-4539-bf3c-c256e6a8b50b req-58f0b646-0507-43df-af52-f55127427530 tempest-VolumesGetTestJSON-1146670904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:38:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-bdab2561-da06-4539-bf3c-c256e6a8b50b req-58f0b646-0507-43df-af52-f55127427530 tempest-VolumesGetTestJSON-1146670904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:38:53 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [req-bdab2561-da06-4539-bf3c-c256e6a8b50b req-58f0b646-0507-43df-af52-f55127427530 tempest-VolumesGetTestJSON-1146670904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:38:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-721727061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4087e29e-b8af-49af-ad29-bd7831191e08,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4762c3d65c7d403e8a644ac8402128c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:38:53Z,use_quota=True,user_id='5bfe021944b141fe93a5dc05045551a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:38:53 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [req-bdab2561-da06-4539-bf3c-c256e6a8b50b req-58f0b646-0507-43df-af52-f55127427530 tempest-VolumesGetTestJSON-1146670904 None] Creating volume 4087e29e-b8af-49af-ad29-bd7831191e08 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:38:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-bdab2561-da06-4539-bf3c-c256e6a8b50b req-58f0b646-0507-43df-af52-f55127427530 tempest-VolumesGetTestJSON-1146670904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:38:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-bdab2561-da06-4539-bf3c-c256e6a8b50b req-58f0b646-0507-43df-af52-f55127427530 tempest-VolumesGetTestJSON-1146670904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:38:53 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [req-bdab2561-da06-4539-bf3c-c256e6a8b50b req-58f0b646-0507-43df-af52-f55127427530 tempest-VolumesGetTestJSON-1146670904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:38:53 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [req-bdab2561-da06-4539-bf3c-c256e6a8b50b req-58f0b646-0507-43df-af52-f55127427530 tempest-VolumesGetTestJSON-1146670904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:38:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-bdab2561-da06-4539-bf3c-c256e6a8b50b req-58f0b646-0507-43df-af52-f55127427530 tempest-VolumesGetTestJSON-1146670904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:38:53 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [req-bdab2561-da06-4539-bf3c-c256e6a8b50b req-58f0b646-0507-43df-af52-f55127427530 tempest-VolumesGetTestJSON-1146670904 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:38:53 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [req-bdab2561-da06-4539-bf3c-c256e6a8b50b req-58f0b646-0507-43df-af52-f55127427530 tempest-VolumesGetTestJSON-1146670904 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:38:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [req-bdab2561-da06-4539-bf3c-c256e6a8b50b req-58f0b646-0507-43df-af52-f55127427530 tempest-VolumesGetTestJSON-1146670904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4087e29e-b8af-49af-ad29-bd7831191e08 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:53 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-3180e1c8-72d3-4a61-86f1-64445674ff35 tempest-GroupSnapshotsV319Test-614711240 None] Created reservations ['13484027-2959-4f1e-8462-94e41cb161d0', '678ae0d8-a140-40ed-8fa6-a1a0791b36fe', 'e965c12e-fc97-442f-ba2e-00bcf5b15702', '79dea242-efe3-4107-9bd0-23eb857c7da9'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:38:53 devstack sudo[95972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4087e29e-b8af-49af-ad29-bd7831191e08 1073741824 Aug 28 09:38:53 devstack sudo[95972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-3180e1c8-72d3-4a61-86f1-64445674ff35 tempest-GroupSnapshotsV319Test-614711240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:38:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-3180e1c8-72d3-4a61-86f1-64445674ff35 tempest-GroupSnapshotsV319Test-614711240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:38:53 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-3180e1c8-72d3-4a61-86f1-64445674ff35 tempest-GroupSnapshotsV319Test-614711240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:38:53 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-3180e1c8-72d3-4a61-86f1-64445674ff35 tempest-GroupSnapshotsV319Test-614711240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:38:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-3180e1c8-72d3-4a61-86f1-64445674ff35 tempest-GroupSnapshotsV319Test-614711240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:38:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3180e1c8-72d3-4a61-86f1-64445674ff35 tempest-GroupSnapshotsV319Test-614711240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:53 devstack sudo[95984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:38:53 devstack sudo[95984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:54 devstack sudo[95972]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [req-bdab2561-da06-4539-bf3c-c256e6a8b50b req-58f0b646-0507-43df-af52-f55127427530 tempest-VolumesGetTestJSON-1146670904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4087e29e-b8af-49af-ad29-bd7831191e08 1073741824" returned: 0 in 0.960s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:54 devstack sudo[95984]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3180e1c8-72d3-4a61-86f1-64445674ff35 tempest-GroupSnapshotsV319Test-614711240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.588s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:54 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-3180e1c8-72d3-4a61-86f1-64445674ff35 tempest-GroupSnapshotsV319Test-614711240 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:38:54 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-3180e1c8-72d3-4a61-86f1-64445674ff35 tempest-GroupSnapshotsV319Test-614711240 None] Delete group completed successfully. Aug 28 09:38:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [req-bdab2561-da06-4539-bf3c-c256e6a8b50b req-58f0b646-0507-43df-af52-f55127427530 tempest-VolumesGetTestJSON-1146670904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4087e29e-b8af-49af-ad29-bd7831191e08 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:54 devstack sudo[96001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4087e29e-b8af-49af-ad29-bd7831191e08 Aug 28 09:38:54 devstack sudo[96001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:54 devstack sudo[96001]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [req-bdab2561-da06-4539-bf3c-c256e6a8b50b req-58f0b646-0507-43df-af52-f55127427530 tempest-VolumesGetTestJSON-1146670904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4087e29e-b8af-49af-ad29-bd7831191e08" returned: 0 in 0.463s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:54 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [req-bdab2561-da06-4539-bf3c-c256e6a8b50b req-58f0b646-0507-43df-af52-f55127427530 tempest-VolumesGetTestJSON-1146670904 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:38:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-bdab2561-da06-4539-bf3c-c256e6a8b50b req-58f0b646-0507-43df-af52-f55127427530 tempest-VolumesGetTestJSON-1146670904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:38:54 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-bdab2561-da06-4539-bf3c-c256e6a8b50b req-58f0b646-0507-43df-af52-f55127427530 tempest-VolumesGetTestJSON-1146670904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3e6d04e-f1f6-41f0-bf51-08569a969af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4087e29e-b8af-49af-ad29-bd7831191e08', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:38:55 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-bdab2561-da06-4539-bf3c-c256e6a8b50b req-58f0b646-0507-43df-af52-f55127427530 tempest-VolumesGetTestJSON-1146670904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc2e6e66-b910-43e6-ad2d-3a23065c0e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:38:55 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [req-bdab2561-da06-4539-bf3c-c256e6a8b50b req-58f0b646-0507-43df-af52-f55127427530 tempest-VolumesGetTestJSON-1146670904 None] Volume volume-4087e29e-b8af-49af-ad29-bd7831191e08 (4087e29e-b8af-49af-ad29-bd7831191e08): created successfully Aug 28 09:38:55 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-bdab2561-da06-4539-bf3c-c256e6a8b50b req-58f0b646-0507-43df-af52-f55127427530 tempest-VolumesGetTestJSON-1146670904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc2e6e66-b910-43e6-ad2d-3a23065c0e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:38:55 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-bdab2561-da06-4539-bf3c-c256e6a8b50b req-58f0b646-0507-43df-af52-f55127427530 tempest-VolumesGetTestJSON-1146670904 None] Flow 'volume_create_manager' (ff0179de-6fc8-47f1-8c98-c67b29f85744) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:38:55 devstack cinder-volume[86081]: INFO cinder.volume.manager [req-bdab2561-da06-4539-bf3c-c256e6a8b50b req-58f0b646-0507-43df-af52-f55127427530 tempest-VolumesGetTestJSON-1146670904 None] Created volume successfully. Aug 28 09:38:56 devstack cinder-volume[86081]: INFO cinder.volume.manager [req-e2b275c1-6346-4bd7-ab39-49a9d2cd5d35 req-b9df777f-498e-408e-a474-cb2410460e2f tempest-TestInstancesWithCinderVolumes-726122166 None] Terminate volume connection completed successfully. Aug 28 09:38:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-e2b275c1-6346-4bd7-ab39-49a9d2cd5d35 req-b9df777f-498e-408e-a474-cb2410460e2f tempest-TestInstancesWithCinderVolumes-726122166 None] Deleting attachment d6679a49-2d10-491a-aedf-225d8ed46b58. {{(pid=86081) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 09:38:56 devstack cinder-volume[86081]: DEBUG cinder.coordination [req-bdf5dd07-3836-42bf-a365-3a0b315fb2b8 req-0d20458b-622a-45c4-b41b-e306acfa5777 tempest-VolumesGetTestJSON-1146670904 None] Acquiring lock "cinder-4087e29e-b8af-49af-ad29-bd7831191e08-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:38:56 devstack cinder-volume[86081]: DEBUG cinder.coordination [req-bdf5dd07-3836-42bf-a365-3a0b315fb2b8 req-0d20458b-622a-45c4-b41b-e306acfa5777 tempest-VolumesGetTestJSON-1146670904 None] Lock "cinder-4087e29e-b8af-49af-ad29-bd7831191e08-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:38:56 devstack cinder-volume[86081]: DEBUG cinder.coordination [req-bdf5dd07-3836-42bf-a365-3a0b315fb2b8 req-0d20458b-622a-45c4-b41b-e306acfa5777 tempest-VolumesGetTestJSON-1146670904 None] Acquiring lock "cinder-quobyte-4087e29e-b8af-49af-ad29-bd7831191e08" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:38:56 devstack cinder-volume[86081]: DEBUG cinder.coordination [req-bdf5dd07-3836-42bf-a365-3a0b315fb2b8 req-0d20458b-622a-45c4-b41b-e306acfa5777 tempest-VolumesGetTestJSON-1146670904 None] Lock "cinder-quobyte-4087e29e-b8af-49af-ad29-bd7831191e08" acquired by "delete_volume" :: waited 0.022s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:38:56 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f315bc-9977-4fd7-bae9-6ccde8d8532e]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:38:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [req-bdf5dd07-3836-42bf-a365-3a0b315fb2b8 req-0d20458b-622a-45c4-b41b-e306acfa5777 tempest-VolumesGetTestJSON-1146670904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4087e29e-b8af-49af-ad29-bd7831191e08 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:56 devstack sudo[96006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4087e29e-b8af-49af-ad29-bd7831191e08 Aug 28 09:38:56 devstack sudo[96006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:56 devstack sudo[96006]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [req-bdf5dd07-3836-42bf-a365-3a0b315fb2b8 req-0d20458b-622a-45c4-b41b-e306acfa5777 tempest-VolumesGetTestJSON-1146670904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4087e29e-b8af-49af-ad29-bd7831191e08" returned: 0 in 0.523s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [req-bdf5dd07-3836-42bf-a365-3a0b315fb2b8 req-0d20458b-622a-45c4-b41b-e306acfa5777 tempest-VolumesGetTestJSON-1146670904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4087e29e-b8af-49af-ad29-bd7831191e08 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:56 devstack sudo[96011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4087e29e-b8af-49af-ad29-bd7831191e08 Aug 28 09:38:56 devstack sudo[96011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:57 devstack sudo[96011]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [req-bdf5dd07-3836-42bf-a365-3a0b315fb2b8 req-0d20458b-622a-45c4-b41b-e306acfa5777 tempest-VolumesGetTestJSON-1146670904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4087e29e-b8af-49af-ad29-bd7831191e08" returned: 0 in 0.273s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:57 devstack cinder-volume[86081]: DEBUG cinder.coordination [req-bdf5dd07-3836-42bf-a365-3a0b315fb2b8 req-0d20458b-622a-45c4-b41b-e306acfa5777 tempest-VolumesGetTestJSON-1146670904 None] Lock "cinder-quobyte-4087e29e-b8af-49af-ad29-bd7831191e08" released by "delete_volume" :: held 0.875s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:38:57 devstack cinder-volume[86081]: DEBUG cinder.quota [req-bdf5dd07-3836-42bf-a365-3a0b315fb2b8 req-0d20458b-622a-45c4-b41b-e306acfa5777 tempest-VolumesGetTestJSON-1146670904 None] Created reservations ['3f299adc-0faa-44ae-9d78-157b51e3b516', 'c0059b9a-32f4-4000-aeba-b6e54422d670', 'a9bf81aa-a313-4ae6-b7f7-bf1cd7990e83', 'b1811161-0928-4c5f-a37f-7044a583ac7d'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:38:57 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-27332f04-83f5-4c76-9160-2160305934c5 tempest-TestInstancesWithCinderVolumes-726122166 None] Acquiring lock "cinder-3974ae1a-d297-40ff-accf-d7aaef93f562-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:38:57 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-27332f04-83f5-4c76-9160-2160305934c5 tempest-TestInstancesWithCinderVolumes-726122166 None] Lock "cinder-3974ae1a-d297-40ff-accf-d7aaef93f562-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:38:57 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-27332f04-83f5-4c76-9160-2160305934c5 tempest-TestInstancesWithCinderVolumes-726122166 None] Acquiring lock "cinder-quobyte-3974ae1a-d297-40ff-accf-d7aaef93f562" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:38:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-bdf5dd07-3836-42bf-a365-3a0b315fb2b8 req-0d20458b-622a-45c4-b41b-e306acfa5777 tempest-VolumesGetTestJSON-1146670904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:38:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-bdf5dd07-3836-42bf-a365-3a0b315fb2b8 req-0d20458b-622a-45c4-b41b-e306acfa5777 tempest-VolumesGetTestJSON-1146670904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:38:57 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [req-bdf5dd07-3836-42bf-a365-3a0b315fb2b8 req-0d20458b-622a-45c4-b41b-e306acfa5777 tempest-VolumesGetTestJSON-1146670904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:38:57 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [req-bdf5dd07-3836-42bf-a365-3a0b315fb2b8 req-0d20458b-622a-45c4-b41b-e306acfa5777 tempest-VolumesGetTestJSON-1146670904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:38:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-bdf5dd07-3836-42bf-a365-3a0b315fb2b8 req-0d20458b-622a-45c4-b41b-e306acfa5777 tempest-VolumesGetTestJSON-1146670904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:38:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [req-bdf5dd07-3836-42bf-a365-3a0b315fb2b8 req-0d20458b-622a-45c4-b41b-e306acfa5777 tempest-VolumesGetTestJSON-1146670904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:57 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-27332f04-83f5-4c76-9160-2160305934c5 tempest-TestInstancesWithCinderVolumes-726122166 None] Lock "cinder-quobyte-3974ae1a-d297-40ff-accf-d7aaef93f562" acquired by "delete_volume" :: waited 0.046s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:38:57 devstack sudo[96014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:38:57 devstack sudo[96014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:57 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[15105a08-eb0f-493b-bd26-7e293278b83d]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:38:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-27332f04-83f5-4c76-9160-2160305934c5 tempest-TestInstancesWithCinderVolumes-726122166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3974ae1a-d297-40ff-accf-d7aaef93f562 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:57 devstack sudo[96016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3974ae1a-d297-40ff-accf-d7aaef93f562 Aug 28 09:38:57 devstack sudo[96016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:57 devstack sudo[96014]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [req-bdf5dd07-3836-42bf-a365-3a0b315fb2b8 req-0d20458b-622a-45c4-b41b-e306acfa5777 tempest-VolumesGetTestJSON-1146670904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.337s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:57 devstack cinder-volume[86081]: DEBUG cinder.manager [req-bdf5dd07-3836-42bf-a365-3a0b315fb2b8 req-0d20458b-622a-45c4-b41b-e306acfa5777 tempest-VolumesGetTestJSON-1146670904 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:38:57 devstack cinder-volume[86081]: INFO cinder.volume.manager [req-bdf5dd07-3836-42bf-a365-3a0b315fb2b8 req-0d20458b-622a-45c4-b41b-e306acfa5777 tempest-VolumesGetTestJSON-1146670904 None] Deleted volume successfully. Aug 28 09:38:57 devstack cinder-volume[86081]: DEBUG cinder.coordination [req-bdf5dd07-3836-42bf-a365-3a0b315fb2b8 req-0d20458b-622a-45c4-b41b-e306acfa5777 tempest-VolumesGetTestJSON-1146670904 None] Lock "cinder-4087e29e-b8af-49af-ad29-bd7831191e08-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:38:57 devstack sudo[96016]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-27332f04-83f5-4c76-9160-2160305934c5 tempest-TestInstancesWithCinderVolumes-726122166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3974ae1a-d297-40ff-accf-d7aaef93f562" returned: 0 in 0.434s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-27332f04-83f5-4c76-9160-2160305934c5 tempest-TestInstancesWithCinderVolumes-726122166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3974ae1a-d297-40ff-accf-d7aaef93f562 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:57 devstack sudo[96022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3974ae1a-d297-40ff-accf-d7aaef93f562 Aug 28 09:38:57 devstack sudo[96022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:58 devstack sudo[96022]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-27332f04-83f5-4c76-9160-2160305934c5 tempest-TestInstancesWithCinderVolumes-726122166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3974ae1a-d297-40ff-accf-d7aaef93f562" returned: 0 in 0.349s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:58 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-27332f04-83f5-4c76-9160-2160305934c5 tempest-TestInstancesWithCinderVolumes-726122166 None] Lock "cinder-quobyte-3974ae1a-d297-40ff-accf-d7aaef93f562" released by "delete_volume" :: held 0.852s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:38:58 devstack cinder-volume[86081]: WARNING cinder.quota [None req-27332f04-83f5-4c76-9160-2160305934c5 tempest-TestInstancesWithCinderVolumes-726122166 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1530193327-1892977593 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1530193327-1892977593, it is now deprecated. Please use the default quota class for default quota. Aug 28 09:38:58 devstack cinder-volume[86081]: WARNING cinder.quota [None req-27332f04-83f5-4c76-9160-2160305934c5 tempest-TestInstancesWithCinderVolumes-726122166 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1530193327-1892977593 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1530193327-1892977593, it is now deprecated. Please use the default quota class for default quota. Aug 28 09:38:58 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-27332f04-83f5-4c76-9160-2160305934c5 tempest-TestInstancesWithCinderVolumes-726122166 None] Created reservations ['fbad2906-2d45-45ba-ad98-b549642d91bf', '0a81070b-9244-4590-a8fc-bf55d718b8c4', 'e61bbe03-b447-4469-8582-283262ec84e9', 'b536324d-0a77-4818-9013-03bc9927b850'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:38:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-27332f04-83f5-4c76-9160-2160305934c5 tempest-TestInstancesWithCinderVolumes-726122166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:38:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-27332f04-83f5-4c76-9160-2160305934c5 tempest-TestInstancesWithCinderVolumes-726122166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:38:58 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-27332f04-83f5-4c76-9160-2160305934c5 tempest-TestInstancesWithCinderVolumes-726122166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:38:58 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-27332f04-83f5-4c76-9160-2160305934c5 tempest-TestInstancesWithCinderVolumes-726122166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:38:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-27332f04-83f5-4c76-9160-2160305934c5 tempest-TestInstancesWithCinderVolumes-726122166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:38:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-27332f04-83f5-4c76-9160-2160305934c5 tempest-TestInstancesWithCinderVolumes-726122166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:58 devstack sudo[96025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:38:58 devstack sudo[96025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:58 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8ff5ab1-a26d-41e7-9321-f187336a7a22 tempest-SnapshotMetadataTestJSON-1283308983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:38:58 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b8ff5ab1-a26d-41e7-9321-f187336a7a22 tempest-SnapshotMetadataTestJSON-1283308983 None] Flow 'volume_create_manager' (2b25a516-1402-4b3e-804d-f5385f0031db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:38:58 devstack sudo[96025]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:58 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b8ff5ab1-a26d-41e7-9321-f187336a7a22 tempest-SnapshotMetadataTestJSON-1283308983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60fe6bb5-4e27-4b23-8841-67402627f10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:38:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-27332f04-83f5-4c76-9160-2160305934c5 tempest-TestInstancesWithCinderVolumes-726122166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.406s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:58 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-27332f04-83f5-4c76-9160-2160305934c5 tempest-TestInstancesWithCinderVolumes-726122166 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:38:59 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-27332f04-83f5-4c76-9160-2160305934c5 tempest-TestInstancesWithCinderVolumes-726122166 None] Deleted volume successfully. Aug 28 09:38:59 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b8ff5ab1-a26d-41e7-9321-f187336a7a22 tempest-SnapshotMetadataTestJSON-1283308983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60fe6bb5-4e27-4b23-8841-67402627f10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:38:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-383831933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32c02905-6702-48ae-84cf-4c432c467ead,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0416dc54a92442528f181af53cf41706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:38:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:38:59Z,use_quota=True,user_id='d04e6628cba24dab9fbd39f538e73b6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:38:59 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b8ff5ab1-a26d-41e7-9321-f187336a7a22 tempest-SnapshotMetadataTestJSON-1283308983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4899d60-dee4-4970-82ab-1e780d68a2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:38:59 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b8ff5ab1-a26d-41e7-9321-f187336a7a22 tempest-SnapshotMetadataTestJSON-1283308983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4899d60-dee4-4970-82ab-1e780d68a2fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:38:59 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b8ff5ab1-a26d-41e7-9321-f187336a7a22 tempest-SnapshotMetadataTestJSON-1283308983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2376d89e-a6b3-4421-9d26-d8ae5295d876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:38:59 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b8ff5ab1-a26d-41e7-9321-f187336a7a22 tempest-SnapshotMetadataTestJSON-1283308983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2376d89e-a6b3-4421-9d26-d8ae5295d876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32c02905-6702-48ae-84cf-4c432c467ead', 'volume_name': 'volume-32c02905-6702-48ae-84cf-4c432c467ead', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:38:59 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b8ff5ab1-a26d-41e7-9321-f187336a7a22 tempest-SnapshotMetadataTestJSON-1283308983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8772f40a-488e-4c74-b086-e1f124fa961b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:38:59 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b8ff5ab1-a26d-41e7-9321-f187336a7a22 tempest-SnapshotMetadataTestJSON-1283308983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8772f40a-488e-4c74-b086-e1f124fa961b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:38:59 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b8ff5ab1-a26d-41e7-9321-f187336a7a22 tempest-SnapshotMetadataTestJSON-1283308983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (873ae974-8b5a-4602-8d3f-73fa3095a61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:38:59 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-b8ff5ab1-a26d-41e7-9321-f187336a7a22 tempest-SnapshotMetadataTestJSON-1283308983 None] Volume 32c02905-6702-48ae-84cf-4c432c467ead: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32c02905-6702-48ae-84cf-4c432c467ead', 'volume_size': 1} Aug 28 09:38:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b8ff5ab1-a26d-41e7-9321-f187336a7a22 tempest-SnapshotMetadataTestJSON-1283308983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:38:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b8ff5ab1-a26d-41e7-9321-f187336a7a22 tempest-SnapshotMetadataTestJSON-1283308983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:38:59 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-b8ff5ab1-a26d-41e7-9321-f187336a7a22 tempest-SnapshotMetadataTestJSON-1283308983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:38:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-383831933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32c02905-6702-48ae-84cf-4c432c467ead,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0416dc54a92442528f181af53cf41706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:38:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:38:59Z,use_quota=True,user_id='d04e6628cba24dab9fbd39f538e73b6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:38:59 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-b8ff5ab1-a26d-41e7-9321-f187336a7a22 tempest-SnapshotMetadataTestJSON-1283308983 None] Creating volume 32c02905-6702-48ae-84cf-4c432c467ead {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:38:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b8ff5ab1-a26d-41e7-9321-f187336a7a22 tempest-SnapshotMetadataTestJSON-1283308983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:38:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b8ff5ab1-a26d-41e7-9321-f187336a7a22 tempest-SnapshotMetadataTestJSON-1283308983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:38:59 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-b8ff5ab1-a26d-41e7-9321-f187336a7a22 tempest-SnapshotMetadataTestJSON-1283308983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:38:59 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-b8ff5ab1-a26d-41e7-9321-f187336a7a22 tempest-SnapshotMetadataTestJSON-1283308983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:38:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b8ff5ab1-a26d-41e7-9321-f187336a7a22 tempest-SnapshotMetadataTestJSON-1283308983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:38:59 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-b8ff5ab1-a26d-41e7-9321-f187336a7a22 tempest-SnapshotMetadataTestJSON-1283308983 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:38:59 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-b8ff5ab1-a26d-41e7-9321-f187336a7a22 tempest-SnapshotMetadataTestJSON-1283308983 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:38:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b8ff5ab1-a26d-41e7-9321-f187336a7a22 tempest-SnapshotMetadataTestJSON-1283308983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-32c02905-6702-48ae-84cf-4c432c467ead 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:59 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-27332f04-83f5-4c76-9160-2160305934c5 tempest-TestInstancesWithCinderVolumes-726122166 None] Lock "cinder-3974ae1a-d297-40ff-accf-d7aaef93f562-delete_volume" released by "delete_volume" :: held 1.762s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:38:59 devstack sudo[96029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-32c02905-6702-48ae-84cf-4c432c467ead 1073741824 Aug 28 09:38:59 devstack sudo[96029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:59 devstack sudo[96029]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b8ff5ab1-a26d-41e7-9321-f187336a7a22 tempest-SnapshotMetadataTestJSON-1283308983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-32c02905-6702-48ae-84cf-4c432c467ead 1073741824" returned: 0 in 0.575s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:38:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b8ff5ab1-a26d-41e7-9321-f187336a7a22 tempest-SnapshotMetadataTestJSON-1283308983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-32c02905-6702-48ae-84cf-4c432c467ead {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:38:59 devstack sudo[96034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-32c02905-6702-48ae-84cf-4c432c467ead Aug 28 09:38:59 devstack sudo[96034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:38:59 devstack sudo[96034]: pam_unix(sudo:session): session closed for user root Aug 28 09:38:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b8ff5ab1-a26d-41e7-9321-f187336a7a22 tempest-SnapshotMetadataTestJSON-1283308983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-32c02905-6702-48ae-84cf-4c432c467ead" returned: 0 in 0.297s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:00 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-b8ff5ab1-a26d-41e7-9321-f187336a7a22 tempest-SnapshotMetadataTestJSON-1283308983 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:39:00 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b8ff5ab1-a26d-41e7-9321-f187336a7a22 tempest-SnapshotMetadataTestJSON-1283308983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:39:00 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b8ff5ab1-a26d-41e7-9321-f187336a7a22 tempest-SnapshotMetadataTestJSON-1283308983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (873ae974-8b5a-4602-8d3f-73fa3095a61c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32c02905-6702-48ae-84cf-4c432c467ead', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:00 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b8ff5ab1-a26d-41e7-9321-f187336a7a22 tempest-SnapshotMetadataTestJSON-1283308983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8f2b576-9707-429d-9088-615cbee9e3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:00 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-b8ff5ab1-a26d-41e7-9321-f187336a7a22 tempest-SnapshotMetadataTestJSON-1283308983 None] Volume volume-32c02905-6702-48ae-84cf-4c432c467ead (32c02905-6702-48ae-84cf-4c432c467ead): created successfully Aug 28 09:39:00 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b8ff5ab1-a26d-41e7-9321-f187336a7a22 tempest-SnapshotMetadataTestJSON-1283308983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8f2b576-9707-429d-9088-615cbee9e3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:00 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b8ff5ab1-a26d-41e7-9321-f187336a7a22 tempest-SnapshotMetadataTestJSON-1283308983 None] Flow 'volume_create_manager' (2b25a516-1402-4b3e-804d-f5385f0031db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:39:00 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-b8ff5ab1-a26d-41e7-9321-f187336a7a22 tempest-SnapshotMetadataTestJSON-1283308983 None] Created volume successfully. Aug 28 09:39:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-d546e3be-e94d-49b5-bcea-937fe9398025 tempest-SnapshotMetadataTestJSON-1283308983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:39:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-d546e3be-e94d-49b5-bcea-937fe9398025 tempest-SnapshotMetadataTestJSON-1283308983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:39:01 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-d546e3be-e94d-49b5-bcea-937fe9398025 tempest-SnapshotMetadataTestJSON-1283308983 None] Creating offline snapshot 88b2e923-ac41-4799-8792-8a9372f097bb of volume 32c02905-6702-48ae-84cf-4c432c467ead {{(pid=86081) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:39:01 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d484743-887a-4061-94a2-84a27cb1ac3e]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:39:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d546e3be-e94d-49b5-bcea-937fe9398025 tempest-SnapshotMetadataTestJSON-1283308983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-32c02905-6702-48ae-84cf-4c432c467ead {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:01 devstack sudo[96037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-32c02905-6702-48ae-84cf-4c432c467ead Aug 28 09:39:01 devstack sudo[96037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:01 devstack sudo[96037]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d546e3be-e94d-49b5-bcea-937fe9398025 tempest-SnapshotMetadataTestJSON-1283308983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-32c02905-6702-48ae-84cf-4c432c467ead" returned: 0 in 0.482s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d546e3be-e94d-49b5-bcea-937fe9398025 tempest-SnapshotMetadataTestJSON-1283308983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-32c02905-6702-48ae-84cf-4c432c467ead,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-32c02905-6702-48ae-84cf-4c432c467ead.88b2e923-ac41-4799-8792-8a9372f097bb 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:01 devstack sudo[96042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-32c02905-6702-48ae-84cf-4c432c467ead,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-32c02905-6702-48ae-84cf-4c432c467ead.88b2e923-ac41-4799-8792-8a9372f097bb 1G Aug 28 09:39:01 devstack sudo[96042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:02 devstack sudo[96042]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d546e3be-e94d-49b5-bcea-937fe9398025 tempest-SnapshotMetadataTestJSON-1283308983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-32c02905-6702-48ae-84cf-4c432c467ead,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-32c02905-6702-48ae-84cf-4c432c467ead.88b2e923-ac41-4799-8792-8a9372f097bb 1G" returned: 0 in 0.661s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d546e3be-e94d-49b5-bcea-937fe9398025 tempest-SnapshotMetadataTestJSON-1283308983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32c02905-6702-48ae-84cf-4c432c467ead -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-32c02905-6702-48ae-84cf-4c432c467ead.88b2e923-ac41-4799-8792-8a9372f097bb {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:02 devstack sudo[96048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32c02905-6702-48ae-84cf-4c432c467ead -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-32c02905-6702-48ae-84cf-4c432c467ead.88b2e923-ac41-4799-8792-8a9372f097bb Aug 28 09:39:02 devstack sudo[96048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:02 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-03b73b62-9ede-46f5-a010-4c46f2ba63a3 tempest-BackendsCapabilitiesAdminTestsJSON-1791921357 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.6184768676758, 'free_capacity_gb': 1774.6184768676758, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86081) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 28 09:39:02 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-628d44bf-2725-4287-bda8-22d7bf92372b tempest-BackendsCapabilitiesAdminTestsJSON-1791921357 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.6184768676758, 'free_capacity_gb': 1774.6184768676758, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86081) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 28 09:39:02 devstack sudo[96048]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d546e3be-e94d-49b5-bcea-937fe9398025 tempest-SnapshotMetadataTestJSON-1283308983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32c02905-6702-48ae-84cf-4c432c467ead -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-32c02905-6702-48ae-84cf-4c432c467ead.88b2e923-ac41-4799-8792-8a9372f097bb" returned: 0 in 0.382s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:02 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-d546e3be-e94d-49b5-bcea-937fe9398025 tempest-SnapshotMetadataTestJSON-1283308983 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-32c02905-6702-48ae-84cf-4c432c467ead.88b2e923-ac41-4799-8792-8a9372f097bb is being set with open permissions: ugo+rw Aug 28 09:39:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d546e3be-e94d-49b5-bcea-937fe9398025 tempest-SnapshotMetadataTestJSON-1283308983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-32c02905-6702-48ae-84cf-4c432c467ead.88b2e923-ac41-4799-8792-8a9372f097bb {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:02 devstack sudo[96053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-32c02905-6702-48ae-84cf-4c432c467ead.88b2e923-ac41-4799-8792-8a9372f097bb Aug 28 09:39:02 devstack sudo[96053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:03 devstack sudo[96053]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d546e3be-e94d-49b5-bcea-937fe9398025 tempest-SnapshotMetadataTestJSON-1283308983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-32c02905-6702-48ae-84cf-4c432c467ead.88b2e923-ac41-4799-8792-8a9372f097bb" returned: 0 in 0.367s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d546e3be-e94d-49b5-bcea-937fe9398025 tempest-SnapshotMetadataTestJSON-1283308983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-32c02905-6702-48ae-84cf-4c432c467ead.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:03 devstack sudo[96062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-32c02905-6702-48ae-84cf-4c432c467ead.info Aug 28 09:39:03 devstack sudo[96062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:03 devstack sudo[96062]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d546e3be-e94d-49b5-bcea-937fe9398025 tempest-SnapshotMetadataTestJSON-1283308983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-32c02905-6702-48ae-84cf-4c432c467ead.info" returned: 0 in 0.395s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:03 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-d546e3be-e94d-49b5-bcea-937fe9398025 tempest-SnapshotMetadataTestJSON-1283308983 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-32c02905-6702-48ae-84cf-4c432c467ead.info is being set with open permissions: ugo+rw Aug 28 09:39:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d546e3be-e94d-49b5-bcea-937fe9398025 tempest-SnapshotMetadataTestJSON-1283308983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-32c02905-6702-48ae-84cf-4c432c467ead.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:03 devstack sudo[96065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-32c02905-6702-48ae-84cf-4c432c467ead.info Aug 28 09:39:03 devstack sudo[96065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:03 devstack sudo[96065]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d546e3be-e94d-49b5-bcea-937fe9398025 tempest-SnapshotMetadataTestJSON-1283308983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-32c02905-6702-48ae-84cf-4c432c467ead.info" returned: 0 in 0.259s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-d546e3be-e94d-49b5-bcea-937fe9398025 tempest-SnapshotMetadataTestJSON-1283308983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.675s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:39:04 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-d546e3be-e94d-49b5-bcea-937fe9398025 tempest-SnapshotMetadataTestJSON-1283308983 None] Create snapshot completed successfully Aug 28 09:39:05 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-3f2aba9c-bf8d-4d56-8697-e33b937102b0 tempest-SnapshotMetadataTestJSON-1283308983 None] Acquiring lock "cinder-88b2e923-ac41-4799-8792-8a9372f097bb-delete_snapshot" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:39:05 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-3f2aba9c-bf8d-4d56-8697-e33b937102b0 tempest-SnapshotMetadataTestJSON-1283308983 None] Lock "cinder-88b2e923-ac41-4799-8792-8a9372f097bb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:39:05 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-3f2aba9c-bf8d-4d56-8697-e33b937102b0 tempest-SnapshotMetadataTestJSON-1283308983 None] Acquiring lock "cinder-quobyte-32c02905-6702-48ae-84cf-4c432c467ead" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:39:05 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-3f2aba9c-bf8d-4d56-8697-e33b937102b0 tempest-SnapshotMetadataTestJSON-1283308983 None] Lock "cinder-quobyte-32c02905-6702-48ae-84cf-4c432c467ead" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:39:05 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-3f2aba9c-bf8d-4d56-8697-e33b937102b0 tempest-SnapshotMetadataTestJSON-1283308983 None] Acquiring lock "cinder-quobyte-88b2e923-ac41-4799-8792-8a9372f097bb" by "_delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:39:05 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-3f2aba9c-bf8d-4d56-8697-e33b937102b0 tempest-SnapshotMetadataTestJSON-1283308983 None] Lock "cinder-quobyte-88b2e923-ac41-4799-8792-8a9372f097bb" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:39:05 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-3f2aba9c-bf8d-4d56-8697-e33b937102b0 tempest-SnapshotMetadataTestJSON-1283308983 None] Deleting offline snapshot 88b2e923-ac41-4799-8792-8a9372f097bb of volume 32c02905-6702-48ae-84cf-4c432c467ead {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:39:05 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-3f2aba9c-bf8d-4d56-8697-e33b937102b0 tempest-SnapshotMetadataTestJSON-1283308983 None] snapshot_file for this snap is: volume-32c02905-6702-48ae-84cf-4c432c467ead.88b2e923-ac41-4799-8792-8a9372f097bb {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:39:05 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[572a8048-cf82-4101-a7d8-8665cf38af11]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:39:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3f2aba9c-bf8d-4d56-8697-e33b937102b0 tempest-SnapshotMetadataTestJSON-1283308983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-32c02905-6702-48ae-84cf-4c432c467ead.88b2e923-ac41-4799-8792-8a9372f097bb {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:05 devstack sudo[96068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-32c02905-6702-48ae-84cf-4c432c467ead.88b2e923-ac41-4799-8792-8a9372f097bb Aug 28 09:39:05 devstack sudo[96068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:06 devstack sudo[96068]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3f2aba9c-bf8d-4d56-8697-e33b937102b0 tempest-SnapshotMetadataTestJSON-1283308983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-32c02905-6702-48ae-84cf-4c432c467ead.88b2e923-ac41-4799-8792-8a9372f097bb" returned: 0 in 0.494s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:06 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-3f2aba9c-bf8d-4d56-8697-e33b937102b0 tempest-SnapshotMetadataTestJSON-1283308983 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32c02905-6702-48ae-84cf-4c432c467ead(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:39:06 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ba7922-3315-4a32-bb96-a39e4af51e17]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:39:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3f2aba9c-bf8d-4d56-8697-e33b937102b0 tempest-SnapshotMetadataTestJSON-1283308983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-32c02905-6702-48ae-84cf-4c432c467ead {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:06 devstack sudo[96075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-32c02905-6702-48ae-84cf-4c432c467ead Aug 28 09:39:06 devstack sudo[96075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:06 devstack sudo[96075]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3f2aba9c-bf8d-4d56-8697-e33b937102b0 tempest-SnapshotMetadataTestJSON-1283308983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-32c02905-6702-48ae-84cf-4c432c467ead" returned: 0 in 0.523s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3f2aba9c-bf8d-4d56-8697-e33b937102b0 tempest-SnapshotMetadataTestJSON-1283308983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-32c02905-6702-48ae-84cf-4c432c467ead.88b2e923-ac41-4799-8792-8a9372f097bb {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:06 devstack sudo[96115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-32c02905-6702-48ae-84cf-4c432c467ead.88b2e923-ac41-4799-8792-8a9372f097bb Aug 28 09:39:06 devstack sudo[96115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:07 devstack sudo[96115]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3f2aba9c-bf8d-4d56-8697-e33b937102b0 tempest-SnapshotMetadataTestJSON-1283308983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-32c02905-6702-48ae-84cf-4c432c467ead.88b2e923-ac41-4799-8792-8a9372f097bb" returned: 0 in 0.564s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3f2aba9c-bf8d-4d56-8697-e33b937102b0 tempest-SnapshotMetadataTestJSON-1283308983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-32c02905-6702-48ae-84cf-4c432c467ead.88b2e923-ac41-4799-8792-8a9372f097bb {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:07 devstack sudo[96122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-32c02905-6702-48ae-84cf-4c432c467ead.88b2e923-ac41-4799-8792-8a9372f097bb Aug 28 09:39:07 devstack sudo[96122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:07 devstack sudo[96122]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3f2aba9c-bf8d-4d56-8697-e33b937102b0 tempest-SnapshotMetadataTestJSON-1283308983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-32c02905-6702-48ae-84cf-4c432c467ead.88b2e923-ac41-4799-8792-8a9372f097bb" returned: 0 in 0.361s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:07 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-3f2aba9c-bf8d-4d56-8697-e33b937102b0 tempest-SnapshotMetadataTestJSON-1283308983 None] Lock "cinder-quobyte-88b2e923-ac41-4799-8792-8a9372f097bb" released by "_delete_snapshot" :: held 2.110s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:39:07 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-3f2aba9c-bf8d-4d56-8697-e33b937102b0 tempest-SnapshotMetadataTestJSON-1283308983 None] Lock "cinder-quobyte-32c02905-6702-48ae-84cf-4c432c467ead" released by "delete_snapshot" :: held 2.160s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:39:07 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-3f2aba9c-bf8d-4d56-8697-e33b937102b0 tempest-SnapshotMetadataTestJSON-1283308983 None] Created reservations ['63257ffe-4cac-4778-b4f8-e0e0dd913c68', '88817374-a3eb-4708-8f50-44c29234cb82', '528f749e-cef5-4715-8a9d-50eea2806376', '3d48524f-574c-4a2e-b0a1-3f8748b763b5'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:39:07 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-3f2aba9c-bf8d-4d56-8697-e33b937102b0 tempest-SnapshotMetadataTestJSON-1283308983 None] Delete snapshot completed successfully. Aug 28 09:39:07 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-3f2aba9c-bf8d-4d56-8697-e33b937102b0 tempest-SnapshotMetadataTestJSON-1283308983 None] Lock "cinder-88b2e923-ac41-4799-8792-8a9372f097bb-delete_snapshot" released by "delete_snapshot" :: held 2.350s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:39:08 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-cdec98ab-ece0-4784-a0ef-7aece0583954 tempest-SnapshotMetadataTestJSON-1283308983 None] Acquiring lock "cinder-32c02905-6702-48ae-84cf-4c432c467ead-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:39:08 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-cdec98ab-ece0-4784-a0ef-7aece0583954 tempest-SnapshotMetadataTestJSON-1283308983 None] Lock "cinder-32c02905-6702-48ae-84cf-4c432c467ead-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:39:08 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-cdec98ab-ece0-4784-a0ef-7aece0583954 tempest-SnapshotMetadataTestJSON-1283308983 None] Acquiring lock "cinder-quobyte-32c02905-6702-48ae-84cf-4c432c467ead" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:39:08 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-cdec98ab-ece0-4784-a0ef-7aece0583954 tempest-SnapshotMetadataTestJSON-1283308983 None] Lock "cinder-quobyte-32c02905-6702-48ae-84cf-4c432c467ead" acquired by "delete_volume" :: waited 0.028s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:39:08 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[2315e37b-f328-429f-9e18-0d5547a23993]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:39:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-cdec98ab-ece0-4784-a0ef-7aece0583954 tempest-SnapshotMetadataTestJSON-1283308983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-32c02905-6702-48ae-84cf-4c432c467ead {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:09 devstack sudo[96127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-32c02905-6702-48ae-84cf-4c432c467ead Aug 28 09:39:09 devstack sudo[96127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:09 devstack sudo[96127]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-cdec98ab-ece0-4784-a0ef-7aece0583954 tempest-SnapshotMetadataTestJSON-1283308983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-32c02905-6702-48ae-84cf-4c432c467ead" returned: 0 in 0.436s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-cdec98ab-ece0-4784-a0ef-7aece0583954 tempest-SnapshotMetadataTestJSON-1283308983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-32c02905-6702-48ae-84cf-4c432c467ead {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:09 devstack sudo[96132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-32c02905-6702-48ae-84cf-4c432c467ead Aug 28 09:39:09 devstack sudo[96132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:09 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-ce616e3d-9f73-4aac-b775-0ca6d591f802 tempest-GroupsTest-219853784 None] Group tempest-Group1-309617895: creating Aug 28 09:39:09 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-ce616e3d-9f73-4aac-b775-0ca6d591f802 tempest-GroupsTest-219853784 None] Group tempest-Group1-309617895: created successfully Aug 28 09:39:09 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-ce616e3d-9f73-4aac-b775-0ca6d591f802 tempest-GroupsTest-219853784 None] Create group completed successfully. Aug 28 09:39:09 devstack sudo[96132]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-cdec98ab-ece0-4784-a0ef-7aece0583954 tempest-SnapshotMetadataTestJSON-1283308983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-32c02905-6702-48ae-84cf-4c432c467ead" returned: 0 in 0.331s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:09 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-cdec98ab-ece0-4784-a0ef-7aece0583954 tempest-SnapshotMetadataTestJSON-1283308983 None] Lock "cinder-quobyte-32c02905-6702-48ae-84cf-4c432c467ead" released by "delete_volume" :: held 0.840s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:39:09 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-cdec98ab-ece0-4784-a0ef-7aece0583954 tempest-SnapshotMetadataTestJSON-1283308983 None] Created reservations ['cea43430-fa3d-4e61-b182-97b20fff860c', '0b647a07-877c-428b-8a72-0edf6368a487', '1e62329b-d573-4179-93b3-2e34f809c93e', 'b9782bd5-eac3-40b3-a56d-5d7e4fe3d749'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:39:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-cdec98ab-ece0-4784-a0ef-7aece0583954 tempest-SnapshotMetadataTestJSON-1283308983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:39:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-cdec98ab-ece0-4784-a0ef-7aece0583954 tempest-SnapshotMetadataTestJSON-1283308983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:39:09 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-cdec98ab-ece0-4784-a0ef-7aece0583954 tempest-SnapshotMetadataTestJSON-1283308983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:39:09 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-cdec98ab-ece0-4784-a0ef-7aece0583954 tempest-SnapshotMetadataTestJSON-1283308983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:39:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-cdec98ab-ece0-4784-a0ef-7aece0583954 tempest-SnapshotMetadataTestJSON-1283308983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:39:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-cdec98ab-ece0-4784-a0ef-7aece0583954 tempest-SnapshotMetadataTestJSON-1283308983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:09 devstack sudo[96135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:39:09 devstack sudo[96135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:10 devstack sudo[96135]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-cdec98ab-ece0-4784-a0ef-7aece0583954 tempest-SnapshotMetadataTestJSON-1283308983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.266s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:10 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-cdec98ab-ece0-4784-a0ef-7aece0583954 tempest-SnapshotMetadataTestJSON-1283308983 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:39:10 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-cdec98ab-ece0-4784-a0ef-7aece0583954 tempest-SnapshotMetadataTestJSON-1283308983 None] Deleted volume successfully. Aug 28 09:39:10 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-cdec98ab-ece0-4784-a0ef-7aece0583954 tempest-SnapshotMetadataTestJSON-1283308983 None] Lock "cinder-32c02905-6702-48ae-84cf-4c432c467ead-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:39:10 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-c3ce7344-ffca-4897-96f2-645481722e09 tempest-GroupsTest-219853784 None] Group tempest-Group2-9470511: creating Aug 28 09:39:10 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-c3ce7344-ffca-4897-96f2-645481722e09 tempest-GroupsTest-219853784 None] Group tempest-Group2-9470511: created successfully Aug 28 09:39:10 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-c3ce7344-ffca-4897-96f2-645481722e09 tempest-GroupsTest-219853784 None] Create group completed successfully. Aug 28 09:39:11 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfe410c0-b3e0-4611-b824-78c6a4232bc3 tempest-SnapshotsActionsTest-765698309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:39:11 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-cfe410c0-b3e0-4611-b824-78c6a4232bc3 tempest-SnapshotsActionsTest-765698309 None] Flow 'volume_create_manager' (28596738-9e82-4815-8373-0f761af8c0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:39:11 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-cfe410c0-b3e0-4611-b824-78c6a4232bc3 tempest-SnapshotsActionsTest-765698309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3a48efc-b5eb-44a7-8b04-c099ce30afaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:11 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-cfe410c0-b3e0-4611-b824-78c6a4232bc3 tempest-SnapshotsActionsTest-765698309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3a48efc-b5eb-44a7-8b04-c099ce30afaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-656099481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2694b58b-5a76-451f-880b-8d714f34d880,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d11ac10920e8436f86aefdfbe29034b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:39:11Z,use_quota=True,user_id='f6622283e6604c2eb8042cf5c25f0d86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:11 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-cfe410c0-b3e0-4611-b824-78c6a4232bc3 tempest-SnapshotsActionsTest-765698309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fdd37e0-8bc2-47ee-b6cd-f284a7cfcbc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:11 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-cfe410c0-b3e0-4611-b824-78c6a4232bc3 tempest-SnapshotsActionsTest-765698309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fdd37e0-8bc2-47ee-b6cd-f284a7cfcbc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:11 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-cfe410c0-b3e0-4611-b824-78c6a4232bc3 tempest-SnapshotsActionsTest-765698309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8aae6ab-5c61-4fac-b1a9-42238071ba33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:11 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-cfe410c0-b3e0-4611-b824-78c6a4232bc3 tempest-SnapshotsActionsTest-765698309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8aae6ab-5c61-4fac-b1a9-42238071ba33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2694b58b-5a76-451f-880b-8d714f34d880', 'volume_name': 'volume-2694b58b-5a76-451f-880b-8d714f34d880', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:11 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-cfe410c0-b3e0-4611-b824-78c6a4232bc3 tempest-SnapshotsActionsTest-765698309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff00632c-5008-42ba-966b-a2a34be702df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:11 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-cfe410c0-b3e0-4611-b824-78c6a4232bc3 tempest-SnapshotsActionsTest-765698309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff00632c-5008-42ba-966b-a2a34be702df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:11 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-cfe410c0-b3e0-4611-b824-78c6a4232bc3 tempest-SnapshotsActionsTest-765698309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99c8ca34-5b5d-4db2-82d7-63158543d94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:11 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-cfe410c0-b3e0-4611-b824-78c6a4232bc3 tempest-SnapshotsActionsTest-765698309 None] Volume 2694b58b-5a76-451f-880b-8d714f34d880: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2694b58b-5a76-451f-880b-8d714f34d880', 'volume_size': 1} Aug 28 09:39:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-cfe410c0-b3e0-4611-b824-78c6a4232bc3 tempest-SnapshotsActionsTest-765698309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:39:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-cfe410c0-b3e0-4611-b824-78c6a4232bc3 tempest-SnapshotsActionsTest-765698309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:39:11 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-cfe410c0-b3e0-4611-b824-78c6a4232bc3 tempest-SnapshotsActionsTest-765698309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-656099481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2694b58b-5a76-451f-880b-8d714f34d880,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d11ac10920e8436f86aefdfbe29034b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:39:11Z,use_quota=True,user_id='f6622283e6604c2eb8042cf5c25f0d86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:39:11 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-cfe410c0-b3e0-4611-b824-78c6a4232bc3 tempest-SnapshotsActionsTest-765698309 None] Creating volume 2694b58b-5a76-451f-880b-8d714f34d880 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:39:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-cfe410c0-b3e0-4611-b824-78c6a4232bc3 tempest-SnapshotsActionsTest-765698309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:39:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-cfe410c0-b3e0-4611-b824-78c6a4232bc3 tempest-SnapshotsActionsTest-765698309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:39:11 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-cfe410c0-b3e0-4611-b824-78c6a4232bc3 tempest-SnapshotsActionsTest-765698309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:39:11 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-cfe410c0-b3e0-4611-b824-78c6a4232bc3 tempest-SnapshotsActionsTest-765698309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:39:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-cfe410c0-b3e0-4611-b824-78c6a4232bc3 tempest-SnapshotsActionsTest-765698309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:39:11 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-cfe410c0-b3e0-4611-b824-78c6a4232bc3 tempest-SnapshotsActionsTest-765698309 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:39:11 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-cfe410c0-b3e0-4611-b824-78c6a4232bc3 tempest-SnapshotsActionsTest-765698309 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:39:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-cfe410c0-b3e0-4611-b824-78c6a4232bc3 tempest-SnapshotsActionsTest-765698309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:11 devstack sudo[96138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880 1073741824 Aug 28 09:39:11 devstack sudo[96138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:11 devstack sudo[96138]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-cfe410c0-b3e0-4611-b824-78c6a4232bc3 tempest-SnapshotsActionsTest-765698309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880 1073741824" returned: 0 in 0.570s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-cfe410c0-b3e0-4611-b824-78c6a4232bc3 tempest-SnapshotsActionsTest-765698309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:11 devstack sudo[96146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880 Aug 28 09:39:11 devstack sudo[96146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:12 devstack sudo[96146]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-cfe410c0-b3e0-4611-b824-78c6a4232bc3 tempest-SnapshotsActionsTest-765698309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880" returned: 0 in 0.286s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:12 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-cfe410c0-b3e0-4611-b824-78c6a4232bc3 tempest-SnapshotsActionsTest-765698309 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:39:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-cfe410c0-b3e0-4611-b824-78c6a4232bc3 tempest-SnapshotsActionsTest-765698309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:39:12 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-cfe410c0-b3e0-4611-b824-78c6a4232bc3 tempest-SnapshotsActionsTest-765698309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99c8ca34-5b5d-4db2-82d7-63158543d94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2694b58b-5a76-451f-880b-8d714f34d880', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:12 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-cfe410c0-b3e0-4611-b824-78c6a4232bc3 tempest-SnapshotsActionsTest-765698309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8778e10-be16-4200-a916-2a335d2a6fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:12 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-cfe410c0-b3e0-4611-b824-78c6a4232bc3 tempest-SnapshotsActionsTest-765698309 None] Volume volume-2694b58b-5a76-451f-880b-8d714f34d880 (2694b58b-5a76-451f-880b-8d714f34d880): created successfully Aug 28 09:39:12 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-cfe410c0-b3e0-4611-b824-78c6a4232bc3 tempest-SnapshotsActionsTest-765698309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8778e10-be16-4200-a916-2a335d2a6fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:12 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-cfe410c0-b3e0-4611-b824-78c6a4232bc3 tempest-SnapshotsActionsTest-765698309 None] Flow 'volume_create_manager' (28596738-9e82-4815-8373-0f761af8c0b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:39:12 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-cfe410c0-b3e0-4611-b824-78c6a4232bc3 tempest-SnapshotsActionsTest-765698309 None] Created volume successfully. Aug 28 09:39:12 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-0090aa38-3231-459b-861b-deca3088235d tempest-GroupsTest-219853784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:39:12 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0090aa38-3231-459b-861b-deca3088235d tempest-GroupsTest-219853784 None] Flow 'volume_create_manager' (dd7f6e8d-c07b-4b84-935f-d15fe8221a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:39:12 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0090aa38-3231-459b-861b-deca3088235d tempest-GroupsTest-219853784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (185194d2-acc5-4ccb-86be-9f3e4d2d49ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:12 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0090aa38-3231-459b-861b-deca3088235d tempest-GroupsTest-219853784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (185194d2-acc5-4ccb-86be-9f3e4d2d49ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:39:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-747550593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5e1d27fb-1a2e-4255-84b8-c5d0cfea251b,host='devstack@QuobyteHD#QuobyteHD',id=a03253a0-0997-43ff-b258-8b04e5d100f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc679b3716dd41799d7c22fc9185d830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:39:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:39:13Z,use_quota=True,user_id='ad9b0cd6ed654fe2a7c79dbc53ae8c8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0d090a-7157-4e8a-aee3-fb67e65a1f45),volume_type_id=ca0d090a-7157-4e8a-aee3-fb67e65a1f45)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:12 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0090aa38-3231-459b-861b-deca3088235d tempest-GroupsTest-219853784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c16048e-eaff-4685-ad61-522783d52f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:12 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0090aa38-3231-459b-861b-deca3088235d tempest-GroupsTest-219853784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c16048e-eaff-4685-ad61-522783d52f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:12 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0090aa38-3231-459b-861b-deca3088235d tempest-GroupsTest-219853784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d6489d1-00f8-4775-b95b-3737fc04d440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:12 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0090aa38-3231-459b-861b-deca3088235d tempest-GroupsTest-219853784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d6489d1-00f8-4775-b95b-3737fc04d440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a03253a0-0997-43ff-b258-8b04e5d100f3', 'volume_name': 'volume-a03253a0-0997-43ff-b258-8b04e5d100f3', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:12 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0090aa38-3231-459b-861b-deca3088235d tempest-GroupsTest-219853784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bcc73ad-04c1-4ac5-9d34-a387213a196c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:12 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0090aa38-3231-459b-861b-deca3088235d tempest-GroupsTest-219853784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bcc73ad-04c1-4ac5-9d34-a387213a196c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:12 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0090aa38-3231-459b-861b-deca3088235d tempest-GroupsTest-219853784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c74238-4bb3-4eac-a8dc-d1b56e7363fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:12 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-0090aa38-3231-459b-861b-deca3088235d tempest-GroupsTest-219853784 None] Volume a03253a0-0997-43ff-b258-8b04e5d100f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a03253a0-0997-43ff-b258-8b04e5d100f3', 'volume_size': 1} Aug 28 09:39:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0090aa38-3231-459b-861b-deca3088235d tempest-GroupsTest-219853784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:39:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0090aa38-3231-459b-861b-deca3088235d tempest-GroupsTest-219853784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:39:12 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0090aa38-3231-459b-861b-deca3088235d tempest-GroupsTest-219853784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5e1d27fb-1a2e-4255-84b8-c5d0cfea251b,created_at=2026-08-28T07:39:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-747550593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5e1d27fb-1a2e-4255-84b8-c5d0cfea251b,host='devstack@QuobyteHD#QuobyteHD',id=a03253a0-0997-43ff-b258-8b04e5d100f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc679b3716dd41799d7c22fc9185d830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:39:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:39:13Z,use_quota=True,user_id='ad9b0cd6ed654fe2a7c79dbc53ae8c8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0d090a-7157-4e8a-aee3-fb67e65a1f45),volume_type_id=ca0d090a-7157-4e8a-aee3-fb67e65a1f45)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:39:12 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-0090aa38-3231-459b-861b-deca3088235d tempest-GroupsTest-219853784 None] Creating volume a03253a0-0997-43ff-b258-8b04e5d100f3 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:39:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0090aa38-3231-459b-861b-deca3088235d tempest-GroupsTest-219853784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:39:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0090aa38-3231-459b-861b-deca3088235d tempest-GroupsTest-219853784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:39:12 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0090aa38-3231-459b-861b-deca3088235d tempest-GroupsTest-219853784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:39:12 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0090aa38-3231-459b-861b-deca3088235d tempest-GroupsTest-219853784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:39:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0090aa38-3231-459b-861b-deca3088235d tempest-GroupsTest-219853784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:39:12 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0090aa38-3231-459b-861b-deca3088235d tempest-GroupsTest-219853784 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:39:12 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-0090aa38-3231-459b-861b-deca3088235d tempest-GroupsTest-219853784 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:39:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0090aa38-3231-459b-861b-deca3088235d tempest-GroupsTest-219853784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a03253a0-0997-43ff-b258-8b04e5d100f3 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:12 devstack sudo[96149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a03253a0-0997-43ff-b258-8b04e5d100f3 1073741824 Aug 28 09:39:12 devstack sudo[96149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:13 devstack sudo[96149]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0090aa38-3231-459b-861b-deca3088235d tempest-GroupsTest-219853784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a03253a0-0997-43ff-b258-8b04e5d100f3 1073741824" returned: 0 in 0.598s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0090aa38-3231-459b-861b-deca3088235d tempest-GroupsTest-219853784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a03253a0-0997-43ff-b258-8b04e5d100f3 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:13 devstack sudo[96154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a03253a0-0997-43ff-b258-8b04e5d100f3 Aug 28 09:39:13 devstack sudo[96154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-6c9f432a-60b0-43fb-bce1-c91aab12b5fd tempest-SnapshotsActionsTest-765698309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:39:13 devstack sudo[96154]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0090aa38-3231-459b-861b-deca3088235d tempest-GroupsTest-219853784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a03253a0-0997-43ff-b258-8b04e5d100f3" returned: 0 in 0.319s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:13 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0090aa38-3231-459b-861b-deca3088235d tempest-GroupsTest-219853784 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:39:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0090aa38-3231-459b-861b-deca3088235d tempest-GroupsTest-219853784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:39:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-6c9f432a-60b0-43fb-bce1-c91aab12b5fd tempest-SnapshotsActionsTest-765698309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.141s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:39:13 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0090aa38-3231-459b-861b-deca3088235d tempest-GroupsTest-219853784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c74238-4bb3-4eac-a8dc-d1b56e7363fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a03253a0-0997-43ff-b258-8b04e5d100f3', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:13 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0090aa38-3231-459b-861b-deca3088235d tempest-GroupsTest-219853784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6589b804-335b-4eae-a107-a7c9666aad88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:13 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-6c9f432a-60b0-43fb-bce1-c91aab12b5fd tempest-SnapshotsActionsTest-765698309 None] Creating offline snapshot dee06454-4775-43ec-858a-23fd58abd6c8 of volume 2694b58b-5a76-451f-880b-8d714f34d880 {{(pid=86081) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:39:13 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-0090aa38-3231-459b-861b-deca3088235d tempest-GroupsTest-219853784 None] Volume volume-a03253a0-0997-43ff-b258-8b04e5d100f3 (a03253a0-0997-43ff-b258-8b04e5d100f3): created successfully Aug 28 09:39:13 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0090aa38-3231-459b-861b-deca3088235d tempest-GroupsTest-219853784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6589b804-335b-4eae-a107-a7c9666aad88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:13 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0090aa38-3231-459b-861b-deca3088235d tempest-GroupsTest-219853784 None] Flow 'volume_create_manager' (dd7f6e8d-c07b-4b84-935f-d15fe8221a28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:39:13 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[5920b959-fc9a-4880-b2c8-91b5429ff717]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:39:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6c9f432a-60b0-43fb-bce1-c91aab12b5fd tempest-SnapshotsActionsTest-765698309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:13 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-0090aa38-3231-459b-861b-deca3088235d tempest-GroupsTest-219853784 None] Created volume successfully. Aug 28 09:39:13 devstack sudo[96157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880 Aug 28 09:39:13 devstack sudo[96157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:14 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-68e15c0f-7888-4821-a3f9-052656562a5e tempest-VolumesDeleteCascade-1232137414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:39:14 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-68e15c0f-7888-4821-a3f9-052656562a5e tempest-VolumesDeleteCascade-1232137414 None] Flow 'volume_create_manager' (c1804795-3156-4105-b004-f18c6375c918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:39:14 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-68e15c0f-7888-4821-a3f9-052656562a5e tempest-VolumesDeleteCascade-1232137414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bcd7f97-eda0-41aa-aae0-56182b2c081d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:14 devstack sudo[96157]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6c9f432a-60b0-43fb-bce1-c91aab12b5fd tempest-SnapshotsActionsTest-765698309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880" returned: 0 in 0.537s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6c9f432a-60b0-43fb-bce1-c91aab12b5fd tempest-SnapshotsActionsTest-765698309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:14 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-68e15c0f-7888-4821-a3f9-052656562a5e tempest-VolumesDeleteCascade-1232137414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bcd7f97-eda0-41aa-aae0-56182b2c081d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:39:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1625476629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=129d97a2-9ddc-48a5-ad6c-241fef25f9f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ab35bad29b74cc0a1701557dd8cd5f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:39:14Z,use_quota=True,user_id='c24d2ef9c5f4479f8577b60287619136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:14 devstack sudo[96163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8 1G Aug 28 09:39:14 devstack sudo[96163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:14 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-68e15c0f-7888-4821-a3f9-052656562a5e tempest-VolumesDeleteCascade-1232137414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b0c7d3f-02bc-44a8-bc60-001405c703b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:14 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-68e15c0f-7888-4821-a3f9-052656562a5e tempest-VolumesDeleteCascade-1232137414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b0c7d3f-02bc-44a8-bc60-001405c703b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:14 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-68e15c0f-7888-4821-a3f9-052656562a5e tempest-VolumesDeleteCascade-1232137414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d86145a1-8863-448c-b0be-229b76ea9581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:14 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-68e15c0f-7888-4821-a3f9-052656562a5e tempest-VolumesDeleteCascade-1232137414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d86145a1-8863-448c-b0be-229b76ea9581) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '129d97a2-9ddc-48a5-ad6c-241fef25f9f0', 'volume_name': 'volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:14 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-68e15c0f-7888-4821-a3f9-052656562a5e tempest-VolumesDeleteCascade-1232137414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f31dcabb-fe7b-4a80-aff8-a5af444b3e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:14 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-68e15c0f-7888-4821-a3f9-052656562a5e tempest-VolumesDeleteCascade-1232137414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f31dcabb-fe7b-4a80-aff8-a5af444b3e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:14 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-68e15c0f-7888-4821-a3f9-052656562a5e tempest-VolumesDeleteCascade-1232137414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68f9dd52-125c-4f54-a307-5cceae59b425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:14 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-68e15c0f-7888-4821-a3f9-052656562a5e tempest-VolumesDeleteCascade-1232137414 None] Volume 129d97a2-9ddc-48a5-ad6c-241fef25f9f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0', 'volume_size': 1} Aug 28 09:39:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-68e15c0f-7888-4821-a3f9-052656562a5e tempest-VolumesDeleteCascade-1232137414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:39:14 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-5919e108-a6a2-4aad-9ed9-1f9123f63097 tempest-GroupsTest-219853784 None] Acquiring lock "cinder-quobyte-a03253a0-0997-43ff-b258-8b04e5d100f3" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:39:14 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-5919e108-a6a2-4aad-9ed9-1f9123f63097 tempest-GroupsTest-219853784 None] Lock "cinder-quobyte-a03253a0-0997-43ff-b258-8b04e5d100f3" acquired by "delete_volume" :: waited 0.021s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:39:14 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[419083cc-74a1-4b81-a1b0-06fce0b34500]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:39:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5919e108-a6a2-4aad-9ed9-1f9123f63097 tempest-GroupsTest-219853784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a03253a0-0997-43ff-b258-8b04e5d100f3 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:14 devstack sudo[96168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a03253a0-0997-43ff-b258-8b04e5d100f3 Aug 28 09:39:14 devstack sudo[96168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:14 devstack sudo[96163]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6c9f432a-60b0-43fb-bce1-c91aab12b5fd tempest-SnapshotsActionsTest-765698309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8 1G" returned: 0 in 0.521s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6c9f432a-60b0-43fb-bce1-c91aab12b5fd tempest-SnapshotsActionsTest-765698309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2694b58b-5a76-451f-880b-8d714f34d880 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:14 devstack sudo[96172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2694b58b-5a76-451f-880b-8d714f34d880 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8 Aug 28 09:39:14 devstack sudo[96172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:15 devstack sudo[96168]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5919e108-a6a2-4aad-9ed9-1f9123f63097 tempest-GroupsTest-219853784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a03253a0-0997-43ff-b258-8b04e5d100f3" returned: 0 in 0.413s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5919e108-a6a2-4aad-9ed9-1f9123f63097 tempest-GroupsTest-219853784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a03253a0-0997-43ff-b258-8b04e5d100f3 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:15 devstack sudo[96182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a03253a0-0997-43ff-b258-8b04e5d100f3 Aug 28 09:39:15 devstack sudo[96182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:15 devstack sudo[96172]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6c9f432a-60b0-43fb-bce1-c91aab12b5fd tempest-SnapshotsActionsTest-765698309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2694b58b-5a76-451f-880b-8d714f34d880 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8" returned: 0 in 0.325s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:15 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-6c9f432a-60b0-43fb-bce1-c91aab12b5fd tempest-SnapshotsActionsTest-765698309 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8 is being set with open permissions: ugo+rw Aug 28 09:39:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6c9f432a-60b0-43fb-bce1-c91aab12b5fd tempest-SnapshotsActionsTest-765698309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:15 devstack sudo[96184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8 Aug 28 09:39:15 devstack sudo[96184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:15 devstack sudo[96182]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:15 devstack sudo[96184]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5919e108-a6a2-4aad-9ed9-1f9123f63097 tempest-GroupsTest-219853784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a03253a0-0997-43ff-b258-8b04e5d100f3" returned: 0 in 0.311s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6c9f432a-60b0-43fb-bce1-c91aab12b5fd tempest-SnapshotsActionsTest-765698309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8" returned: 0 in 0.264s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:15 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-5919e108-a6a2-4aad-9ed9-1f9123f63097 tempest-GroupsTest-219853784 None] Lock "cinder-quobyte-a03253a0-0997-43ff-b258-8b04e5d100f3" released by "delete_volume" :: held 0.781s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:39:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6c9f432a-60b0-43fb-bce1-c91aab12b5fd tempest-SnapshotsActionsTest-765698309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:15 devstack sudo[96188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.info Aug 28 09:39:15 devstack sudo[96188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:15 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-5919e108-a6a2-4aad-9ed9-1f9123f63097 tempest-GroupsTest-219853784 None] Created reservations ['263dc509-10cb-42e5-9d8e-2f606893a746'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:39:15 devstack cinder-volume[86081]: WARNING cinder.quota [None req-5919e108-a6a2-4aad-9ed9-1f9123f63097 tempest-GroupsTest-219853784 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1069872457 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1069872457, it is now deprecated. Please use the default quota class for default quota. Aug 28 09:39:15 devstack cinder-volume[86081]: WARNING cinder.quota [None req-5919e108-a6a2-4aad-9ed9-1f9123f63097 tempest-GroupsTest-219853784 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1069872457 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1069872457, it is now deprecated. Please use the default quota class for default quota. Aug 28 09:39:15 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-5919e108-a6a2-4aad-9ed9-1f9123f63097 tempest-GroupsTest-219853784 None] Created reservations ['dac68d6b-30e3-47fa-9a1b-7020da1c7020', '84c2e299-a6a7-4a22-ac9c-c5059c3e59cf', '3800a0f3-3eeb-47f1-9e52-5267b6b1c71c', 'a39e27db-80ff-46ce-9688-f9b639e88565'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:39:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-5919e108-a6a2-4aad-9ed9-1f9123f63097 tempest-GroupsTest-219853784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:39:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-5919e108-a6a2-4aad-9ed9-1f9123f63097 tempest-GroupsTest-219853784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:39:15 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-5919e108-a6a2-4aad-9ed9-1f9123f63097 tempest-GroupsTest-219853784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:39:15 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-5919e108-a6a2-4aad-9ed9-1f9123f63097 tempest-GroupsTest-219853784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:39:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-5919e108-a6a2-4aad-9ed9-1f9123f63097 tempest-GroupsTest-219853784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:39:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5919e108-a6a2-4aad-9ed9-1f9123f63097 tempest-GroupsTest-219853784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:15 devstack sudo[96190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:39:15 devstack sudo[96190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:15 devstack sudo[96188]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6c9f432a-60b0-43fb-bce1-c91aab12b5fd tempest-SnapshotsActionsTest-765698309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.info" returned: 0 in 0.301s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:15 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-6c9f432a-60b0-43fb-bce1-c91aab12b5fd tempest-SnapshotsActionsTest-765698309 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.info is being set with open permissions: ugo+rw Aug 28 09:39:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6c9f432a-60b0-43fb-bce1-c91aab12b5fd tempest-SnapshotsActionsTest-765698309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:15 devstack sudo[96193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.info Aug 28 09:39:15 devstack sudo[96193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:15 devstack sudo[96190]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:15 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-63f3dcee-9901-464c-a738-ff4d0a8c879d tempest-GroupsTest-219853784 None] Created reservations ['58fa4a6f-9f4f-4a8e-8048-b230f18b7bc4'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:39:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5919e108-a6a2-4aad-9ed9-1f9123f63097 tempest-GroupsTest-219853784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.317s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:16 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-5919e108-a6a2-4aad-9ed9-1f9123f63097 tempest-GroupsTest-219853784 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:39:16 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-5919e108-a6a2-4aad-9ed9-1f9123f63097 tempest-GroupsTest-219853784 None] Delete group completed successfully. Aug 28 09:39:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-63f3dcee-9901-464c-a738-ff4d0a8c879d tempest-GroupsTest-219853784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:39:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-63f3dcee-9901-464c-a738-ff4d0a8c879d tempest-GroupsTest-219853784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:39:16 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-63f3dcee-9901-464c-a738-ff4d0a8c879d tempest-GroupsTest-219853784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:39:16 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-63f3dcee-9901-464c-a738-ff4d0a8c879d tempest-GroupsTest-219853784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:39:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-63f3dcee-9901-464c-a738-ff4d0a8c879d tempest-GroupsTest-219853784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:39:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-63f3dcee-9901-464c-a738-ff4d0a8c879d tempest-GroupsTest-219853784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:16 devstack sudo[96193]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6c9f432a-60b0-43fb-bce1-c91aab12b5fd tempest-SnapshotsActionsTest-765698309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.info" returned: 0 in 0.352s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-6c9f432a-60b0-43fb-bce1-c91aab12b5fd tempest-SnapshotsActionsTest-765698309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.461s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:39:16 devstack sudo[96197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:39:16 devstack sudo[96197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-68e15c0f-7888-4821-a3f9-052656562a5e tempest-VolumesDeleteCascade-1232137414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.784s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:39:16 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-68e15c0f-7888-4821-a3f9-052656562a5e tempest-VolumesDeleteCascade-1232137414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:39:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1625476629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=129d97a2-9ddc-48a5-ad6c-241fef25f9f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ab35bad29b74cc0a1701557dd8cd5f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:39:14Z,use_quota=True,user_id='c24d2ef9c5f4479f8577b60287619136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:39:16 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-68e15c0f-7888-4821-a3f9-052656562a5e tempest-VolumesDeleteCascade-1232137414 None] Creating volume 129d97a2-9ddc-48a5-ad6c-241fef25f9f0 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:39:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-68e15c0f-7888-4821-a3f9-052656562a5e tempest-VolumesDeleteCascade-1232137414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:39:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-68e15c0f-7888-4821-a3f9-052656562a5e tempest-VolumesDeleteCascade-1232137414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:39:16 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-68e15c0f-7888-4821-a3f9-052656562a5e tempest-VolumesDeleteCascade-1232137414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:39:16 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-68e15c0f-7888-4821-a3f9-052656562a5e tempest-VolumesDeleteCascade-1232137414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:39:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-68e15c0f-7888-4821-a3f9-052656562a5e tempest-VolumesDeleteCascade-1232137414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:39:16 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-68e15c0f-7888-4821-a3f9-052656562a5e tempest-VolumesDeleteCascade-1232137414 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:39:16 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-68e15c0f-7888-4821-a3f9-052656562a5e tempest-VolumesDeleteCascade-1232137414 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:39:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-68e15c0f-7888-4821-a3f9-052656562a5e tempest-VolumesDeleteCascade-1232137414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:16 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-6c9f432a-60b0-43fb-bce1-c91aab12b5fd tempest-SnapshotsActionsTest-765698309 None] Create snapshot completed successfully Aug 28 09:39:16 devstack sudo[96199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0 1073741824 Aug 28 09:39:16 devstack sudo[96199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:16 devstack sudo[96197]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-63f3dcee-9901-464c-a738-ff4d0a8c879d tempest-GroupsTest-219853784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.276s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:16 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-63f3dcee-9901-464c-a738-ff4d0a8c879d tempest-GroupsTest-219853784 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:39:16 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-63f3dcee-9901-464c-a738-ff4d0a8c879d tempest-GroupsTest-219853784 None] Delete group completed successfully. Aug 28 09:39:16 devstack sudo[96199]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-68e15c0f-7888-4821-a3f9-052656562a5e tempest-VolumesDeleteCascade-1232137414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0 1073741824" returned: 0 in 0.534s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-68e15c0f-7888-4821-a3f9-052656562a5e tempest-VolumesDeleteCascade-1232137414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:16 devstack sudo[96207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0 Aug 28 09:39:16 devstack sudo[96207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:17 devstack sudo[96207]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-68e15c0f-7888-4821-a3f9-052656562a5e tempest-VolumesDeleteCascade-1232137414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0" returned: 0 in 0.313s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:17 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-68e15c0f-7888-4821-a3f9-052656562a5e tempest-VolumesDeleteCascade-1232137414 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:39:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-68e15c0f-7888-4821-a3f9-052656562a5e tempest-VolumesDeleteCascade-1232137414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:39:17 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-68e15c0f-7888-4821-a3f9-052656562a5e tempest-VolumesDeleteCascade-1232137414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68f9dd52-125c-4f54-a307-5cceae59b425) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:17 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-68e15c0f-7888-4821-a3f9-052656562a5e tempest-VolumesDeleteCascade-1232137414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f95a89b-bfba-42ce-9b26-05336bd8f993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:17 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-68e15c0f-7888-4821-a3f9-052656562a5e tempest-VolumesDeleteCascade-1232137414 None] Volume volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0 (129d97a2-9ddc-48a5-ad6c-241fef25f9f0): created successfully Aug 28 09:39:17 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-68e15c0f-7888-4821-a3f9-052656562a5e tempest-VolumesDeleteCascade-1232137414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f95a89b-bfba-42ce-9b26-05336bd8f993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:17 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-68e15c0f-7888-4821-a3f9-052656562a5e tempest-VolumesDeleteCascade-1232137414 None] Flow 'volume_create_manager' (c1804795-3156-4105-b004-f18c6375c918) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:39:17 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-68e15c0f-7888-4821-a3f9-052656562a5e tempest-VolumesDeleteCascade-1232137414 None] Created volume successfully. Aug 28 09:39:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-36a21943-300f-48c6-8417-99d68939b7de tempest-SnapshotsActionsTest-765698309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:39:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-36a21943-300f-48c6-8417-99d68939b7de tempest-SnapshotsActionsTest-765698309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:39:17 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-36a21943-300f-48c6-8417-99d68939b7de tempest-SnapshotsActionsTest-765698309 None] Creating offline snapshot 42f8d741-bcdb-4283-85ed-def85aac20e3 of volume 2694b58b-5a76-451f-880b-8d714f34d880 {{(pid=86081) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:39:17 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[99bc7a62-e8d6-4071-9dab-1d9a9ac9f7ff]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:39:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-36a21943-300f-48c6-8417-99d68939b7de tempest-SnapshotsActionsTest-765698309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:17 devstack sudo[96210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8 Aug 28 09:39:17 devstack sudo[96210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-80bd0428-f705-4c36-9a65-f4d4165e2638 tempest-VolumesDeleteCascade-1232137414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:39:17 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-c7c4ed47-c690-45b5-92ff-0cf1d6db321c tempest-GroupsTest-219853784 None] Group tempest-GroupsTest-Group-2123792276: creating Aug 28 09:39:17 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-c7c4ed47-c690-45b5-92ff-0cf1d6db321c tempest-GroupsTest-219853784 None] Group tempest-GroupsTest-Group-2123792276: created successfully Aug 28 09:39:17 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-c7c4ed47-c690-45b5-92ff-0cf1d6db321c tempest-GroupsTest-219853784 None] Create group completed successfully. Aug 28 09:39:18 devstack sudo[96210]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-36a21943-300f-48c6-8417-99d68939b7de tempest-SnapshotsActionsTest-765698309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8" returned: 0 in 0.488s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:18 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-36a21943-300f-48c6-8417-99d68939b7de tempest-SnapshotsActionsTest-765698309 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2694b58b-5a76-451f-880b-8d714f34d880(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:39:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-36a21943-300f-48c6-8417-99d68939b7de tempest-SnapshotsActionsTest-765698309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.42f8d741-bcdb-4283-85ed-def85aac20e3 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:18 devstack sudo[96216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.42f8d741-bcdb-4283-85ed-def85aac20e3 1G Aug 28 09:39:18 devstack sudo[96216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:18 devstack sudo[96216]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-36a21943-300f-48c6-8417-99d68939b7de tempest-SnapshotsActionsTest-765698309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.42f8d741-bcdb-4283-85ed-def85aac20e3 1G" returned: 0 in 0.450s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-36a21943-300f-48c6-8417-99d68939b7de tempest-SnapshotsActionsTest-765698309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.42f8d741-bcdb-4283-85ed-def85aac20e3 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:18 devstack sudo[96222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.42f8d741-bcdb-4283-85ed-def85aac20e3 Aug 28 09:39:18 devstack sudo[96222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:18 devstack sudo[96222]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-36a21943-300f-48c6-8417-99d68939b7de tempest-SnapshotsActionsTest-765698309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.42f8d741-bcdb-4283-85ed-def85aac20e3" returned: 0 in 0.351s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:18 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-36a21943-300f-48c6-8417-99d68939b7de tempest-SnapshotsActionsTest-765698309 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.42f8d741-bcdb-4283-85ed-def85aac20e3 is being set with open permissions: ugo+rw Aug 28 09:39:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-36a21943-300f-48c6-8417-99d68939b7de tempest-SnapshotsActionsTest-765698309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.42f8d741-bcdb-4283-85ed-def85aac20e3 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:18 devstack sudo[96229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.42f8d741-bcdb-4283-85ed-def85aac20e3 Aug 28 09:39:18 devstack sudo[96229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:19 devstack sudo[96229]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-36a21943-300f-48c6-8417-99d68939b7de tempest-SnapshotsActionsTest-765698309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.42f8d741-bcdb-4283-85ed-def85aac20e3" returned: 0 in 0.256s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-36a21943-300f-48c6-8417-99d68939b7de tempest-SnapshotsActionsTest-765698309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.687s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:39:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-80bd0428-f705-4c36-9a65-f4d4165e2638 tempest-VolumesDeleteCascade-1232137414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.320s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:39:19 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-80bd0428-f705-4c36-9a65-f4d4165e2638 tempest-VolumesDeleteCascade-1232137414 None] Creating offline snapshot e995fee1-0a05-48d4-8ee9-47c2f4a47936 of volume 129d97a2-9ddc-48a5-ad6c-241fef25f9f0 {{(pid=86081) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:39:19 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-36a21943-300f-48c6-8417-99d68939b7de tempest-SnapshotsActionsTest-765698309 None] Create snapshot completed successfully Aug 28 09:39:19 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1581f28-3b3e-410b-b0d4-eba98aeed0f0]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:39:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-80bd0428-f705-4c36-9a65-f4d4165e2638 tempest-VolumesDeleteCascade-1232137414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:19 devstack sudo[96234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0 Aug 28 09:39:19 devstack sudo[96234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:19 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-32e16bd3-5e91-4cbd-a6c1-795cb9e039a7 tempest-GroupsTest-219853784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:39:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-32e16bd3-5e91-4cbd-a6c1-795cb9e039a7 tempest-GroupsTest-219853784 None] Flow 'volume_create_manager' (397e2aa1-06b8-4178-839e-e603fe272061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:39:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-32e16bd3-5e91-4cbd-a6c1-795cb9e039a7 tempest-GroupsTest-219853784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d4fcaa6-c109-4f37-b4ea-56780d1e1a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-32e16bd3-5e91-4cbd-a6c1-795cb9e039a7 tempest-GroupsTest-219853784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d4fcaa6-c109-4f37-b4ea-56780d1e1a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1321965269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4e057e44-7ea5-4c0f-bb3f-7e8f0ebce997,host='devstack@QuobyteHD#QuobyteHD',id=ddbbb53a-2139-4a7d-b014-142912639ea4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc679b3716dd41799d7c22fc9185d830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:39:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:39:19Z,use_quota=True,user_id='ad9b0cd6ed654fe2a7c79dbc53ae8c8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f40a4ad8-b0b6-4ead-81d0-519afac86c44),volume_type_id=f40a4ad8-b0b6-4ead-81d0-519afac86c44)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:19 devstack sudo[96234]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-32e16bd3-5e91-4cbd-a6c1-795cb9e039a7 tempest-GroupsTest-219853784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f206b2bd-d19c-4703-b713-cc587b2c1d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-32e16bd3-5e91-4cbd-a6c1-795cb9e039a7 tempest-GroupsTest-219853784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f206b2bd-d19c-4703-b713-cc587b2c1d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-32e16bd3-5e91-4cbd-a6c1-795cb9e039a7 tempest-GroupsTest-219853784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2571822e-29a7-46b6-95c2-f852c290907b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-32e16bd3-5e91-4cbd-a6c1-795cb9e039a7 tempest-GroupsTest-219853784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2571822e-29a7-46b6-95c2-f852c290907b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddbbb53a-2139-4a7d-b014-142912639ea4', 'volume_name': 'volume-ddbbb53a-2139-4a7d-b014-142912639ea4', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-32e16bd3-5e91-4cbd-a6c1-795cb9e039a7 tempest-GroupsTest-219853784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (388f6e35-f819-4750-b2bd-fb1997441aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-32e16bd3-5e91-4cbd-a6c1-795cb9e039a7 tempest-GroupsTest-219853784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (388f6e35-f819-4750-b2bd-fb1997441aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-32e16bd3-5e91-4cbd-a6c1-795cb9e039a7 tempest-GroupsTest-219853784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50557f7e-b52f-4c80-898e-673199cf69fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:19 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-32e16bd3-5e91-4cbd-a6c1-795cb9e039a7 tempest-GroupsTest-219853784 None] Volume ddbbb53a-2139-4a7d-b014-142912639ea4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddbbb53a-2139-4a7d-b014-142912639ea4', 'volume_size': 1} Aug 28 09:39:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-32e16bd3-5e91-4cbd-a6c1-795cb9e039a7 tempest-GroupsTest-219853784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:39:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-80bd0428-f705-4c36-9a65-f4d4165e2638 tempest-VolumesDeleteCascade-1232137414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0" returned: 0 in 0.490s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-80bd0428-f705-4c36-9a65-f4d4165e2638 tempest-VolumesDeleteCascade-1232137414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.e995fee1-0a05-48d4-8ee9-47c2f4a47936 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:19 devstack sudo[96240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.e995fee1-0a05-48d4-8ee9-47c2f4a47936 1G Aug 28 09:39:19 devstack sudo[96240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:19 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-80185b0f-0dd8-466c-8ea4-4492e9c7150e tempest-SnapshotsActionsTest-1083237043 None] Acquiring lock "cinder-42f8d741-bcdb-4283-85ed-def85aac20e3-delete_snapshot" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:39:19 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-80185b0f-0dd8-466c-8ea4-4492e9c7150e tempest-SnapshotsActionsTest-1083237043 None] Lock "cinder-42f8d741-bcdb-4283-85ed-def85aac20e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:39:19 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-80185b0f-0dd8-466c-8ea4-4492e9c7150e tempest-SnapshotsActionsTest-1083237043 None] Acquiring lock "cinder-quobyte-2694b58b-5a76-451f-880b-8d714f34d880" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:39:19 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-80185b0f-0dd8-466c-8ea4-4492e9c7150e tempest-SnapshotsActionsTest-1083237043 None] Lock "cinder-quobyte-2694b58b-5a76-451f-880b-8d714f34d880" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:39:19 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-80185b0f-0dd8-466c-8ea4-4492e9c7150e tempest-SnapshotsActionsTest-1083237043 None] Acquiring lock "cinder-quobyte-42f8d741-bcdb-4283-85ed-def85aac20e3" by "_delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:39:19 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-80185b0f-0dd8-466c-8ea4-4492e9c7150e tempest-SnapshotsActionsTest-1083237043 None] Lock "cinder-quobyte-42f8d741-bcdb-4283-85ed-def85aac20e3" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:39:19 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-80185b0f-0dd8-466c-8ea4-4492e9c7150e tempest-SnapshotsActionsTest-1083237043 None] Deleting offline snapshot 42f8d741-bcdb-4283-85ed-def85aac20e3 of volume 2694b58b-5a76-451f-880b-8d714f34d880 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:39:19 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-80185b0f-0dd8-466c-8ea4-4492e9c7150e tempest-SnapshotsActionsTest-1083237043 None] snapshot_file for this snap is: volume-2694b58b-5a76-451f-880b-8d714f34d880.42f8d741-bcdb-4283-85ed-def85aac20e3 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:39:19 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[607b9124-32d2-4e91-acc2-59855181c32f]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:39:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-80185b0f-0dd8-466c-8ea4-4492e9c7150e tempest-SnapshotsActionsTest-1083237043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.42f8d741-bcdb-4283-85ed-def85aac20e3 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:20 devstack sudo[96244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.42f8d741-bcdb-4283-85ed-def85aac20e3 Aug 28 09:39:20 devstack sudo[96244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:20 devstack sudo[96240]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-80bd0428-f705-4c36-9a65-f4d4165e2638 tempest-VolumesDeleteCascade-1232137414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.e995fee1-0a05-48d4-8ee9-47c2f4a47936 1G" returned: 0 in 0.569s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-80bd0428-f705-4c36-9a65-f4d4165e2638 tempest-VolumesDeleteCascade-1232137414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.e995fee1-0a05-48d4-8ee9-47c2f4a47936 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:20 devstack sudo[96248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.e995fee1-0a05-48d4-8ee9-47c2f4a47936 Aug 28 09:39:20 devstack sudo[96248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:20 devstack sudo[96244]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-80185b0f-0dd8-466c-8ea4-4492e9c7150e tempest-SnapshotsActionsTest-1083237043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.42f8d741-bcdb-4283-85ed-def85aac20e3" returned: 0 in 0.414s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:20 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-80185b0f-0dd8-466c-8ea4-4492e9c7150e tempest-SnapshotsActionsTest-1083237043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2694b58b-5a76-451f-880b-8d714f34d880(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:39:20 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[2144f154-8e1e-4a0f-a2ee-f982629fb23e]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:39:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-80185b0f-0dd8-466c-8ea4-4492e9c7150e tempest-SnapshotsActionsTest-1083237043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:20 devstack sudo[96253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8 Aug 28 09:39:20 devstack sudo[96253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:20 devstack sudo[96248]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-80bd0428-f705-4c36-9a65-f4d4165e2638 tempest-VolumesDeleteCascade-1232137414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.e995fee1-0a05-48d4-8ee9-47c2f4a47936" returned: 0 in 0.333s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:20 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-80bd0428-f705-4c36-9a65-f4d4165e2638 tempest-VolumesDeleteCascade-1232137414 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.e995fee1-0a05-48d4-8ee9-47c2f4a47936 is being set with open permissions: ugo+rw Aug 28 09:39:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-80bd0428-f705-4c36-9a65-f4d4165e2638 tempest-VolumesDeleteCascade-1232137414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.e995fee1-0a05-48d4-8ee9-47c2f4a47936 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:20 devstack sudo[96258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.e995fee1-0a05-48d4-8ee9-47c2f4a47936 Aug 28 09:39:20 devstack sudo[96258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:20 devstack sudo[96258]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:20 devstack sudo[96253]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-80185b0f-0dd8-466c-8ea4-4492e9c7150e tempest-SnapshotsActionsTest-1083237043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8" returned: 0 in 0.446s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:20 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-80185b0f-0dd8-466c-8ea4-4492e9c7150e tempest-SnapshotsActionsTest-1083237043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2694b58b-5a76-451f-880b-8d714f34d880(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:39:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-80185b0f-0dd8-466c-8ea4-4492e9c7150e tempest-SnapshotsActionsTest-1083237043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.42f8d741-bcdb-4283-85ed-def85aac20e3 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-80bd0428-f705-4c36-9a65-f4d4165e2638 tempest-VolumesDeleteCascade-1232137414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.e995fee1-0a05-48d4-8ee9-47c2f4a47936" returned: 0 in 0.306s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:20 devstack sudo[96266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.42f8d741-bcdb-4283-85ed-def85aac20e3 Aug 28 09:39:20 devstack sudo[96266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-80bd0428-f705-4c36-9a65-f4d4165e2638 tempest-VolumesDeleteCascade-1232137414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:20 devstack sudo[96268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.info Aug 28 09:39:20 devstack sudo[96268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:21 devstack sudo[96268]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-80bd0428-f705-4c36-9a65-f4d4165e2638 tempest-VolumesDeleteCascade-1232137414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.info" returned: 0 in 0.287s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:21 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-80bd0428-f705-4c36-9a65-f4d4165e2638 tempest-VolumesDeleteCascade-1232137414 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.info is being set with open permissions: ugo+rw Aug 28 09:39:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-80bd0428-f705-4c36-9a65-f4d4165e2638 tempest-VolumesDeleteCascade-1232137414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:21 devstack sudo[96275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.info Aug 28 09:39:21 devstack sudo[96275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:21 devstack sudo[96266]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-80185b0f-0dd8-466c-8ea4-4492e9c7150e tempest-SnapshotsActionsTest-1083237043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.42f8d741-bcdb-4283-85ed-def85aac20e3" returned: 0 in 0.431s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-80185b0f-0dd8-466c-8ea4-4492e9c7150e tempest-SnapshotsActionsTest-1083237043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.42f8d741-bcdb-4283-85ed-def85aac20e3 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:21 devstack sudo[96277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.42f8d741-bcdb-4283-85ed-def85aac20e3 Aug 28 09:39:21 devstack sudo[96277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:21 devstack sudo[96275]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-80bd0428-f705-4c36-9a65-f4d4165e2638 tempest-VolumesDeleteCascade-1232137414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.info" returned: 0 in 0.272s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-80bd0428-f705-4c36-9a65-f4d4165e2638 tempest-VolumesDeleteCascade-1232137414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.389s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:39:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-32e16bd3-5e91-4cbd-a6c1-795cb9e039a7 tempest-GroupsTest-219853784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.850s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:39:21 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-32e16bd3-5e91-4cbd-a6c1-795cb9e039a7 tempest-GroupsTest-219853784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4e057e44-7ea5-4c0f-bb3f-7e8f0ebce997,created_at=2026-08-28T07:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1321965269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4e057e44-7ea5-4c0f-bb3f-7e8f0ebce997,host='devstack@QuobyteHD#QuobyteHD',id=ddbbb53a-2139-4a7d-b014-142912639ea4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc679b3716dd41799d7c22fc9185d830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:39:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:39:19Z,use_quota=True,user_id='ad9b0cd6ed654fe2a7c79dbc53ae8c8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f40a4ad8-b0b6-4ead-81d0-519afac86c44),volume_type_id=f40a4ad8-b0b6-4ead-81d0-519afac86c44)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:39:21 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-32e16bd3-5e91-4cbd-a6c1-795cb9e039a7 tempest-GroupsTest-219853784 None] Creating volume ddbbb53a-2139-4a7d-b014-142912639ea4 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:39:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-32e16bd3-5e91-4cbd-a6c1-795cb9e039a7 tempest-GroupsTest-219853784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:39:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-32e16bd3-5e91-4cbd-a6c1-795cb9e039a7 tempest-GroupsTest-219853784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:39:21 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-32e16bd3-5e91-4cbd-a6c1-795cb9e039a7 tempest-GroupsTest-219853784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:39:21 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-32e16bd3-5e91-4cbd-a6c1-795cb9e039a7 tempest-GroupsTest-219853784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:39:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-32e16bd3-5e91-4cbd-a6c1-795cb9e039a7 tempest-GroupsTest-219853784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:39:21 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-32e16bd3-5e91-4cbd-a6c1-795cb9e039a7 tempest-GroupsTest-219853784 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:39:21 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-32e16bd3-5e91-4cbd-a6c1-795cb9e039a7 tempest-GroupsTest-219853784 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:39:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-32e16bd3-5e91-4cbd-a6c1-795cb9e039a7 tempest-GroupsTest-219853784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ddbbb53a-2139-4a7d-b014-142912639ea4 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:21 devstack sudo[96281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ddbbb53a-2139-4a7d-b014-142912639ea4 1073741824 Aug 28 09:39:21 devstack sudo[96281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:21 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-80bd0428-f705-4c36-9a65-f4d4165e2638 tempest-VolumesDeleteCascade-1232137414 None] Create snapshot completed successfully Aug 28 09:39:21 devstack sudo[96277]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-80185b0f-0dd8-466c-8ea4-4492e9c7150e tempest-SnapshotsActionsTest-1083237043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.42f8d741-bcdb-4283-85ed-def85aac20e3" returned: 0 in 0.286s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:21 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-80185b0f-0dd8-466c-8ea4-4492e9c7150e tempest-SnapshotsActionsTest-1083237043 None] Lock "cinder-quobyte-42f8d741-bcdb-4283-85ed-def85aac20e3" released by "_delete_snapshot" :: held 1.771s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:39:21 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-80185b0f-0dd8-466c-8ea4-4492e9c7150e tempest-SnapshotsActionsTest-1083237043 None] Lock "cinder-quobyte-2694b58b-5a76-451f-880b-8d714f34d880" released by "delete_snapshot" :: held 1.802s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:39:21 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-80185b0f-0dd8-466c-8ea4-4492e9c7150e tempest-SnapshotsActionsTest-1083237043 None] Created reservations ['3a5e55bc-a0ed-4b39-8e2a-a1b4b8422376', '88f8ebb3-9106-44ae-861b-1a43cafbfaea', 'fea9081c-8088-467c-96d1-0f064fff0b6d', 'fe1e2c97-2588-440c-8cdf-82aae296975c'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:39:21 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-80185b0f-0dd8-466c-8ea4-4492e9c7150e tempest-SnapshotsActionsTest-1083237043 None] Delete snapshot completed successfully. Aug 28 09:39:21 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-80185b0f-0dd8-466c-8ea4-4492e9c7150e tempest-SnapshotsActionsTest-1083237043 None] Lock "cinder-42f8d741-bcdb-4283-85ed-def85aac20e3-delete_snapshot" released by "delete_snapshot" :: held 1.961s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:39:22 devstack sudo[96281]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-32e16bd3-5e91-4cbd-a6c1-795cb9e039a7 tempest-GroupsTest-219853784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ddbbb53a-2139-4a7d-b014-142912639ea4 1073741824" returned: 0 in 0.570s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-32e16bd3-5e91-4cbd-a6c1-795cb9e039a7 tempest-GroupsTest-219853784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ddbbb53a-2139-4a7d-b014-142912639ea4 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:22 devstack sudo[96287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ddbbb53a-2139-4a7d-b014-142912639ea4 Aug 28 09:39:22 devstack sudo[96287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-3d1b0233-2d26-4268-8f2b-b13dd4337c67 tempest-VolumesDeleteCascade-1232137414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:39:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-729f153a-24db-4d54-99a5-e8891347845d tempest-SnapshotsActionsTest-765698309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:39:22 devstack sudo[96287]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-32e16bd3-5e91-4cbd-a6c1-795cb9e039a7 tempest-GroupsTest-219853784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ddbbb53a-2139-4a7d-b014-142912639ea4" returned: 0 in 0.399s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:22 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-32e16bd3-5e91-4cbd-a6c1-795cb9e039a7 tempest-GroupsTest-219853784 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:39:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-32e16bd3-5e91-4cbd-a6c1-795cb9e039a7 tempest-GroupsTest-219853784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:39:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-3d1b0233-2d26-4268-8f2b-b13dd4337c67 tempest-VolumesDeleteCascade-1232137414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.155s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:39:22 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-3d1b0233-2d26-4268-8f2b-b13dd4337c67 tempest-VolumesDeleteCascade-1232137414 None] Creating offline snapshot d0a1ff44-4c32-4b65-94c0-3069f31ca7f0 of volume 129d97a2-9ddc-48a5-ad6c-241fef25f9f0 {{(pid=86081) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:39:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-32e16bd3-5e91-4cbd-a6c1-795cb9e039a7 tempest-GroupsTest-219853784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50557f7e-b52f-4c80-898e-673199cf69fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddbbb53a-2139-4a7d-b014-142912639ea4', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-32e16bd3-5e91-4cbd-a6c1-795cb9e039a7 tempest-GroupsTest-219853784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a0e71fa-142c-432b-bddd-fac72372b986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:22 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[634b5cff-f461-49ef-b41d-9ea8ed49346b]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:39:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3d1b0233-2d26-4268-8f2b-b13dd4337c67 tempest-VolumesDeleteCascade-1232137414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.e995fee1-0a05-48d4-8ee9-47c2f4a47936 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:22 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-32e16bd3-5e91-4cbd-a6c1-795cb9e039a7 tempest-GroupsTest-219853784 None] Volume volume-ddbbb53a-2139-4a7d-b014-142912639ea4 (ddbbb53a-2139-4a7d-b014-142912639ea4): created successfully Aug 28 09:39:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-32e16bd3-5e91-4cbd-a6c1-795cb9e039a7 tempest-GroupsTest-219853784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a0e71fa-142c-432b-bddd-fac72372b986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-32e16bd3-5e91-4cbd-a6c1-795cb9e039a7 tempest-GroupsTest-219853784 None] Flow 'volume_create_manager' (397e2aa1-06b8-4178-839e-e603fe272061) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:39:22 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-32e16bd3-5e91-4cbd-a6c1-795cb9e039a7 tempest-GroupsTest-219853784 None] Created volume successfully. Aug 28 09:39:22 devstack sudo[96290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.e995fee1-0a05-48d4-8ee9-47c2f4a47936 Aug 28 09:39:22 devstack sudo[96290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:23 devstack sudo[96290]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3d1b0233-2d26-4268-8f2b-b13dd4337c67 tempest-VolumesDeleteCascade-1232137414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.e995fee1-0a05-48d4-8ee9-47c2f4a47936" returned: 0 in 0.402s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:23 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-3d1b0233-2d26-4268-8f2b-b13dd4337c67 tempest-VolumesDeleteCascade-1232137414 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:39:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3d1b0233-2d26-4268-8f2b-b13dd4337c67 tempest-VolumesDeleteCascade-1232137414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.e995fee1-0a05-48d4-8ee9-47c2f4a47936,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.d0a1ff44-4c32-4b65-94c0-3069f31ca7f0 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:23 devstack sudo[96295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.e995fee1-0a05-48d4-8ee9-47c2f4a47936,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.d0a1ff44-4c32-4b65-94c0-3069f31ca7f0 1G Aug 28 09:39:23 devstack sudo[96295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:23 devstack sudo[96295]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3d1b0233-2d26-4268-8f2b-b13dd4337c67 tempest-VolumesDeleteCascade-1232137414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.e995fee1-0a05-48d4-8ee9-47c2f4a47936,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.d0a1ff44-4c32-4b65-94c0-3069f31ca7f0 1G" returned: 0 in 0.507s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3d1b0233-2d26-4268-8f2b-b13dd4337c67 tempest-VolumesDeleteCascade-1232137414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.e995fee1-0a05-48d4-8ee9-47c2f4a47936 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.d0a1ff44-4c32-4b65-94c0-3069f31ca7f0 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:23 devstack sudo[96304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.e995fee1-0a05-48d4-8ee9-47c2f4a47936 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.d0a1ff44-4c32-4b65-94c0-3069f31ca7f0 Aug 28 09:39:23 devstack sudo[96304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:23 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writing DB stats cinder:DELETE=13,cinder:SELECT=145,cinder:INSERT=39,cinder:UPDATE=169 {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:39:23 devstack sudo[96304]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:23 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-c47b729e-d237-45f9-80db-318a4e2f49bd tempest-GroupsTest-219853784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:39:23 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-c47b729e-d237-45f9-80db-318a4e2f49bd tempest-GroupsTest-219853784 None] Flow 'volume_create_manager' (c9e57727-041a-4a3f-bef4-df79cb9b88dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:39:23 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-c47b729e-d237-45f9-80db-318a4e2f49bd tempest-GroupsTest-219853784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eebf13b2-bf84-4489-b8ec-b35854a4793d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3d1b0233-2d26-4268-8f2b-b13dd4337c67 tempest-VolumesDeleteCascade-1232137414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.e995fee1-0a05-48d4-8ee9-47c2f4a47936 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.d0a1ff44-4c32-4b65-94c0-3069f31ca7f0" returned: 0 in 0.424s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:23 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-3d1b0233-2d26-4268-8f2b-b13dd4337c67 tempest-VolumesDeleteCascade-1232137414 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.d0a1ff44-4c32-4b65-94c0-3069f31ca7f0 is being set with open permissions: ugo+rw Aug 28 09:39:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3d1b0233-2d26-4268-8f2b-b13dd4337c67 tempest-VolumesDeleteCascade-1232137414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.d0a1ff44-4c32-4b65-94c0-3069f31ca7f0 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:23 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-c47b729e-d237-45f9-80db-318a4e2f49bd tempest-GroupsTest-219853784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eebf13b2-bf84-4489-b8ec-b35854a4793d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2050349080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4e057e44-7ea5-4c0f-bb3f-7e8f0ebce997,host='devstack@QuobyteHD#QuobyteHD',id=f126ca01-a73f-4fba-984e-10b2a6542796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc679b3716dd41799d7c22fc9185d830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:39:24Z,use_quota=True,user_id='ad9b0cd6ed654fe2a7c79dbc53ae8c8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f40a4ad8-b0b6-4ead-81d0-519afac86c44),volume_type_id=f40a4ad8-b0b6-4ead-81d0-519afac86c44)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:23 devstack sudo[96310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.d0a1ff44-4c32-4b65-94c0-3069f31ca7f0 Aug 28 09:39:23 devstack sudo[96310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:23 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-c47b729e-d237-45f9-80db-318a4e2f49bd tempest-GroupsTest-219853784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7dfd7c9-fe6a-4e93-8af3-55225152706a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:24 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-c47b729e-d237-45f9-80db-318a4e2f49bd tempest-GroupsTest-219853784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7dfd7c9-fe6a-4e93-8af3-55225152706a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:24 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-c47b729e-d237-45f9-80db-318a4e2f49bd tempest-GroupsTest-219853784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69fcbf34-b077-43f7-bbd9-db7d42cdcbc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:24 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-c47b729e-d237-45f9-80db-318a4e2f49bd tempest-GroupsTest-219853784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69fcbf34-b077-43f7-bbd9-db7d42cdcbc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f126ca01-a73f-4fba-984e-10b2a6542796', 'volume_name': 'volume-f126ca01-a73f-4fba-984e-10b2a6542796', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:24 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-c47b729e-d237-45f9-80db-318a4e2f49bd tempest-GroupsTest-219853784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff199b4c-dc4a-49df-afa3-4f0f10e66d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:24 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-c47b729e-d237-45f9-80db-318a4e2f49bd tempest-GroupsTest-219853784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff199b4c-dc4a-49df-afa3-4f0f10e66d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:24 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-c47b729e-d237-45f9-80db-318a4e2f49bd tempest-GroupsTest-219853784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d05d43e3-b483-4441-8314-d0ccbfde2555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:24 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-c47b729e-d237-45f9-80db-318a4e2f49bd tempest-GroupsTest-219853784 None] Volume f126ca01-a73f-4fba-984e-10b2a6542796: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f126ca01-a73f-4fba-984e-10b2a6542796', 'volume_size': 1} Aug 28 09:39:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-c47b729e-d237-45f9-80db-318a4e2f49bd tempest-GroupsTest-219853784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:39:24 devstack sudo[96310]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3d1b0233-2d26-4268-8f2b-b13dd4337c67 tempest-VolumesDeleteCascade-1232137414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.d0a1ff44-4c32-4b65-94c0-3069f31ca7f0" returned: 0 in 0.243s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-3d1b0233-2d26-4268-8f2b-b13dd4337c67 tempest-VolumesDeleteCascade-1232137414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.688s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:39:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-729f153a-24db-4d54-99a5-e8891347845d tempest-SnapshotsActionsTest-765698309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.742s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:39:24 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-729f153a-24db-4d54-99a5-e8891347845d tempest-SnapshotsActionsTest-765698309 None] Creating offline snapshot a64beeed-9819-47be-b3c2-d1269bea747e of volume 2694b58b-5a76-451f-880b-8d714f34d880 {{(pid=86081) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:39:24 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-3d1b0233-2d26-4268-8f2b-b13dd4337c67 tempest-VolumesDeleteCascade-1232137414 None] Create snapshot completed successfully Aug 28 09:39:24 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[15dfc69e-7d7b-41be-913a-c43478d1099f]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:39:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-729f153a-24db-4d54-99a5-e8891347845d tempest-SnapshotsActionsTest-765698309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:24 devstack sudo[96313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8 Aug 28 09:39:24 devstack sudo[96313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:24 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] Acquiring lock "cinder-129d97a2-9ddc-48a5-ad6c-241fef25f9f0-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:39:24 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] Lock "cinder-129d97a2-9ddc-48a5-ad6c-241fef25f9f0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:39:24 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writing DB stats cinder:UPDATE=162,cinder:SELECT=173,cinder:INSERT=37,cinder:DELETE=11 {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:39:24 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] Performing cascade delete. {{(pid=86081) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 28 09:39:24 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] Acquiring lock "cinder-d0a1ff44-4c32-4b65-94c0-3069f31ca7f0-delete_snapshot" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:39:24 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] Lock "cinder-d0a1ff44-4c32-4b65-94c0-3069f31ca7f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:39:24 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] Acquiring lock "cinder-quobyte-129d97a2-9ddc-48a5-ad6c-241fef25f9f0" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:39:24 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] Lock "cinder-quobyte-129d97a2-9ddc-48a5-ad6c-241fef25f9f0" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:39:24 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] Acquiring lock "cinder-quobyte-d0a1ff44-4c32-4b65-94c0-3069f31ca7f0" by "_delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:39:24 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] Lock "cinder-quobyte-d0a1ff44-4c32-4b65-94c0-3069f31ca7f0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:39:24 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] Deleting offline snapshot d0a1ff44-4c32-4b65-94c0-3069f31ca7f0 of volume 129d97a2-9ddc-48a5-ad6c-241fef25f9f0 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:39:24 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] snapshot_file for this snap is: volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.d0a1ff44-4c32-4b65-94c0-3069f31ca7f0 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:39:24 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[804495fb-eb0c-4432-8b65-3ab1a570c9c6]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:39:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.d0a1ff44-4c32-4b65-94c0-3069f31ca7f0 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:24 devstack sudo[96313]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-729f153a-24db-4d54-99a5-e8891347845d tempest-SnapshotsActionsTest-765698309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8" returned: 0 in 0.462s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:24 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-729f153a-24db-4d54-99a5-e8891347845d tempest-SnapshotsActionsTest-765698309 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2694b58b-5a76-451f-880b-8d714f34d880(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:39:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-729f153a-24db-4d54-99a5-e8891347845d tempest-SnapshotsActionsTest-765698309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.a64beeed-9819-47be-b3c2-d1269bea747e 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:24 devstack sudo[96319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.a64beeed-9819-47be-b3c2-d1269bea747e 1G Aug 28 09:39:24 devstack sudo[96319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:24 devstack sudo[96318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.d0a1ff44-4c32-4b65-94c0-3069f31ca7f0 Aug 28 09:39:24 devstack sudo[96318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:25 devstack sudo[96318]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.d0a1ff44-4c32-4b65-94c0-3069f31ca7f0" returned: 0 in 0.401s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:25 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:39:25 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01095c6-0c06-47ee-aabd-a40b66b202e1]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:39:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.e995fee1-0a05-48d4-8ee9-47c2f4a47936 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:25 devstack sudo[96319]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-729f153a-24db-4d54-99a5-e8891347845d tempest-SnapshotsActionsTest-765698309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.a64beeed-9819-47be-b3c2-d1269bea747e 1G" returned: 0 in 0.552s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:25 devstack sudo[96333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.e995fee1-0a05-48d4-8ee9-47c2f4a47936 Aug 28 09:39:25 devstack sudo[96333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-729f153a-24db-4d54-99a5-e8891347845d tempest-SnapshotsActionsTest-765698309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.a64beeed-9819-47be-b3c2-d1269bea747e {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:25 devstack sudo[96335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.a64beeed-9819-47be-b3c2-d1269bea747e Aug 28 09:39:25 devstack sudo[96335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:25 devstack sudo[96335]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-729f153a-24db-4d54-99a5-e8891347845d tempest-SnapshotsActionsTest-765698309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.a64beeed-9819-47be-b3c2-d1269bea747e" returned: 0 in 0.338s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:25 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-729f153a-24db-4d54-99a5-e8891347845d tempest-SnapshotsActionsTest-765698309 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.a64beeed-9819-47be-b3c2-d1269bea747e is being set with open permissions: ugo+rw Aug 28 09:39:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-729f153a-24db-4d54-99a5-e8891347845d tempest-SnapshotsActionsTest-765698309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.a64beeed-9819-47be-b3c2-d1269bea747e {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:25 devstack sudo[96333]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.e995fee1-0a05-48d4-8ee9-47c2f4a47936" returned: 0 in 0.502s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:25 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:39:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.d0a1ff44-4c32-4b65-94c0-3069f31ca7f0 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:25 devstack sudo[96344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.a64beeed-9819-47be-b3c2-d1269bea747e Aug 28 09:39:25 devstack sudo[96344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:25 devstack sudo[96345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.d0a1ff44-4c32-4b65-94c0-3069f31ca7f0 Aug 28 09:39:25 devstack sudo[96345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:25 devstack sudo[96344]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-729f153a-24db-4d54-99a5-e8891347845d tempest-SnapshotsActionsTest-765698309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.a64beeed-9819-47be-b3c2-d1269bea747e" returned: 0 in 0.268s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-729f153a-24db-4d54-99a5-e8891347845d tempest-SnapshotsActionsTest-765698309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.754s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:39:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-c47b729e-d237-45f9-80db-318a4e2f49bd tempest-GroupsTest-219853784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.980s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:39:26 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-c47b729e-d237-45f9-80db-318a4e2f49bd tempest-GroupsTest-219853784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4e057e44-7ea5-4c0f-bb3f-7e8f0ebce997,created_at=2026-08-28T07:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2050349080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4e057e44-7ea5-4c0f-bb3f-7e8f0ebce997,host='devstack@QuobyteHD#QuobyteHD',id=f126ca01-a73f-4fba-984e-10b2a6542796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc679b3716dd41799d7c22fc9185d830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:39:24Z,use_quota=True,user_id='ad9b0cd6ed654fe2a7c79dbc53ae8c8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f40a4ad8-b0b6-4ead-81d0-519afac86c44),volume_type_id=f40a4ad8-b0b6-4ead-81d0-519afac86c44)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:39:26 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-c47b729e-d237-45f9-80db-318a4e2f49bd tempest-GroupsTest-219853784 None] Creating volume f126ca01-a73f-4fba-984e-10b2a6542796 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:39:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-c47b729e-d237-45f9-80db-318a4e2f49bd tempest-GroupsTest-219853784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:39:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-c47b729e-d237-45f9-80db-318a4e2f49bd tempest-GroupsTest-219853784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:39:26 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-c47b729e-d237-45f9-80db-318a4e2f49bd tempest-GroupsTest-219853784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:39:26 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-c47b729e-d237-45f9-80db-318a4e2f49bd tempest-GroupsTest-219853784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:39:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-c47b729e-d237-45f9-80db-318a4e2f49bd tempest-GroupsTest-219853784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:39:26 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-c47b729e-d237-45f9-80db-318a4e2f49bd tempest-GroupsTest-219853784 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:39:26 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-c47b729e-d237-45f9-80db-318a4e2f49bd tempest-GroupsTest-219853784 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:39:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c47b729e-d237-45f9-80db-318a4e2f49bd tempest-GroupsTest-219853784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f126ca01-a73f-4fba-984e-10b2a6542796 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:26 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-729f153a-24db-4d54-99a5-e8891347845d tempest-SnapshotsActionsTest-765698309 None] Create snapshot completed successfully Aug 28 09:39:26 devstack sudo[96351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f126ca01-a73f-4fba-984e-10b2a6542796 1073741824 Aug 28 09:39:26 devstack sudo[96351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:26 devstack sudo[96345]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.d0a1ff44-4c32-4b65-94c0-3069f31ca7f0" returned: 0 in 0.528s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.d0a1ff44-4c32-4b65-94c0-3069f31ca7f0 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:26 devstack sudo[96355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.d0a1ff44-4c32-4b65-94c0-3069f31ca7f0 Aug 28 09:39:26 devstack sudo[96355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:26 devstack sudo[96355]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.d0a1ff44-4c32-4b65-94c0-3069f31ca7f0" returned: 0 in 0.403s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:26 devstack sudo[96351]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c47b729e-d237-45f9-80db-318a4e2f49bd tempest-GroupsTest-219853784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f126ca01-a73f-4fba-984e-10b2a6542796 1073741824" returned: 0 in 0.668s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:26 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] Lock "cinder-quobyte-d0a1ff44-4c32-4b65-94c0-3069f31ca7f0" released by "_delete_snapshot" :: held 1.952s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:39:26 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] Lock "cinder-quobyte-129d97a2-9ddc-48a5-ad6c-241fef25f9f0" released by "delete_snapshot" :: held 1.981s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:39:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c47b729e-d237-45f9-80db-318a4e2f49bd tempest-GroupsTest-219853784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f126ca01-a73f-4fba-984e-10b2a6542796 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:26 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] Created reservations ['9a943391-ae33-4f58-9832-e19273f8f273', 'c1e23419-f63e-4d17-893e-b1bede0a4f53', 'd0170d76-81f0-4def-9d2e-5db562950a45', '7ba9b853-24cc-4567-b5ae-5dd8ed679c5e'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:39:26 devstack sudo[96362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f126ca01-a73f-4fba-984e-10b2a6542796 Aug 28 09:39:26 devstack sudo[96362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:26 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] Delete snapshot completed successfully. Aug 28 09:39:26 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] Lock "cinder-d0a1ff44-4c32-4b65-94c0-3069f31ca7f0-delete_snapshot" released by "delete_snapshot" :: held 2.218s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:39:26 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] Acquiring lock "cinder-e995fee1-0a05-48d4-8ee9-47c2f4a47936-delete_snapshot" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:39:26 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c4c5ed9d-246d-4d84-888e-b4d10edaad8e tempest-SnapshotsActionsTest-1083237043 None] Acquiring lock "cinder-a64beeed-9819-47be-b3c2-d1269bea747e-delete_snapshot" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:39:26 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] Lock "cinder-e995fee1-0a05-48d4-8ee9-47c2f4a47936-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:39:26 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c4c5ed9d-246d-4d84-888e-b4d10edaad8e tempest-SnapshotsActionsTest-1083237043 None] Lock "cinder-a64beeed-9819-47be-b3c2-d1269bea747e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:39:26 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c4c5ed9d-246d-4d84-888e-b4d10edaad8e tempest-SnapshotsActionsTest-1083237043 None] Acquiring lock "cinder-quobyte-2694b58b-5a76-451f-880b-8d714f34d880" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:39:26 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] Acquiring lock "cinder-quobyte-129d97a2-9ddc-48a5-ad6c-241fef25f9f0" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:39:27 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c4c5ed9d-246d-4d84-888e-b4d10edaad8e tempest-SnapshotsActionsTest-1083237043 None] Lock "cinder-quobyte-2694b58b-5a76-451f-880b-8d714f34d880" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:39:27 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c4c5ed9d-246d-4d84-888e-b4d10edaad8e tempest-SnapshotsActionsTest-1083237043 None] Acquiring lock "cinder-quobyte-a64beeed-9819-47be-b3c2-d1269bea747e" by "_delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:39:27 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] Lock "cinder-quobyte-129d97a2-9ddc-48a5-ad6c-241fef25f9f0" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:39:27 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] Acquiring lock "cinder-quobyte-e995fee1-0a05-48d4-8ee9-47c2f4a47936" by "_delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:39:27 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] Lock "cinder-quobyte-e995fee1-0a05-48d4-8ee9-47c2f4a47936" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:39:27 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] Deleting offline snapshot e995fee1-0a05-48d4-8ee9-47c2f4a47936 of volume 129d97a2-9ddc-48a5-ad6c-241fef25f9f0 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:39:27 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] snapshot_file for this snap is: volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.e995fee1-0a05-48d4-8ee9-47c2f4a47936 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:39:27 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c4c5ed9d-246d-4d84-888e-b4d10edaad8e tempest-SnapshotsActionsTest-1083237043 None] Lock "cinder-quobyte-a64beeed-9819-47be-b3c2-d1269bea747e" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:39:27 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-c4c5ed9d-246d-4d84-888e-b4d10edaad8e tempest-SnapshotsActionsTest-1083237043 None] Deleting offline snapshot a64beeed-9819-47be-b3c2-d1269bea747e of volume 2694b58b-5a76-451f-880b-8d714f34d880 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:39:27 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-c4c5ed9d-246d-4d84-888e-b4d10edaad8e tempest-SnapshotsActionsTest-1083237043 None] snapshot_file for this snap is: volume-2694b58b-5a76-451f-880b-8d714f34d880.a64beeed-9819-47be-b3c2-d1269bea747e {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:39:27 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32ed160-0663-428a-a300-468bfe917b26]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:39:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.e995fee1-0a05-48d4-8ee9-47c2f4a47936 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:27 devstack sudo[96362]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c47b729e-d237-45f9-80db-318a4e2f49bd tempest-GroupsTest-219853784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f126ca01-a73f-4fba-984e-10b2a6542796" returned: 0 in 0.304s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:27 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-c47b729e-d237-45f9-80db-318a4e2f49bd tempest-GroupsTest-219853784 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:39:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-c47b729e-d237-45f9-80db-318a4e2f49bd tempest-GroupsTest-219853784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:39:27 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24b1b10-692a-44b0-94f2-8dd3bb466f32]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:39:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c4c5ed9d-246d-4d84-888e-b4d10edaad8e tempest-SnapshotsActionsTest-1083237043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.a64beeed-9819-47be-b3c2-d1269bea747e {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-c47b729e-d237-45f9-80db-318a4e2f49bd tempest-GroupsTest-219853784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d05d43e3-b483-4441-8314-d0ccbfde2555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f126ca01-a73f-4fba-984e-10b2a6542796', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-c47b729e-d237-45f9-80db-318a4e2f49bd tempest-GroupsTest-219853784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6c74de1-cd37-43f6-aea0-c88d6f2b3929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:27 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-c47b729e-d237-45f9-80db-318a4e2f49bd tempest-GroupsTest-219853784 None] Volume volume-f126ca01-a73f-4fba-984e-10b2a6542796 (f126ca01-a73f-4fba-984e-10b2a6542796): created successfully Aug 28 09:39:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-c47b729e-d237-45f9-80db-318a4e2f49bd tempest-GroupsTest-219853784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6c74de1-cd37-43f6-aea0-c88d6f2b3929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-c47b729e-d237-45f9-80db-318a4e2f49bd tempest-GroupsTest-219853784 None] Flow 'volume_create_manager' (c9e57727-041a-4a3f-bef4-df79cb9b88dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:39:27 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-c47b729e-d237-45f9-80db-318a4e2f49bd tempest-GroupsTest-219853784 None] Created volume successfully. Aug 28 09:39:27 devstack sudo[96365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.e995fee1-0a05-48d4-8ee9-47c2f4a47936 Aug 28 09:39:27 devstack sudo[96365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:27 devstack sudo[96366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.a64beeed-9819-47be-b3c2-d1269bea747e Aug 28 09:39:27 devstack sudo[96366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:27 devstack sudo[96365]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.e995fee1-0a05-48d4-8ee9-47c2f4a47936" returned: 0 in 0.433s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:27 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:39:27 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e8b5cc-e65c-482f-830b-86a0b43dae0b]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:39:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:27 devstack sudo[96366]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c4c5ed9d-246d-4d84-888e-b4d10edaad8e tempest-SnapshotsActionsTest-1083237043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.a64beeed-9819-47be-b3c2-d1269bea747e" returned: 0 in 0.460s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:27 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-c4c5ed9d-246d-4d84-888e-b4d10edaad8e tempest-SnapshotsActionsTest-1083237043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2694b58b-5a76-451f-880b-8d714f34d880(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:39:27 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d1c784-2cb1-4a84-b123-4fdb28d40ff1]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:39:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c4c5ed9d-246d-4d84-888e-b4d10edaad8e tempest-SnapshotsActionsTest-1083237043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:27 devstack sudo[96376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8 Aug 28 09:39:27 devstack sudo[96376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:27 devstack sudo[96375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0 Aug 28 09:39:27 devstack sudo[96375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:27 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-5f6668b9-9500-4e22-ab97-84f420d548f3 tempest-GroupsTest-219853784 None] Update group completed successfully. Aug 28 09:39:28 devstack sudo[96376]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c4c5ed9d-246d-4d84-888e-b4d10edaad8e tempest-SnapshotsActionsTest-1083237043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8" returned: 0 in 0.514s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:28 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-c4c5ed9d-246d-4d84-888e-b4d10edaad8e tempest-SnapshotsActionsTest-1083237043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2694b58b-5a76-451f-880b-8d714f34d880(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:39:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c4c5ed9d-246d-4d84-888e-b4d10edaad8e tempest-SnapshotsActionsTest-1083237043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.a64beeed-9819-47be-b3c2-d1269bea747e {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:28 devstack sudo[96386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.a64beeed-9819-47be-b3c2-d1269bea747e Aug 28 09:39:28 devstack sudo[96386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:28 devstack sudo[96375]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0" returned: 0 in 0.664s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.e995fee1-0a05-48d4-8ee9-47c2f4a47936 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:28 devstack sudo[96390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.e995fee1-0a05-48d4-8ee9-47c2f4a47936 Aug 28 09:39:28 devstack sudo[96390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:28 devstack sudo[96386]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c4c5ed9d-246d-4d84-888e-b4d10edaad8e tempest-SnapshotsActionsTest-1083237043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.a64beeed-9819-47be-b3c2-d1269bea747e" returned: 0 in 0.429s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c4c5ed9d-246d-4d84-888e-b4d10edaad8e tempest-SnapshotsActionsTest-1083237043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.a64beeed-9819-47be-b3c2-d1269bea747e {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:28 devstack sudo[96399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.a64beeed-9819-47be-b3c2-d1269bea747e Aug 28 09:39:28 devstack sudo[96399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:28 devstack sudo[96390]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.e995fee1-0a05-48d4-8ee9-47c2f4a47936" returned: 0 in 0.408s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.e995fee1-0a05-48d4-8ee9-47c2f4a47936 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:28 devstack sudo[96401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.e995fee1-0a05-48d4-8ee9-47c2f4a47936 Aug 28 09:39:28 devstack sudo[96401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:28 devstack sudo[96399]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c4c5ed9d-246d-4d84-888e-b4d10edaad8e tempest-SnapshotsActionsTest-1083237043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.a64beeed-9819-47be-b3c2-d1269bea747e" returned: 0 in 0.284s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:28 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c4c5ed9d-246d-4d84-888e-b4d10edaad8e tempest-SnapshotsActionsTest-1083237043 None] Lock "cinder-quobyte-a64beeed-9819-47be-b3c2-d1269bea747e" released by "_delete_snapshot" :: held 1.853s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:39:28 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c4c5ed9d-246d-4d84-888e-b4d10edaad8e tempest-SnapshotsActionsTest-1083237043 None] Lock "cinder-quobyte-2694b58b-5a76-451f-880b-8d714f34d880" released by "delete_snapshot" :: held 1.908s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:39:28 devstack sudo[96401]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0.e995fee1-0a05-48d4-8ee9-47c2f4a47936" returned: 0 in 0.320s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:28 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] Lock "cinder-quobyte-e995fee1-0a05-48d4-8ee9-47c2f4a47936" released by "_delete_snapshot" :: held 1.949s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:39:28 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] Lock "cinder-quobyte-129d97a2-9ddc-48a5-ad6c-241fef25f9f0" released by "delete_snapshot" :: held 1.975s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:39:29 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-c4c5ed9d-246d-4d84-888e-b4d10edaad8e tempest-SnapshotsActionsTest-1083237043 None] Created reservations ['581f7a5a-2fe0-41e1-b976-1dbd8aeea2ad', '5c7d4814-c761-46b2-971e-e57bf0cd3d0e', '85f55240-0035-437f-95fb-7336f37a387c', '56c31c8e-46e4-4ebb-b29c-baf0d218f612'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:39:29 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] Created reservations ['863d44b8-d4f4-4fd0-99da-29d3120f21d7', '61fd75d8-6831-4ca4-b83c-284742ce62b4', '54e9cbff-2d27-45bc-8517-4eb177c03036', '26c18c6d-c8e2-4103-9f52-fd052ea83177'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:39:29 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-c4c5ed9d-246d-4d84-888e-b4d10edaad8e tempest-SnapshotsActionsTest-1083237043 None] Delete snapshot completed successfully. Aug 28 09:39:29 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c4c5ed9d-246d-4d84-888e-b4d10edaad8e tempest-SnapshotsActionsTest-1083237043 None] Lock "cinder-a64beeed-9819-47be-b3c2-d1269bea747e-delete_snapshot" released by "delete_snapshot" :: held 2.195s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:39:29 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] Delete snapshot completed successfully. Aug 28 09:39:29 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] Lock "cinder-e995fee1-0a05-48d4-8ee9-47c2f4a47936-delete_snapshot" released by "delete_snapshot" :: held 2.256s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:39:29 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] Snapshots deleted, issuing volume delete {{(pid=86081) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 28 09:39:29 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] Acquiring lock "cinder-quobyte-129d97a2-9ddc-48a5-ad6c-241fef25f9f0" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:39:29 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] Lock "cinder-quobyte-129d97a2-9ddc-48a5-ad6c-241fef25f9f0" acquired by "delete_volume" :: waited 0.021s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:39:29 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[88eff5a4-6c83-4a0f-bc11-379d7842801b]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:39:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:29 devstack sudo[96406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0 Aug 28 09:39:29 devstack sudo[96406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:29 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-1df8377e-5901-4660-8ca7-c7e573988caa tempest-GroupsTest-219853784 None] Update group completed successfully. Aug 28 09:39:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e811abdb-bd37-4887-8cc7-d167f90d70af tempest-SnapshotsActionsTest-765698309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:39:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e811abdb-bd37-4887-8cc7-d167f90d70af tempest-SnapshotsActionsTest-765698309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:39:29 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-e811abdb-bd37-4887-8cc7-d167f90d70af tempest-SnapshotsActionsTest-765698309 None] Creating offline snapshot 9ea14683-6597-4935-b698-e4d91f066954 of volume 2694b58b-5a76-451f-880b-8d714f34d880 {{(pid=86081) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:39:29 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16c8191-16e8-4ea5-ba75-5aef9f56a2fb]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:39:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e811abdb-bd37-4887-8cc7-d167f90d70af tempest-SnapshotsActionsTest-765698309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:29 devstack sudo[96406]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0" returned: 0 in 0.442s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:29 devstack sudo[96408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8 Aug 28 09:39:29 devstack sudo[96408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:29 devstack sudo[96413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0 Aug 28 09:39:29 devstack sudo[96413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:29 devstack sudo[96413]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:29 devstack sudo[96408]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-129d97a2-9ddc-48a5-ad6c-241fef25f9f0" returned: 0 in 0.264s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e811abdb-bd37-4887-8cc7-d167f90d70af tempest-SnapshotsActionsTest-765698309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8" returned: 0 in 0.393s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:30 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-e811abdb-bd37-4887-8cc7-d167f90d70af tempest-SnapshotsActionsTest-765698309 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2694b58b-5a76-451f-880b-8d714f34d880(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:39:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e811abdb-bd37-4887-8cc7-d167f90d70af tempest-SnapshotsActionsTest-765698309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.9ea14683-6597-4935-b698-e4d91f066954 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:30 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] Lock "cinder-quobyte-129d97a2-9ddc-48a5-ad6c-241fef25f9f0" released by "delete_volume" :: held 0.799s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:39:30 devstack sudo[96420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.9ea14683-6597-4935-b698-e4d91f066954 1G Aug 28 09:39:30 devstack sudo[96420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:30 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] Created reservations ['31f01f7c-861f-4325-8f44-8424ddef6079', '8e753ede-935d-4548-8a67-f0446592a793', '52e089ff-3c02-41b8-ba74-e971ec510c0f', 'dfd6186a-95d8-4019-99a7-53ae054f4285'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:39:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:39:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:39:30 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:39:30 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:39:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:39:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:30 devstack sudo[96422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:39:30 devstack sudo[96422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:30 devstack sudo[96422]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.305s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:30 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:39:30 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] Deleted volume successfully. Aug 28 09:39:30 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ecc13fe6-deca-466c-8d27-2e2c28062d42 tempest-VolumesDeleteCascade-1232137414 None] Lock "cinder-129d97a2-9ddc-48a5-ad6c-241fef25f9f0-delete_volume" released by "delete_volume" :: held 5.940s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:39:30 devstack sudo[96420]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e811abdb-bd37-4887-8cc7-d167f90d70af tempest-SnapshotsActionsTest-765698309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.9ea14683-6597-4935-b698-e4d91f066954 1G" returned: 0 in 0.560s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e811abdb-bd37-4887-8cc7-d167f90d70af tempest-SnapshotsActionsTest-765698309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.9ea14683-6597-4935-b698-e4d91f066954 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:30 devstack sudo[96429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.9ea14683-6597-4935-b698-e4d91f066954 Aug 28 09:39:30 devstack sudo[96429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:30 devstack sudo[96429]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e811abdb-bd37-4887-8cc7-d167f90d70af tempest-SnapshotsActionsTest-765698309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.9ea14683-6597-4935-b698-e4d91f066954" returned: 0 in 0.329s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:30 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-e811abdb-bd37-4887-8cc7-d167f90d70af tempest-SnapshotsActionsTest-765698309 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.9ea14683-6597-4935-b698-e4d91f066954 is being set with open permissions: ugo+rw Aug 28 09:39:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e811abdb-bd37-4887-8cc7-d167f90d70af tempest-SnapshotsActionsTest-765698309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.9ea14683-6597-4935-b698-e4d91f066954 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:30 devstack sudo[96434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.9ea14683-6597-4935-b698-e4d91f066954 Aug 28 09:39:30 devstack sudo[96434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:31 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-71bb5463-eb16-4ac8-8211-4c97069ce346 tempest-GroupsTest-219853784 None] Acquiring lock "cinder-quobyte-ddbbb53a-2139-4a7d-b014-142912639ea4" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:39:31 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-71bb5463-eb16-4ac8-8211-4c97069ce346 tempest-GroupsTest-219853784 None] Lock "cinder-quobyte-ddbbb53a-2139-4a7d-b014-142912639ea4" acquired by "delete_volume" :: waited 0.024s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:39:31 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[e644cebd-4793-4479-ae0f-7c1d91c29967]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:39:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-71bb5463-eb16-4ac8-8211-4c97069ce346 tempest-GroupsTest-219853784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ddbbb53a-2139-4a7d-b014-142912639ea4 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:31 devstack sudo[96434]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e811abdb-bd37-4887-8cc7-d167f90d70af tempest-SnapshotsActionsTest-765698309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.9ea14683-6597-4935-b698-e4d91f066954" returned: 0 in 0.304s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e811abdb-bd37-4887-8cc7-d167f90d70af tempest-SnapshotsActionsTest-765698309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.725s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:39:31 devstack sudo[96436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ddbbb53a-2139-4a7d-b014-142912639ea4 Aug 28 09:39:31 devstack sudo[96436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:31 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-e811abdb-bd37-4887-8cc7-d167f90d70af tempest-SnapshotsActionsTest-765698309 None] Create snapshot completed successfully Aug 28 09:39:31 devstack sudo[96436]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-71bb5463-eb16-4ac8-8211-4c97069ce346 tempest-GroupsTest-219853784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ddbbb53a-2139-4a7d-b014-142912639ea4" returned: 0 in 0.525s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-71bb5463-eb16-4ac8-8211-4c97069ce346 tempest-GroupsTest-219853784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ddbbb53a-2139-4a7d-b014-142912639ea4 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:31 devstack sudo[96442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ddbbb53a-2139-4a7d-b014-142912639ea4 Aug 28 09:39:31 devstack sudo[96442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:31 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c3335dad-685c-4917-9860-ffdb868c6e2e tempest-SnapshotsActionsTest-1083237043 None] Acquiring lock "cinder-9ea14683-6597-4935-b698-e4d91f066954-delete_snapshot" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:39:31 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c3335dad-685c-4917-9860-ffdb868c6e2e tempest-SnapshotsActionsTest-1083237043 None] Lock "cinder-9ea14683-6597-4935-b698-e4d91f066954-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:39:31 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c3335dad-685c-4917-9860-ffdb868c6e2e tempest-SnapshotsActionsTest-1083237043 None] Acquiring lock "cinder-quobyte-2694b58b-5a76-451f-880b-8d714f34d880" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:39:31 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c3335dad-685c-4917-9860-ffdb868c6e2e tempest-SnapshotsActionsTest-1083237043 None] Lock "cinder-quobyte-2694b58b-5a76-451f-880b-8d714f34d880" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:39:31 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c3335dad-685c-4917-9860-ffdb868c6e2e tempest-SnapshotsActionsTest-1083237043 None] Acquiring lock "cinder-quobyte-9ea14683-6597-4935-b698-e4d91f066954" by "_delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:39:31 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c3335dad-685c-4917-9860-ffdb868c6e2e tempest-SnapshotsActionsTest-1083237043 None] Lock "cinder-quobyte-9ea14683-6597-4935-b698-e4d91f066954" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:39:31 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-c3335dad-685c-4917-9860-ffdb868c6e2e tempest-SnapshotsActionsTest-1083237043 None] Deleting offline snapshot 9ea14683-6597-4935-b698-e4d91f066954 of volume 2694b58b-5a76-451f-880b-8d714f34d880 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:39:31 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-c3335dad-685c-4917-9860-ffdb868c6e2e tempest-SnapshotsActionsTest-1083237043 None] snapshot_file for this snap is: volume-2694b58b-5a76-451f-880b-8d714f34d880.9ea14683-6597-4935-b698-e4d91f066954 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:39:31 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4cea357-9b9f-45ec-ab6e-a3ecc647dd80]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:39:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c3335dad-685c-4917-9860-ffdb868c6e2e tempest-SnapshotsActionsTest-1083237043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.9ea14683-6597-4935-b698-e4d91f066954 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:31 devstack sudo[96442]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-71bb5463-eb16-4ac8-8211-4c97069ce346 tempest-GroupsTest-219853784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ddbbb53a-2139-4a7d-b014-142912639ea4" returned: 0 in 0.360s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:32 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-71bb5463-eb16-4ac8-8211-4c97069ce346 tempest-GroupsTest-219853784 None] Lock "cinder-quobyte-ddbbb53a-2139-4a7d-b014-142912639ea4" released by "delete_volume" :: held 0.945s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:39:32 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-71bb5463-eb16-4ac8-8211-4c97069ce346 tempest-GroupsTest-219853784 None] Acquiring lock "cinder-quobyte-f126ca01-a73f-4fba-984e-10b2a6542796" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:39:32 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-71bb5463-eb16-4ac8-8211-4c97069ce346 tempest-GroupsTest-219853784 None] Lock "cinder-quobyte-f126ca01-a73f-4fba-984e-10b2a6542796" acquired by "delete_volume" :: waited 0.016s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:39:32 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[04651cf3-cab3-43bf-85da-4a70c16c393d]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:39:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-71bb5463-eb16-4ac8-8211-4c97069ce346 tempest-GroupsTest-219853784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f126ca01-a73f-4fba-984e-10b2a6542796 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:32 devstack sudo[96445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.9ea14683-6597-4935-b698-e4d91f066954 Aug 28 09:39:32 devstack sudo[96445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:32 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-76df92ef-2f49-4ab4-afa9-f06bb868d5c6 tempest-VolumesDeleteCascade-1232137414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:39:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-76df92ef-2f49-4ab4-afa9-f06bb868d5c6 tempest-VolumesDeleteCascade-1232137414 None] Flow 'volume_create_manager' (d1e1ef52-52c9-4349-bfe7-c42e4a52ff81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:39:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-76df92ef-2f49-4ab4-afa9-f06bb868d5c6 tempest-VolumesDeleteCascade-1232137414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de64de35-b334-45e9-a796-a2e89a0da4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-76df92ef-2f49-4ab4-afa9-f06bb868d5c6 tempest-VolumesDeleteCascade-1232137414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de64de35-b334-45e9-a796-a2e89a0da4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2131040342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d6c688e-44ae-4a43-9bc7-7ba49f788f04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ab35bad29b74cc0a1701557dd8cd5f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:39:32Z,use_quota=True,user_id='c24d2ef9c5f4479f8577b60287619136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-76df92ef-2f49-4ab4-afa9-f06bb868d5c6 tempest-VolumesDeleteCascade-1232137414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f218fbb-ac5b-4b7e-a0a5-3b8c72315db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:32 devstack sudo[96446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f126ca01-a73f-4fba-984e-10b2a6542796 Aug 28 09:39:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-76df92ef-2f49-4ab4-afa9-f06bb868d5c6 tempest-VolumesDeleteCascade-1232137414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f218fbb-ac5b-4b7e-a0a5-3b8c72315db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:32 devstack sudo[96446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-76df92ef-2f49-4ab4-afa9-f06bb868d5c6 tempest-VolumesDeleteCascade-1232137414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77a5fe3a-d241-4c33-97f1-3ff73f6dd17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-76df92ef-2f49-4ab4-afa9-f06bb868d5c6 tempest-VolumesDeleteCascade-1232137414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77a5fe3a-d241-4c33-97f1-3ff73f6dd17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d6c688e-44ae-4a43-9bc7-7ba49f788f04', 'volume_name': 'volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-76df92ef-2f49-4ab4-afa9-f06bb868d5c6 tempest-VolumesDeleteCascade-1232137414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbe100b1-230d-457a-8b1f-15c4fd03b769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-76df92ef-2f49-4ab4-afa9-f06bb868d5c6 tempest-VolumesDeleteCascade-1232137414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbe100b1-230d-457a-8b1f-15c4fd03b769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-76df92ef-2f49-4ab4-afa9-f06bb868d5c6 tempest-VolumesDeleteCascade-1232137414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b167b2b-407b-4d93-b1d0-56ad4ed73d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:32 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-76df92ef-2f49-4ab4-afa9-f06bb868d5c6 tempest-VolumesDeleteCascade-1232137414 None] Volume 4d6c688e-44ae-4a43-9bc7-7ba49f788f04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04', 'volume_size': 1} Aug 28 09:39:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-76df92ef-2f49-4ab4-afa9-f06bb868d5c6 tempest-VolumesDeleteCascade-1232137414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:39:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-76df92ef-2f49-4ab4-afa9-f06bb868d5c6 tempest-VolumesDeleteCascade-1232137414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:39:32 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-76df92ef-2f49-4ab4-afa9-f06bb868d5c6 tempest-VolumesDeleteCascade-1232137414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2131040342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d6c688e-44ae-4a43-9bc7-7ba49f788f04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ab35bad29b74cc0a1701557dd8cd5f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:39:32Z,use_quota=True,user_id='c24d2ef9c5f4479f8577b60287619136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:39:32 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-76df92ef-2f49-4ab4-afa9-f06bb868d5c6 tempest-VolumesDeleteCascade-1232137414 None] Creating volume 4d6c688e-44ae-4a43-9bc7-7ba49f788f04 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:39:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-76df92ef-2f49-4ab4-afa9-f06bb868d5c6 tempest-VolumesDeleteCascade-1232137414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:39:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-76df92ef-2f49-4ab4-afa9-f06bb868d5c6 tempest-VolumesDeleteCascade-1232137414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:39:32 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-76df92ef-2f49-4ab4-afa9-f06bb868d5c6 tempest-VolumesDeleteCascade-1232137414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:39:32 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-76df92ef-2f49-4ab4-afa9-f06bb868d5c6 tempest-VolumesDeleteCascade-1232137414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:39:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-76df92ef-2f49-4ab4-afa9-f06bb868d5c6 tempest-VolumesDeleteCascade-1232137414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:39:32 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-76df92ef-2f49-4ab4-afa9-f06bb868d5c6 tempest-VolumesDeleteCascade-1232137414 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:39:32 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-76df92ef-2f49-4ab4-afa9-f06bb868d5c6 tempest-VolumesDeleteCascade-1232137414 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:39:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-76df92ef-2f49-4ab4-afa9-f06bb868d5c6 tempest-VolumesDeleteCascade-1232137414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:32 devstack sudo[96449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04 1073741824 Aug 28 09:39:32 devstack sudo[96449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:32 devstack sudo[96445]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c3335dad-685c-4917-9860-ffdb868c6e2e tempest-SnapshotsActionsTest-1083237043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.9ea14683-6597-4935-b698-e4d91f066954" returned: 0 in 0.472s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:32 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-c3335dad-685c-4917-9860-ffdb868c6e2e tempest-SnapshotsActionsTest-1083237043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2694b58b-5a76-451f-880b-8d714f34d880(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:39:32 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea25b099-c45d-4d2b-bb28-ebbfdc985722]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:39:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c3335dad-685c-4917-9860-ffdb868c6e2e tempest-SnapshotsActionsTest-1083237043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:32 devstack sudo[96446]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-71bb5463-eb16-4ac8-8211-4c97069ce346 tempest-GroupsTest-219853784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f126ca01-a73f-4fba-984e-10b2a6542796" returned: 0 in 0.541s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-71bb5463-eb16-4ac8-8211-4c97069ce346 tempest-GroupsTest-219853784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f126ca01-a73f-4fba-984e-10b2a6542796 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:32 devstack sudo[96456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8 Aug 28 09:39:32 devstack sudo[96456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:32 devstack sudo[96461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f126ca01-a73f-4fba-984e-10b2a6542796 Aug 28 09:39:32 devstack sudo[96461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:32 devstack sudo[96449]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-76df92ef-2f49-4ab4-afa9-f06bb868d5c6 tempest-VolumesDeleteCascade-1232137414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04 1073741824" returned: 0 in 0.566s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-76df92ef-2f49-4ab4-afa9-f06bb868d5c6 tempest-VolumesDeleteCascade-1232137414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:32 devstack sudo[96461]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:32 devstack sudo[96468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04 Aug 28 09:39:32 devstack sudo[96468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-71bb5463-eb16-4ac8-8211-4c97069ce346 tempest-GroupsTest-219853784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f126ca01-a73f-4fba-984e-10b2a6542796" returned: 0 in 0.289s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:32 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-71bb5463-eb16-4ac8-8211-4c97069ce346 tempest-GroupsTest-219853784 None] Lock "cinder-quobyte-f126ca01-a73f-4fba-984e-10b2a6542796" released by "delete_volume" :: held 0.882s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:39:32 devstack sudo[96456]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c3335dad-685c-4917-9860-ffdb868c6e2e tempest-SnapshotsActionsTest-1083237043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8" returned: 0 in 0.503s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:32 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-c3335dad-685c-4917-9860-ffdb868c6e2e tempest-SnapshotsActionsTest-1083237043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2694b58b-5a76-451f-880b-8d714f34d880(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:39:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c3335dad-685c-4917-9860-ffdb868c6e2e tempest-SnapshotsActionsTest-1083237043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.9ea14683-6597-4935-b698-e4d91f066954 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:33 devstack sudo[96472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.9ea14683-6597-4935-b698-e4d91f066954 Aug 28 09:39:33 devstack sudo[96472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:33 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-71bb5463-eb16-4ac8-8211-4c97069ce346 tempest-GroupsTest-219853784 None] Created reservations ['6b2d2b85-8d40-4307-bcaf-48c229b7aea7'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:39:33 devstack cinder-volume[86081]: WARNING cinder.quota [None req-71bb5463-eb16-4ac8-8211-4c97069ce346 tempest-GroupsTest-219853784 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-963680891 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-963680891, it is now deprecated. Please use the default quota class for default quota. Aug 28 09:39:33 devstack cinder-volume[86081]: WARNING cinder.quota [None req-71bb5463-eb16-4ac8-8211-4c97069ce346 tempest-GroupsTest-219853784 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-963680891 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-963680891, it is now deprecated. Please use the default quota class for default quota. Aug 28 09:39:33 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-71bb5463-eb16-4ac8-8211-4c97069ce346 tempest-GroupsTest-219853784 None] Created reservations ['7ebe2946-f759-42fc-8ac6-321e34f5e1df', '47b0d245-c8b7-4de9-960d-550a93f9d8ec', 'e0f1efc1-b26b-4853-b6b9-1c4aa9a156fd', '57517a1a-cdd0-4d0a-a281-a3a326860d8e'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:39:33 devstack sudo[96468]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-76df92ef-2f49-4ab4-afa9-f06bb868d5c6 tempest-VolumesDeleteCascade-1232137414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04" returned: 0 in 0.296s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:33 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-76df92ef-2f49-4ab4-afa9-f06bb868d5c6 tempest-VolumesDeleteCascade-1232137414 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:39:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-76df92ef-2f49-4ab4-afa9-f06bb868d5c6 tempest-VolumesDeleteCascade-1232137414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:39:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-76df92ef-2f49-4ab4-afa9-f06bb868d5c6 tempest-VolumesDeleteCascade-1232137414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b167b2b-407b-4d93-b1d0-56ad4ed73d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-76df92ef-2f49-4ab4-afa9-f06bb868d5c6 tempest-VolumesDeleteCascade-1232137414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddebfe1d-6365-43d0-859a-a37eeab31150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:33 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-76df92ef-2f49-4ab4-afa9-f06bb868d5c6 tempest-VolumesDeleteCascade-1232137414 None] Volume volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04 (4d6c688e-44ae-4a43-9bc7-7ba49f788f04): created successfully Aug 28 09:39:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-76df92ef-2f49-4ab4-afa9-f06bb868d5c6 tempest-VolumesDeleteCascade-1232137414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddebfe1d-6365-43d0-859a-a37eeab31150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-76df92ef-2f49-4ab4-afa9-f06bb868d5c6 tempest-VolumesDeleteCascade-1232137414 None] Flow 'volume_create_manager' (d1e1ef52-52c9-4349-bfe7-c42e4a52ff81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:39:33 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-76df92ef-2f49-4ab4-afa9-f06bb868d5c6 tempest-VolumesDeleteCascade-1232137414 None] Created volume successfully. Aug 28 09:39:33 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-71bb5463-eb16-4ac8-8211-4c97069ce346 tempest-GroupsTest-219853784 None] Created reservations ['7009e043-0f6c-478f-936f-3e03529b4d56', '138f5f8f-b86a-4b90-917d-abc22e156aa4', '06c5ddaf-82ba-4f57-b4e5-8fed87aa9628', 'ec8bb56a-e5db-434c-b8f1-9486d2aee1b4'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:39:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-71bb5463-eb16-4ac8-8211-4c97069ce346 tempest-GroupsTest-219853784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:39:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-71bb5463-eb16-4ac8-8211-4c97069ce346 tempest-GroupsTest-219853784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:39:33 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-71bb5463-eb16-4ac8-8211-4c97069ce346 tempest-GroupsTest-219853784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:39:33 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-71bb5463-eb16-4ac8-8211-4c97069ce346 tempest-GroupsTest-219853784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:39:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-71bb5463-eb16-4ac8-8211-4c97069ce346 tempest-GroupsTest-219853784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:39:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-71bb5463-eb16-4ac8-8211-4c97069ce346 tempest-GroupsTest-219853784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:33 devstack sudo[96478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:39:33 devstack sudo[96478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:33 devstack sudo[96472]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c3335dad-685c-4917-9860-ffdb868c6e2e tempest-SnapshotsActionsTest-1083237043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.9ea14683-6597-4935-b698-e4d91f066954" returned: 0 in 0.610s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c3335dad-685c-4917-9860-ffdb868c6e2e tempest-SnapshotsActionsTest-1083237043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.9ea14683-6597-4935-b698-e4d91f066954 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:33 devstack sudo[96480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.9ea14683-6597-4935-b698-e4d91f066954 Aug 28 09:39:33 devstack sudo[96480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:33 devstack sudo[96478]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-71bb5463-eb16-4ac8-8211-4c97069ce346 tempest-GroupsTest-219853784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.365s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:33 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-71bb5463-eb16-4ac8-8211-4c97069ce346 tempest-GroupsTest-219853784 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:39:33 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-71bb5463-eb16-4ac8-8211-4c97069ce346 tempest-GroupsTest-219853784 None] Delete group completed successfully. Aug 28 09:39:33 devstack sudo[96480]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c3335dad-685c-4917-9860-ffdb868c6e2e tempest-SnapshotsActionsTest-1083237043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.9ea14683-6597-4935-b698-e4d91f066954" returned: 0 in 0.397s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:34 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c3335dad-685c-4917-9860-ffdb868c6e2e tempest-SnapshotsActionsTest-1083237043 None] Lock "cinder-quobyte-9ea14683-6597-4935-b698-e4d91f066954" released by "_delete_snapshot" :: held 2.136s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:39:34 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c3335dad-685c-4917-9860-ffdb868c6e2e tempest-SnapshotsActionsTest-1083237043 None] Lock "cinder-quobyte-2694b58b-5a76-451f-880b-8d714f34d880" released by "delete_snapshot" :: held 2.180s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:39:34 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-c3335dad-685c-4917-9860-ffdb868c6e2e tempest-SnapshotsActionsTest-1083237043 None] Created reservations ['00880b39-6fc7-487e-af94-5633ddc33e30', 'a1c2b905-896c-48b4-a462-63ff53fa954c', '0a60148f-48f1-47d4-8292-b9262de0c2b0', 'b6ed337a-e769-4657-abb3-1ed8aba285b9'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:39:34 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-c3335dad-685c-4917-9860-ffdb868c6e2e tempest-SnapshotsActionsTest-1083237043 None] Delete snapshot completed successfully. Aug 28 09:39:34 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c3335dad-685c-4917-9860-ffdb868c6e2e tempest-SnapshotsActionsTest-1083237043 None] Lock "cinder-9ea14683-6597-4935-b698-e4d91f066954-delete_snapshot" released by "delete_snapshot" :: held 2.366s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:39:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-042ce0ac-278e-4333-b738-c828377db973 tempest-VolumesDeleteCascade-1232137414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:39:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-042ce0ac-278e-4333-b738-c828377db973 tempest-VolumesDeleteCascade-1232137414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:39:34 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-042ce0ac-278e-4333-b738-c828377db973 tempest-VolumesDeleteCascade-1232137414 None] Creating offline snapshot 96711593-2a42-4d51-85d8-600a4a3ab547 of volume 4d6c688e-44ae-4a43-9bc7-7ba49f788f04 {{(pid=86081) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:39:34 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad3506f-2dac-4c2c-ba9f-3a3af39e4ce3]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:39:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-042ce0ac-278e-4333-b738-c828377db973 tempest-VolumesDeleteCascade-1232137414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:34 devstack sudo[96484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04 Aug 28 09:39:34 devstack sudo[96484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:34 devstack sudo[96484]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-042ce0ac-278e-4333-b738-c828377db973 tempest-VolumesDeleteCascade-1232137414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04" returned: 0 in 0.412s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-042ce0ac-278e-4333-b738-c828377db973 tempest-VolumesDeleteCascade-1232137414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04.96711593-2a42-4d51-85d8-600a4a3ab547 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:34 devstack sudo[96489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04.96711593-2a42-4d51-85d8-600a4a3ab547 1G Aug 28 09:39:34 devstack sudo[96489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f6093dd3-a95d-4593-b024-c7393e3dd072 tempest-SnapshotsActionsTest-765698309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:39:35 devstack sudo[96489]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-042ce0ac-278e-4333-b738-c828377db973 tempest-VolumesDeleteCascade-1232137414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04.96711593-2a42-4d51-85d8-600a4a3ab547 1G" returned: 0 in 0.653s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-042ce0ac-278e-4333-b738-c828377db973 tempest-VolumesDeleteCascade-1232137414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04.96711593-2a42-4d51-85d8-600a4a3ab547 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:35 devstack sudo[96495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04.96711593-2a42-4d51-85d8-600a4a3ab547 Aug 28 09:39:35 devstack sudo[96495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:35 devstack sudo[96495]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-042ce0ac-278e-4333-b738-c828377db973 tempest-VolumesDeleteCascade-1232137414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04.96711593-2a42-4d51-85d8-600a4a3ab547" returned: 0 in 0.404s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:35 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-042ce0ac-278e-4333-b738-c828377db973 tempest-VolumesDeleteCascade-1232137414 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04.96711593-2a42-4d51-85d8-600a4a3ab547 is being set with open permissions: ugo+rw Aug 28 09:39:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-042ce0ac-278e-4333-b738-c828377db973 tempest-VolumesDeleteCascade-1232137414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04.96711593-2a42-4d51-85d8-600a4a3ab547 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:35 devstack sudo[96501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04.96711593-2a42-4d51-85d8-600a4a3ab547 Aug 28 09:39:35 devstack sudo[96501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:36 devstack sudo[96501]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-042ce0ac-278e-4333-b738-c828377db973 tempest-VolumesDeleteCascade-1232137414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04.96711593-2a42-4d51-85d8-600a4a3ab547" returned: 0 in 0.306s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-042ce0ac-278e-4333-b738-c828377db973 tempest-VolumesDeleteCascade-1232137414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:36 devstack sudo[96504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04.info Aug 28 09:39:36 devstack sudo[96504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:36 devstack sudo[96504]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-042ce0ac-278e-4333-b738-c828377db973 tempest-VolumesDeleteCascade-1232137414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04.info" returned: 0 in 0.331s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:36 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-042ce0ac-278e-4333-b738-c828377db973 tempest-VolumesDeleteCascade-1232137414 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04.info is being set with open permissions: ugo+rw Aug 28 09:39:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-042ce0ac-278e-4333-b738-c828377db973 tempest-VolumesDeleteCascade-1232137414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:36 devstack sudo[96507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04.info Aug 28 09:39:36 devstack sudo[96507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:36 devstack sudo[96507]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-042ce0ac-278e-4333-b738-c828377db973 tempest-VolumesDeleteCascade-1232137414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04.info" returned: 0 in 0.278s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-042ce0ac-278e-4333-b738-c828377db973 tempest-VolumesDeleteCascade-1232137414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.507s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:39:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f6093dd3-a95d-4593-b024-c7393e3dd072 tempest-SnapshotsActionsTest-765698309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.502s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:39:36 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-f6093dd3-a95d-4593-b024-c7393e3dd072 tempest-SnapshotsActionsTest-765698309 None] Creating offline snapshot 06ac6370-7800-4370-af68-8acf0fef89de of volume 2694b58b-5a76-451f-880b-8d714f34d880 {{(pid=86081) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:39:37 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[6420cf3d-badf-442a-8e5a-603f50ebe4f7]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:39:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f6093dd3-a95d-4593-b024-c7393e3dd072 tempest-SnapshotsActionsTest-765698309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:37 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-042ce0ac-278e-4333-b738-c828377db973 tempest-VolumesDeleteCascade-1232137414 None] Create snapshot completed successfully Aug 28 09:39:37 devstack sudo[96510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8 Aug 28 09:39:37 devstack sudo[96510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:37 devstack sudo[96510]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f6093dd3-a95d-4593-b024-c7393e3dd072 tempest-SnapshotsActionsTest-765698309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8" returned: 0 in 0.440s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:37 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-f6093dd3-a95d-4593-b024-c7393e3dd072 tempest-SnapshotsActionsTest-765698309 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2694b58b-5a76-451f-880b-8d714f34d880(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:39:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f6093dd3-a95d-4593-b024-c7393e3dd072 tempest-SnapshotsActionsTest-765698309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.06ac6370-7800-4370-af68-8acf0fef89de 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:37 devstack sudo[96515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.06ac6370-7800-4370-af68-8acf0fef89de 1G Aug 28 09:39:37 devstack sudo[96515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:38 devstack cinder-volume[86081]: DEBUG oslo_service.periodic_task [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86081) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:39:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:39:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:39:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:39:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:39:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:39:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:38 devstack sudo[96521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:39:38 devstack sudo[96521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:38 devstack sudo[96515]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f6093dd3-a95d-4593-b024-c7393e3dd072 tempest-SnapshotsActionsTest-765698309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.06ac6370-7800-4370-af68-8acf0fef89de 1G" returned: 0 in 0.663s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f6093dd3-a95d-4593-b024-c7393e3dd072 tempest-SnapshotsActionsTest-765698309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.06ac6370-7800-4370-af68-8acf0fef89de {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:38 devstack sudo[96523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.06ac6370-7800-4370-af68-8acf0fef89de Aug 28 09:39:38 devstack sudo[96523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:38 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e348c1c-890b-47a6-9b88-3b7f53d25777 tempest-VolumesDeleteCascade-1232137414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:39:38 devstack sudo[96521]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.314s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:38 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:39:38 devstack cinder-volume[86081]: DEBUG oslo_service.periodic_task [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running periodic task VolumeManager._thread_info {{(pid=86081) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:39:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] thread count: 28 {{(pid=86081) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 09:39:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] thread info: [<_MainThread(MainThread, started 129914189705344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86081) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 09:39:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-9e348c1c-890b-47a6-9b88-3b7f53d25777 tempest-VolumesDeleteCascade-1232137414 None] Flow 'volume_create_manager' (f73ea653-9125-4663-a104-1b6758741a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:39:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-9e348c1c-890b-47a6-9b88-3b7f53d25777 tempest-VolumesDeleteCascade-1232137414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77399700-60dc-40a2-b5b0-65369b6053a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-9e348c1c-890b-47a6-9b88-3b7f53d25777 tempest-VolumesDeleteCascade-1232137414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77399700-60dc-40a2-b5b0-65369b6053a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:39:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1207680965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17423d1c-1343-41de-888a-b17bc3807c86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ab35bad29b74cc0a1701557dd8cd5f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:39:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=96711593-2a42-4d51-85d8-600a4a3ab547,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:39:38Z,use_quota=True,user_id='c24d2ef9c5f4479f8577b60287619136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-9e348c1c-890b-47a6-9b88-3b7f53d25777 tempest-VolumesDeleteCascade-1232137414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0f61703-47c0-45c9-ae97-229be5c59197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-9e348c1c-890b-47a6-9b88-3b7f53d25777 tempest-VolumesDeleteCascade-1232137414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0f61703-47c0-45c9-ae97-229be5c59197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-9e348c1c-890b-47a6-9b88-3b7f53d25777 tempest-VolumesDeleteCascade-1232137414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82001069-1ebd-46d4-a274-7d284bbe17d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-9e348c1c-890b-47a6-9b88-3b7f53d25777 tempest-VolumesDeleteCascade-1232137414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82001069-1ebd-46d4-a274-7d284bbe17d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '17423d1c-1343-41de-888a-b17bc3807c86', 'volume_name': 'volume-17423d1c-1343-41de-888a-b17bc3807c86', 'volume_size': 1, 'snapshot_id': '96711593-2a42-4d51-85d8-600a4a3ab547'}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-9e348c1c-890b-47a6-9b88-3b7f53d25777 tempest-VolumesDeleteCascade-1232137414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff286ae6-851a-405e-a3fb-eb4af862f75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-9e348c1c-890b-47a6-9b88-3b7f53d25777 tempest-VolumesDeleteCascade-1232137414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff286ae6-851a-405e-a3fb-eb4af862f75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-9e348c1c-890b-47a6-9b88-3b7f53d25777 tempest-VolumesDeleteCascade-1232137414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (090e997a-0f21-4322-a7c7-1a3657911e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:38 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-9e348c1c-890b-47a6-9b88-3b7f53d25777 tempest-VolumesDeleteCascade-1232137414 None] Volume 17423d1c-1343-41de-888a-b17bc3807c86: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-17423d1c-1343-41de-888a-b17bc3807c86', 'volume_size': 1, 'snapshot_id': '96711593-2a42-4d51-85d8-600a4a3ab547'} Aug 28 09:39:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-9e348c1c-890b-47a6-9b88-3b7f53d25777 tempest-VolumesDeleteCascade-1232137414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:39:38 devstack sudo[96523]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f6093dd3-a95d-4593-b024-c7393e3dd072 tempest-SnapshotsActionsTest-765698309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.06ac6370-7800-4370-af68-8acf0fef89de" returned: 0 in 0.450s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:38 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-f6093dd3-a95d-4593-b024-c7393e3dd072 tempest-SnapshotsActionsTest-765698309 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.06ac6370-7800-4370-af68-8acf0fef89de is being set with open permissions: ugo+rw Aug 28 09:39:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f6093dd3-a95d-4593-b024-c7393e3dd072 tempest-SnapshotsActionsTest-765698309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.06ac6370-7800-4370-af68-8acf0fef89de {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:38 devstack sudo[96530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.06ac6370-7800-4370-af68-8acf0fef89de Aug 28 09:39:38 devstack sudo[96530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:38 devstack sudo[96530]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f6093dd3-a95d-4593-b024-c7393e3dd072 tempest-SnapshotsActionsTest-765698309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.06ac6370-7800-4370-af68-8acf0fef89de" returned: 0 in 0.279s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f6093dd3-a95d-4593-b024-c7393e3dd072 tempest-SnapshotsActionsTest-765698309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.957s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:39:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-9e348c1c-890b-47a6-9b88-3b7f53d25777 tempest-VolumesDeleteCascade-1232137414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.336s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:39:38 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-9e348c1c-890b-47a6-9b88-3b7f53d25777 tempest-VolumesDeleteCascade-1232137414 None] Acquiring lock "cinder-quobyte-96711593-2a42-4d51-85d8-600a4a3ab547-17423d1c-1343-41de-888a-b17bc3807c86" by "_create_volume_from_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:39:38 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-9e348c1c-890b-47a6-9b88-3b7f53d25777 tempest-VolumesDeleteCascade-1232137414 None] Lock "cinder-quobyte-96711593-2a42-4d51-85d8-600a4a3ab547-17423d1c-1343-41de-888a-b17bc3807c86" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:39:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-9e348c1c-890b-47a6-9b88-3b7f53d25777 tempest-VolumesDeleteCascade-1232137414 None] Creating volume 17423d1c-1343-41de-888a-b17bc3807c86 from snapshot 96711593-2a42-4d51-85d8-600a4a3ab547 {{(pid=86081) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 28 09:39:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-9e348c1c-890b-47a6-9b88-3b7f53d25777 tempest-VolumesDeleteCascade-1232137414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:39:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-9e348c1c-890b-47a6-9b88-3b7f53d25777 tempest-VolumesDeleteCascade-1232137414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:39:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-9e348c1c-890b-47a6-9b88-3b7f53d25777 tempest-VolumesDeleteCascade-1232137414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:39:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-9e348c1c-890b-47a6-9b88-3b7f53d25777 tempest-VolumesDeleteCascade-1232137414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:39:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-9e348c1c-890b-47a6-9b88-3b7f53d25777 tempest-VolumesDeleteCascade-1232137414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:39:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-9e348c1c-890b-47a6-9b88-3b7f53d25777 tempest-VolumesDeleteCascade-1232137414 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:39:38 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-9e348c1c-890b-47a6-9b88-3b7f53d25777 tempest-VolumesDeleteCascade-1232137414 None] Acquiring lock "cinder-quobyte-17423d1c-1343-41de-888a-b17bc3807c86" by "_copy_volume_from_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:39:38 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-f6093dd3-a95d-4593-b024-c7393e3dd072 tempest-SnapshotsActionsTest-765698309 None] Create snapshot completed successfully Aug 28 09:39:38 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-9e348c1c-890b-47a6-9b88-3b7f53d25777 tempest-VolumesDeleteCascade-1232137414 None] Lock "cinder-quobyte-17423d1c-1343-41de-888a-b17bc3807c86" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:39:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-9e348c1c-890b-47a6-9b88-3b7f53d25777 tempest-VolumesDeleteCascade-1232137414 None] snapshot: 96711593-2a42-4d51-85d8-600a4a3ab547, volume: 17423d1c-1343-41de-888a-b17bc3807c86, {{(pid=86081) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 28 09:39:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-9e348c1c-890b-47a6-9b88-3b7f53d25777 tempest-VolumesDeleteCascade-1232137414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:39:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-9e348c1c-890b-47a6-9b88-3b7f53d25777 tempest-VolumesDeleteCascade-1232137414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:39:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-9e348c1c-890b-47a6-9b88-3b7f53d25777 tempest-VolumesDeleteCascade-1232137414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:39:39 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-9e348c1c-890b-47a6-9b88-3b7f53d25777 tempest-VolumesDeleteCascade-1232137414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:39:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-9e348c1c-890b-47a6-9b88-3b7f53d25777 tempest-VolumesDeleteCascade-1232137414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:39:39 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a54d543-dabf-4828-9094-3e41002892d9]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:39:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9e348c1c-890b-47a6-9b88-3b7f53d25777 tempest-VolumesDeleteCascade-1232137414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04.96711593-2a42-4d51-85d8-600a4a3ab547 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:39 devstack sudo[96534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04.96711593-2a42-4d51-85d8-600a4a3ab547 Aug 28 09:39:39 devstack sudo[96534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:39 devstack sudo[96534]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9e348c1c-890b-47a6-9b88-3b7f53d25777 tempest-VolumesDeleteCascade-1232137414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04.96711593-2a42-4d51-85d8-600a4a3ab547" returned: 0 in 0.409s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:39 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-9e348c1c-890b-47a6-9b88-3b7f53d25777 tempest-VolumesDeleteCascade-1232137414 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:39:39 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[359c026a-6245-49d6-a9ac-176f6dc845ca]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:39:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9e348c1c-890b-47a6-9b88-3b7f53d25777 tempest-VolumesDeleteCascade-1232137414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:39 devstack sudo[96539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04 Aug 28 09:39:39 devstack sudo[96539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:39 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-46a6a6a9-fdf5-4528-a00d-d07854c1b2db tempest-SnapshotsActionsTest-1083237043 None] Acquiring lock "cinder-06ac6370-7800-4370-af68-8acf0fef89de-delete_snapshot" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:39:39 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-1c85be38-348b-40e7-8079-f95f2e82aae0 tempest-GroupsV314Test-865056381 None] Group tempest-GroupsV314Test-Group-67676357: creating Aug 28 09:39:39 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-46a6a6a9-fdf5-4528-a00d-d07854c1b2db tempest-SnapshotsActionsTest-1083237043 None] Lock "cinder-06ac6370-7800-4370-af68-8acf0fef89de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:39:39 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-46a6a6a9-fdf5-4528-a00d-d07854c1b2db tempest-SnapshotsActionsTest-1083237043 None] Acquiring lock "cinder-quobyte-2694b58b-5a76-451f-880b-8d714f34d880" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:39:39 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-46a6a6a9-fdf5-4528-a00d-d07854c1b2db tempest-SnapshotsActionsTest-1083237043 None] Lock "cinder-quobyte-2694b58b-5a76-451f-880b-8d714f34d880" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:39:39 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-46a6a6a9-fdf5-4528-a00d-d07854c1b2db tempest-SnapshotsActionsTest-1083237043 None] Acquiring lock "cinder-quobyte-06ac6370-7800-4370-af68-8acf0fef89de" by "_delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:39:39 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-1c85be38-348b-40e7-8079-f95f2e82aae0 tempest-GroupsV314Test-865056381 None] Group tempest-GroupsV314Test-Group-67676357: created successfully Aug 28 09:39:39 devstack sudo[96539]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:39 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-46a6a6a9-fdf5-4528-a00d-d07854c1b2db tempest-SnapshotsActionsTest-1083237043 None] Lock "cinder-quobyte-06ac6370-7800-4370-af68-8acf0fef89de" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:39:39 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-46a6a6a9-fdf5-4528-a00d-d07854c1b2db tempest-SnapshotsActionsTest-1083237043 None] Deleting offline snapshot 06ac6370-7800-4370-af68-8acf0fef89de of volume 2694b58b-5a76-451f-880b-8d714f34d880 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:39:39 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-46a6a6a9-fdf5-4528-a00d-d07854c1b2db tempest-SnapshotsActionsTest-1083237043 None] snapshot_file for this snap is: volume-2694b58b-5a76-451f-880b-8d714f34d880.06ac6370-7800-4370-af68-8acf0fef89de {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:39:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9e348c1c-890b-47a6-9b88-3b7f53d25777 tempest-VolumesDeleteCascade-1232137414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04" returned: 0 in 0.512s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:39 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-9e348c1c-890b-47a6-9b88-3b7f53d25777 tempest-VolumesDeleteCascade-1232137414 None] will copy from snapshot at /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04 {{(pid=86081) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 28 09:39:39 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-9e348c1c-890b-47a6-9b88-3b7f53d25777 tempest-VolumesDeleteCascade-1232137414 None] Creating direct copy from snapshot {{(pid=86081) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 28 09:39:39 devstack cinder-volume[86081]: DEBUG cinder.utils [None req-9e348c1c-890b-47a6-9b88-3b7f53d25777 tempest-VolumesDeleteCascade-1232137414 None] Path /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-17423d1c-1343-41de-888a-b17bc3807c86 not found in is_blk_device check {{(pid=86081) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 28 09:39:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9e348c1c-890b-47a6-9b88-3b7f53d25777 tempest-VolumesDeleteCascade-1232137414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-17423d1c-1343-41de-888a-b17bc3807c86 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:39 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[0883bf30-e82f-4d70-a1b6-8e19bca509f3]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:39:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-46a6a6a9-fdf5-4528-a00d-d07854c1b2db tempest-SnapshotsActionsTest-1083237043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.06ac6370-7800-4370-af68-8acf0fef89de {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:39 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-1c85be38-348b-40e7-8079-f95f2e82aae0 tempest-GroupsV314Test-865056381 None] Create group completed successfully. Aug 28 09:39:39 devstack sudo[96544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-17423d1c-1343-41de-888a-b17bc3807c86 Aug 28 09:39:39 devstack sudo[96544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:40 devstack sudo[96545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.06ac6370-7800-4370-af68-8acf0fef89de Aug 28 09:39:40 devstack sudo[96545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:40 devstack sudo[96545]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-46a6a6a9-fdf5-4528-a00d-d07854c1b2db tempest-SnapshotsActionsTest-1083237043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.06ac6370-7800-4370-af68-8acf0fef89de" returned: 0 in 0.447s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:40 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-46a6a6a9-fdf5-4528-a00d-d07854c1b2db tempest-SnapshotsActionsTest-1083237043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2694b58b-5a76-451f-880b-8d714f34d880(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:39:40 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfe28e1-2fba-4c80-92ba-009eeb9d77a4]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:39:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-46a6a6a9-fdf5-4528-a00d-d07854c1b2db tempest-SnapshotsActionsTest-1083237043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:40 devstack sudo[96554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8 Aug 28 09:39:40 devstack sudo[96554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:41 devstack sudo[96554]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-46a6a6a9-fdf5-4528-a00d-d07854c1b2db tempest-SnapshotsActionsTest-1083237043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8" returned: 0 in 0.969s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:41 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-46a6a6a9-fdf5-4528-a00d-d07854c1b2db tempest-SnapshotsActionsTest-1083237043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2694b58b-5a76-451f-880b-8d714f34d880(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:39:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-46a6a6a9-fdf5-4528-a00d-d07854c1b2db tempest-SnapshotsActionsTest-1083237043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.06ac6370-7800-4370-af68-8acf0fef89de {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:41 devstack sudo[96567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.06ac6370-7800-4370-af68-8acf0fef89de Aug 28 09:39:41 devstack sudo[96567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:42 devstack sudo[96567]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:42 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-46a6a6a9-fdf5-4528-a00d-d07854c1b2db tempest-SnapshotsActionsTest-1083237043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.06ac6370-7800-4370-af68-8acf0fef89de" returned: 0 in 0.842s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:42 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-46a6a6a9-fdf5-4528-a00d-d07854c1b2db tempest-SnapshotsActionsTest-1083237043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.06ac6370-7800-4370-af68-8acf0fef89de {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:42 devstack sudo[96572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.06ac6370-7800-4370-af68-8acf0fef89de Aug 28 09:39:42 devstack sudo[96572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:43 devstack sudo[96572]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-46a6a6a9-fdf5-4528-a00d-d07854c1b2db tempest-SnapshotsActionsTest-1083237043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.06ac6370-7800-4370-af68-8acf0fef89de" returned: 0 in 0.805s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:43 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-46a6a6a9-fdf5-4528-a00d-d07854c1b2db tempest-SnapshotsActionsTest-1083237043 None] Lock "cinder-quobyte-06ac6370-7800-4370-af68-8acf0fef89de" released by "_delete_snapshot" :: held 3.260s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:39:43 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-46a6a6a9-fdf5-4528-a00d-d07854c1b2db tempest-SnapshotsActionsTest-1083237043 None] Lock "cinder-quobyte-2694b58b-5a76-451f-880b-8d714f34d880" released by "delete_snapshot" :: held 3.310s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:39:43 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-5424d158-24d0-4a89-8c49-20c463f6cfff tempest-GroupsV314Test-865056381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:39:43 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5424d158-24d0-4a89-8c49-20c463f6cfff tempest-GroupsV314Test-865056381 None] Flow 'volume_create_manager' (1cdf00ce-1c2b-4d43-8ecd-bae15381b290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:39:43 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5424d158-24d0-4a89-8c49-20c463f6cfff tempest-GroupsV314Test-865056381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f795e975-5fa9-4dd5-ba1d-b4609015658d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:43 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5424d158-24d0-4a89-8c49-20c463f6cfff tempest-GroupsV314Test-865056381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f795e975-5fa9-4dd5-ba1d-b4609015658d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-35246880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=41753295-33c3-4904-91b0-c13b5c0909f7,host='devstack@QuobyteHD#QuobyteHD',id=6a436825-aaee-4332-9d52-4a5336589cb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c18f403769c455885b8738760af7793',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:39:43Z,use_quota=True,user_id='f091628f264149528360c35dcd524a92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d17a4ab8-1ad4-44a3-84bf-9e82d8d375e8),volume_type_id=d17a4ab8-1ad4-44a3-84bf-9e82d8d375e8)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:43 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5424d158-24d0-4a89-8c49-20c463f6cfff tempest-GroupsV314Test-865056381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1dc54c3-37f1-40df-a797-f5a24e7708b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:43 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5424d158-24d0-4a89-8c49-20c463f6cfff tempest-GroupsV314Test-865056381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1dc54c3-37f1-40df-a797-f5a24e7708b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:43 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5424d158-24d0-4a89-8c49-20c463f6cfff tempest-GroupsV314Test-865056381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc4b6821-2226-466e-8acf-c8bd467e1fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:43 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5424d158-24d0-4a89-8c49-20c463f6cfff tempest-GroupsV314Test-865056381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc4b6821-2226-466e-8acf-c8bd467e1fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a436825-aaee-4332-9d52-4a5336589cb0', 'volume_name': 'volume-6a436825-aaee-4332-9d52-4a5336589cb0', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:43 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5424d158-24d0-4a89-8c49-20c463f6cfff tempest-GroupsV314Test-865056381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7545f1a2-91a6-46bf-8933-b690a065206f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:43 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5424d158-24d0-4a89-8c49-20c463f6cfff tempest-GroupsV314Test-865056381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7545f1a2-91a6-46bf-8933-b690a065206f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:43 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5424d158-24d0-4a89-8c49-20c463f6cfff tempest-GroupsV314Test-865056381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67f418f9-9756-4af3-9ac0-f028f3b170a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:43 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-5424d158-24d0-4a89-8c49-20c463f6cfff tempest-GroupsV314Test-865056381 None] Volume 6a436825-aaee-4332-9d52-4a5336589cb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a436825-aaee-4332-9d52-4a5336589cb0', 'volume_size': 1} Aug 28 09:39:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-5424d158-24d0-4a89-8c49-20c463f6cfff tempest-GroupsV314Test-865056381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:39:43 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-85c1a736-c509-4de6-947e-3c49110b628d tempest-TestServerVolumeAttachmentScenario-1064473967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:39:43 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-85c1a736-c509-4de6-947e-3c49110b628d tempest-TestServerVolumeAttachmentScenario-1064473967 None] Flow 'volume_create_manager' (24cb8fc6-871f-4988-a146-1dded9f72d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:39:43 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-85c1a736-c509-4de6-947e-3c49110b628d tempest-TestServerVolumeAttachmentScenario-1064473967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9aa7303-8cf9-4a6d-bfb0-651cfe4d3f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:44 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-85c1a736-c509-4de6-947e-3c49110b628d tempest-TestServerVolumeAttachmentScenario-1064473967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9aa7303-8cf9-4a6d-bfb0-651cfe4d3f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1341795979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68ac8c7b-bf60-48a2-b0e0-c507cc572d83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00f445b42931424280f85357bd4c4997',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:39:43Z,use_quota=True,user_id='1e547c4210f04355b142dd68b736912d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:44 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-85c1a736-c509-4de6-947e-3c49110b628d tempest-TestServerVolumeAttachmentScenario-1064473967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d3a59a5-e406-4079-8dc5-735e900d54b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:44 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-85c1a736-c509-4de6-947e-3c49110b628d tempest-TestServerVolumeAttachmentScenario-1064473967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d3a59a5-e406-4079-8dc5-735e900d54b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:44 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-85c1a736-c509-4de6-947e-3c49110b628d tempest-TestServerVolumeAttachmentScenario-1064473967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e004a946-261f-4176-ac4b-216f3cc75335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:44 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-85c1a736-c509-4de6-947e-3c49110b628d tempest-TestServerVolumeAttachmentScenario-1064473967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e004a946-261f-4176-ac4b-216f3cc75335) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68ac8c7b-bf60-48a2-b0e0-c507cc572d83', 'volume_name': 'volume-68ac8c7b-bf60-48a2-b0e0-c507cc572d83', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:44 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-85c1a736-c509-4de6-947e-3c49110b628d tempest-TestServerVolumeAttachmentScenario-1064473967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87eb0ef2-7174-4cf5-87fb-4c28793f1004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:44 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-85c1a736-c509-4de6-947e-3c49110b628d tempest-TestServerVolumeAttachmentScenario-1064473967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87eb0ef2-7174-4cf5-87fb-4c28793f1004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:44 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-85c1a736-c509-4de6-947e-3c49110b628d tempest-TestServerVolumeAttachmentScenario-1064473967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cc0113b-0e8c-477e-ac6f-369a11bb6468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:44 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-85c1a736-c509-4de6-947e-3c49110b628d tempest-TestServerVolumeAttachmentScenario-1064473967 None] Volume 68ac8c7b-bf60-48a2-b0e0-c507cc572d83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68ac8c7b-bf60-48a2-b0e0-c507cc572d83', 'volume_size': 1} Aug 28 09:39:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-85c1a736-c509-4de6-947e-3c49110b628d tempest-TestServerVolumeAttachmentScenario-1064473967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:39:44 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-46a6a6a9-fdf5-4528-a00d-d07854c1b2db tempest-SnapshotsActionsTest-1083237043 None] Created reservations ['a5d8dd4e-6ead-4e78-aafc-b651d43ac4a2', '19615a84-1b85-4cbb-9762-a2140979d412', '7e1ba23e-f2ba-49d0-9f11-16a2d38ff959', '63797096-7d49-4610-9e73-86800ba8b948'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:39:44 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-4520e5a5-f71f-446d-a59f-dd2ce3bb3b81 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:39:44 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-4520e5a5-f71f-446d-a59f-dd2ce3bb3b81 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Flow 'volume_create_manager' (92d418ca-a65c-4497-bd50-acd1704fc23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:39:44 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-4520e5a5-f71f-446d-a59f-dd2ce3bb3b81 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d547a55d-3ce2-483b-8b62-932c9c06a470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:44 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-4520e5a5-f71f-446d-a59f-dd2ce3bb3b81 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d547a55d-3ce2-483b-8b62-932c9c06a470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-172121087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df4f9f4e-2a7a-4b0f-a489-c3aebc7cf713,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00f445b42931424280f85357bd4c4997',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:39:44Z,use_quota=True,user_id='1e547c4210f04355b142dd68b736912d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:44 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-4520e5a5-f71f-446d-a59f-dd2ce3bb3b81 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe768160-c2da-4e8b-a89f-5cc18122e699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:44 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-4520e5a5-f71f-446d-a59f-dd2ce3bb3b81 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe768160-c2da-4e8b-a89f-5cc18122e699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:44 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-4520e5a5-f71f-446d-a59f-dd2ce3bb3b81 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d6fad38-4a6e-4104-b2a3-a35924948e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:44 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-4520e5a5-f71f-446d-a59f-dd2ce3bb3b81 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d6fad38-4a6e-4104-b2a3-a35924948e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df4f9f4e-2a7a-4b0f-a489-c3aebc7cf713', 'volume_name': 'volume-df4f9f4e-2a7a-4b0f-a489-c3aebc7cf713', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:44 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-4520e5a5-f71f-446d-a59f-dd2ce3bb3b81 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (499fd54d-c4e0-49c2-93e8-b59b3c5e0cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:44 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-4520e5a5-f71f-446d-a59f-dd2ce3bb3b81 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (499fd54d-c4e0-49c2-93e8-b59b3c5e0cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:44 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-4520e5a5-f71f-446d-a59f-dd2ce3bb3b81 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a075ad7e-3919-4d6b-a718-7a23de5b149a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:44 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-4520e5a5-f71f-446d-a59f-dd2ce3bb3b81 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Volume df4f9f4e-2a7a-4b0f-a489-c3aebc7cf713: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df4f9f4e-2a7a-4b0f-a489-c3aebc7cf713', 'volume_size': 1} Aug 28 09:39:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-4520e5a5-f71f-446d-a59f-dd2ce3bb3b81 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:39:44 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-46a6a6a9-fdf5-4528-a00d-d07854c1b2db tempest-SnapshotsActionsTest-1083237043 None] Delete snapshot completed successfully. Aug 28 09:39:44 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-46a6a6a9-fdf5-4528-a00d-d07854c1b2db tempest-SnapshotsActionsTest-1083237043 None] Lock "cinder-06ac6370-7800-4370-af68-8acf0fef89de-delete_snapshot" released by "delete_snapshot" :: held 4.715s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:39:45 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-9aa49759-bacf-4f8f-b1ed-ccee90b10aa6 tempest-SnapshotsActionsTest-765698309 None] Acquiring lock "cinder-dee06454-4775-43ec-858a-23fd58abd6c8-delete_snapshot" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:39:45 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-9aa49759-bacf-4f8f-b1ed-ccee90b10aa6 tempest-SnapshotsActionsTest-765698309 None] Lock "cinder-dee06454-4775-43ec-858a-23fd58abd6c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:39:45 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-9aa49759-bacf-4f8f-b1ed-ccee90b10aa6 tempest-SnapshotsActionsTest-765698309 None] Acquiring lock "cinder-quobyte-2694b58b-5a76-451f-880b-8d714f34d880" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:39:45 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-9aa49759-bacf-4f8f-b1ed-ccee90b10aa6 tempest-SnapshotsActionsTest-765698309 None] Lock "cinder-quobyte-2694b58b-5a76-451f-880b-8d714f34d880" acquired by "delete_snapshot" :: waited 0.052s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:39:45 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-9aa49759-bacf-4f8f-b1ed-ccee90b10aa6 tempest-SnapshotsActionsTest-765698309 None] Acquiring lock "cinder-quobyte-dee06454-4775-43ec-858a-23fd58abd6c8" by "_delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:39:45 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-9aa49759-bacf-4f8f-b1ed-ccee90b10aa6 tempest-SnapshotsActionsTest-765698309 None] Lock "cinder-quobyte-dee06454-4775-43ec-858a-23fd58abd6c8" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:39:45 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-9aa49759-bacf-4f8f-b1ed-ccee90b10aa6 tempest-SnapshotsActionsTest-765698309 None] Deleting offline snapshot dee06454-4775-43ec-858a-23fd58abd6c8 of volume 2694b58b-5a76-451f-880b-8d714f34d880 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:39:45 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-9aa49759-bacf-4f8f-b1ed-ccee90b10aa6 tempest-SnapshotsActionsTest-765698309 None] snapshot_file for this snap is: volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:39:46 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9b6fdf-86dd-4116-9d2d-1ead268e8d8e]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:39:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9aa49759-bacf-4f8f-b1ed-ccee90b10aa6 tempest-SnapshotsActionsTest-765698309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:46 devstack sudo[96544]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9e348c1c-890b-47a6-9b88-3b7f53d25777 tempest-VolumesDeleteCascade-1232137414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-17423d1c-1343-41de-888a-b17bc3807c86" returned: 0 in 6.093s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:46 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-9e348c1c-890b-47a6-9b88-3b7f53d25777 tempest-VolumesDeleteCascade-1232137414 None] Image conversion details: src /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04, size 1024.00 MB, duration 6.09 sec, destination /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-17423d1c-1343-41de-888a-b17bc3807c86 {{(pid=86081) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 09:39:46 devstack cinder-volume[86081]: INFO cinder.image.image_utils [None req-9e348c1c-890b-47a6-9b88-3b7f53d25777 tempest-VolumesDeleteCascade-1232137414 None] Converted 1024.00 MB image at 168.03 MB/s Aug 28 09:39:46 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-9e348c1c-890b-47a6-9b88-3b7f53d25777 tempest-VolumesDeleteCascade-1232137414 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-17423d1c-1343-41de-888a-b17bc3807c86 is being set with open permissions: ugo+rw Aug 28 09:39:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9e348c1c-890b-47a6-9b88-3b7f53d25777 tempest-VolumesDeleteCascade-1232137414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-17423d1c-1343-41de-888a-b17bc3807c86 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:46 devstack sudo[96582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-17423d1c-1343-41de-888a-b17bc3807c86 Aug 28 09:39:46 devstack sudo[96582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:46 devstack sudo[96581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8 Aug 28 09:39:46 devstack sudo[96581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:46 devstack sudo[96582]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9e348c1c-890b-47a6-9b88-3b7f53d25777 tempest-VolumesDeleteCascade-1232137414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-17423d1c-1343-41de-888a-b17bc3807c86" returned: 0 in 0.258s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:46 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-9e348c1c-890b-47a6-9b88-3b7f53d25777 tempest-VolumesDeleteCascade-1232137414 None] Lock "cinder-quobyte-17423d1c-1343-41de-888a-b17bc3807c86" released by "_copy_volume_from_snapshot" :: held 7.364s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:39:46 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-9e348c1c-890b-47a6-9b88-3b7f53d25777 tempest-VolumesDeleteCascade-1232137414 None] Lock "cinder-quobyte-96711593-2a42-4d51-85d8-600a4a3ab547-17423d1c-1343-41de-888a-b17bc3807c86" released by "_create_volume_from_snapshot" :: held 7.448s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:39:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-9e348c1c-890b-47a6-9b88-3b7f53d25777 tempest-VolumesDeleteCascade-1232137414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.475s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:39:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-5424d158-24d0-4a89-8c49-20c463f6cfff tempest-GroupsV314Test-865056381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.583s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:39:46 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-5424d158-24d0-4a89-8c49-20c463f6cfff tempest-GroupsV314Test-865056381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=41753295-33c3-4904-91b0-c13b5c0909f7,created_at=2026-08-28T07:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-35246880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=41753295-33c3-4904-91b0-c13b5c0909f7,host='devstack@QuobyteHD#QuobyteHD',id=6a436825-aaee-4332-9d52-4a5336589cb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c18f403769c455885b8738760af7793',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:39:43Z,use_quota=True,user_id='f091628f264149528360c35dcd524a92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d17a4ab8-1ad4-44a3-84bf-9e82d8d375e8),volume_type_id=d17a4ab8-1ad4-44a3-84bf-9e82d8d375e8)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:39:46 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-5424d158-24d0-4a89-8c49-20c463f6cfff tempest-GroupsV314Test-865056381 None] Creating volume 6a436825-aaee-4332-9d52-4a5336589cb0 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:39:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-5424d158-24d0-4a89-8c49-20c463f6cfff tempest-GroupsV314Test-865056381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:39:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-5424d158-24d0-4a89-8c49-20c463f6cfff tempest-GroupsV314Test-865056381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:39:46 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-5424d158-24d0-4a89-8c49-20c463f6cfff tempest-GroupsV314Test-865056381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:39:46 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-5424d158-24d0-4a89-8c49-20c463f6cfff tempest-GroupsV314Test-865056381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:39:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-5424d158-24d0-4a89-8c49-20c463f6cfff tempest-GroupsV314Test-865056381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:39:46 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-5424d158-24d0-4a89-8c49-20c463f6cfff tempest-GroupsV314Test-865056381 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:39:46 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-5424d158-24d0-4a89-8c49-20c463f6cfff tempest-GroupsV314Test-865056381 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:39:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5424d158-24d0-4a89-8c49-20c463f6cfff tempest-GroupsV314Test-865056381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:46 devstack sudo[96581]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9aa49759-bacf-4f8f-b1ed-ccee90b10aa6 tempest-SnapshotsActionsTest-765698309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8" returned: 0 in 0.394s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:46 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-9aa49759-bacf-4f8f-b1ed-ccee90b10aa6 tempest-SnapshotsActionsTest-765698309 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2694b58b-5a76-451f-880b-8d714f34d880(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:39:46 devstack sudo[96589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0 1073741824 Aug 28 09:39:46 devstack sudo[96589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:46 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5778e6-b87d-4446-a8c4-4581ee4bfa66]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:39:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9aa49759-bacf-4f8f-b1ed-ccee90b10aa6 tempest-SnapshotsActionsTest-765698309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:46 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-9e348c1c-890b-47a6-9b88-3b7f53d25777 tempest-VolumesDeleteCascade-1232137414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (090e997a-0f21-4322-a7c7-1a3657911e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17423d1c-1343-41de-888a-b17bc3807c86', 'volume_size': 1, 'snapshot_id': '96711593-2a42-4d51-85d8-600a4a3ab547'}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:46 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-9e348c1c-890b-47a6-9b88-3b7f53d25777 tempest-VolumesDeleteCascade-1232137414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fb13e94-e987-426b-bb7d-3841be4a94e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:46 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-9e348c1c-890b-47a6-9b88-3b7f53d25777 tempest-VolumesDeleteCascade-1232137414 None] Volume volume-17423d1c-1343-41de-888a-b17bc3807c86 (17423d1c-1343-41de-888a-b17bc3807c86): created successfully Aug 28 09:39:46 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-9e348c1c-890b-47a6-9b88-3b7f53d25777 tempest-VolumesDeleteCascade-1232137414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fb13e94-e987-426b-bb7d-3841be4a94e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:46 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-9e348c1c-890b-47a6-9b88-3b7f53d25777 tempest-VolumesDeleteCascade-1232137414 None] Flow 'volume_create_manager' (f73ea653-9125-4663-a104-1b6758741a5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:39:46 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-9e348c1c-890b-47a6-9b88-3b7f53d25777 tempest-VolumesDeleteCascade-1232137414 None] Created volume successfully. Aug 28 09:39:46 devstack sudo[96591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880 Aug 28 09:39:46 devstack sudo[96591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:46 devstack sudo[96589]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5424d158-24d0-4a89-8c49-20c463f6cfff tempest-GroupsV314Test-865056381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0 1073741824" returned: 0 in 0.511s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:46 devstack sudo[96591]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9aa49759-bacf-4f8f-b1ed-ccee90b10aa6 tempest-SnapshotsActionsTest-765698309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880" returned: 0 in 0.486s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9aa49759-bacf-4f8f-b1ed-ccee90b10aa6 tempest-SnapshotsActionsTest-765698309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:46 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6d732e9c-b338-439a-852a-a7c90b253483 tempest-VolumesDeleteCascade-1232137414 None] Acquiring lock "cinder-4d6c688e-44ae-4a43-9bc7-7ba49f788f04-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:39:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5424d158-24d0-4a89-8c49-20c463f6cfff tempest-GroupsV314Test-865056381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:46 devstack sudo[96600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8 Aug 28 09:39:46 devstack sudo[96600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:47 devstack sudo[96601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0 Aug 28 09:39:47 devstack sudo[96601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:47 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6d732e9c-b338-439a-852a-a7c90b253483 tempest-VolumesDeleteCascade-1232137414 None] Lock "cinder-4d6c688e-44ae-4a43-9bc7-7ba49f788f04-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:39:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6d732e9c-b338-439a-852a-a7c90b253483 tempest-VolumesDeleteCascade-1232137414 None] Performing cascade delete. {{(pid=86081) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 28 09:39:47 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6d732e9c-b338-439a-852a-a7c90b253483 tempest-VolumesDeleteCascade-1232137414 None] Acquiring lock "cinder-96711593-2a42-4d51-85d8-600a4a3ab547-delete_snapshot" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:39:47 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6d732e9c-b338-439a-852a-a7c90b253483 tempest-VolumesDeleteCascade-1232137414 None] Lock "cinder-96711593-2a42-4d51-85d8-600a4a3ab547-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:39:47 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6d732e9c-b338-439a-852a-a7c90b253483 tempest-VolumesDeleteCascade-1232137414 None] Acquiring lock "cinder-quobyte-4d6c688e-44ae-4a43-9bc7-7ba49f788f04" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:39:47 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6d732e9c-b338-439a-852a-a7c90b253483 tempest-VolumesDeleteCascade-1232137414 None] Lock "cinder-quobyte-4d6c688e-44ae-4a43-9bc7-7ba49f788f04" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:39:47 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6d732e9c-b338-439a-852a-a7c90b253483 tempest-VolumesDeleteCascade-1232137414 None] Acquiring lock "cinder-quobyte-96711593-2a42-4d51-85d8-600a4a3ab547" by "_delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:39:47 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6d732e9c-b338-439a-852a-a7c90b253483 tempest-VolumesDeleteCascade-1232137414 None] Lock "cinder-quobyte-96711593-2a42-4d51-85d8-600a4a3ab547" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:39:47 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-6d732e9c-b338-439a-852a-a7c90b253483 tempest-VolumesDeleteCascade-1232137414 None] Deleting offline snapshot 96711593-2a42-4d51-85d8-600a4a3ab547 of volume 4d6c688e-44ae-4a43-9bc7-7ba49f788f04 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:39:47 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-6d732e9c-b338-439a-852a-a7c90b253483 tempest-VolumesDeleteCascade-1232137414 None] snapshot_file for this snap is: volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04.96711593-2a42-4d51-85d8-600a4a3ab547 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:39:47 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad85a1bc-62ae-4d43-8dad-ef01ba9b4329]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:39:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6d732e9c-b338-439a-852a-a7c90b253483 tempest-VolumesDeleteCascade-1232137414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04.96711593-2a42-4d51-85d8-600a4a3ab547 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:47 devstack sudo[96601]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5424d158-24d0-4a89-8c49-20c463f6cfff tempest-GroupsV314Test-865056381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0" returned: 0 in 0.342s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:47 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-5424d158-24d0-4a89-8c49-20c463f6cfff tempest-GroupsV314Test-865056381 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:39:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-5424d158-24d0-4a89-8c49-20c463f6cfff tempest-GroupsV314Test-865056381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:39:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-85c1a736-c509-4de6-947e-3c49110b628d tempest-TestServerVolumeAttachmentScenario-1064473967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.157s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:39:47 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-85c1a736-c509-4de6-947e-3c49110b628d tempest-TestServerVolumeAttachmentScenario-1064473967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1341795979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68ac8c7b-bf60-48a2-b0e0-c507cc572d83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00f445b42931424280f85357bd4c4997',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:39:43Z,use_quota=True,user_id='1e547c4210f04355b142dd68b736912d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:39:47 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-85c1a736-c509-4de6-947e-3c49110b628d tempest-TestServerVolumeAttachmentScenario-1064473967 None] Creating volume 68ac8c7b-bf60-48a2-b0e0-c507cc572d83 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:39:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-85c1a736-c509-4de6-947e-3c49110b628d tempest-TestServerVolumeAttachmentScenario-1064473967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:39:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-85c1a736-c509-4de6-947e-3c49110b628d tempest-TestServerVolumeAttachmentScenario-1064473967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:39:47 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-85c1a736-c509-4de6-947e-3c49110b628d tempest-TestServerVolumeAttachmentScenario-1064473967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:39:47 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-85c1a736-c509-4de6-947e-3c49110b628d tempest-TestServerVolumeAttachmentScenario-1064473967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:39:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-85c1a736-c509-4de6-947e-3c49110b628d tempest-TestServerVolumeAttachmentScenario-1064473967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:39:47 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-85c1a736-c509-4de6-947e-3c49110b628d tempest-TestServerVolumeAttachmentScenario-1064473967 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:39:47 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-85c1a736-c509-4de6-947e-3c49110b628d tempest-TestServerVolumeAttachmentScenario-1064473967 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:39:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-85c1a736-c509-4de6-947e-3c49110b628d tempest-TestServerVolumeAttachmentScenario-1064473967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-68ac8c7b-bf60-48a2-b0e0-c507cc572d83 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:47 devstack sudo[96606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04.96711593-2a42-4d51-85d8-600a4a3ab547 Aug 28 09:39:47 devstack sudo[96606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5424d158-24d0-4a89-8c49-20c463f6cfff tempest-GroupsV314Test-865056381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67f418f9-9756-4af3-9ac0-f028f3b170a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a436825-aaee-4332-9d52-4a5336589cb0', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:47 devstack sudo[96609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-68ac8c7b-bf60-48a2-b0e0-c507cc572d83 1073741824 Aug 28 09:39:47 devstack sudo[96609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:47 devstack sudo[96600]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5424d158-24d0-4a89-8c49-20c463f6cfff tempest-GroupsV314Test-865056381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc65c48a-2d5b-414e-bcc1-e3788d350eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9aa49759-bacf-4f8f-b1ed-ccee90b10aa6 tempest-SnapshotsActionsTest-765698309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8" returned: 0 in 0.441s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9aa49759-bacf-4f8f-b1ed-ccee90b10aa6 tempest-SnapshotsActionsTest-765698309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:47 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-5424d158-24d0-4a89-8c49-20c463f6cfff tempest-GroupsV314Test-865056381 None] Volume volume-6a436825-aaee-4332-9d52-4a5336589cb0 (6a436825-aaee-4332-9d52-4a5336589cb0): created successfully Aug 28 09:39:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5424d158-24d0-4a89-8c49-20c463f6cfff tempest-GroupsV314Test-865056381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc65c48a-2d5b-414e-bcc1-e3788d350eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:47 devstack sudo[96612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8 Aug 28 09:39:47 devstack sudo[96612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5424d158-24d0-4a89-8c49-20c463f6cfff tempest-GroupsV314Test-865056381 None] Flow 'volume_create_manager' (1cdf00ce-1c2b-4d43-8ecd-bae15381b290) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:39:47 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-5424d158-24d0-4a89-8c49-20c463f6cfff tempest-GroupsV314Test-865056381 None] Created volume successfully. Aug 28 09:39:47 devstack sudo[96606]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6d732e9c-b338-439a-852a-a7c90b253483 tempest-VolumesDeleteCascade-1232137414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04.96711593-2a42-4d51-85d8-600a4a3ab547" returned: 0 in 0.466s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:47 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-6d732e9c-b338-439a-852a-a7c90b253483 tempest-VolumesDeleteCascade-1232137414 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:39:47 devstack sudo[96612]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:47 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[2106ad36-957d-4511-bf48-88a39cbc74b5]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:39:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6d732e9c-b338-439a-852a-a7c90b253483 tempest-VolumesDeleteCascade-1232137414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9aa49759-bacf-4f8f-b1ed-ccee90b10aa6 tempest-SnapshotsActionsTest-765698309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880.dee06454-4775-43ec-858a-23fd58abd6c8" returned: 0 in 0.353s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:47 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-9aa49759-bacf-4f8f-b1ed-ccee90b10aa6 tempest-SnapshotsActionsTest-765698309 None] Lock "cinder-quobyte-dee06454-4775-43ec-858a-23fd58abd6c8" released by "_delete_snapshot" :: held 1.859s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:39:47 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-9aa49759-bacf-4f8f-b1ed-ccee90b10aa6 tempest-SnapshotsActionsTest-765698309 None] Lock "cinder-quobyte-2694b58b-5a76-451f-880b-8d714f34d880" released by "delete_snapshot" :: held 1.898s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:39:47 devstack sudo[96621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04 Aug 28 09:39:47 devstack sudo[96621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:47 devstack sudo[96609]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-85c1a736-c509-4de6-947e-3c49110b628d tempest-TestServerVolumeAttachmentScenario-1064473967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-68ac8c7b-bf60-48a2-b0e0-c507cc572d83 1073741824" returned: 0 in 0.526s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:47 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-9aa49759-bacf-4f8f-b1ed-ccee90b10aa6 tempest-SnapshotsActionsTest-765698309 None] Created reservations ['ab76a7d7-9251-41d0-9067-0ffc2e6d45ac', '32e8b628-cce0-4699-9de6-b17b31901a96', '3ad6fb74-3d6c-4240-82cb-016664ebcb46', '738b7a2b-2a65-42e9-8b25-98f720a04900'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:39:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-85c1a736-c509-4de6-947e-3c49110b628d tempest-TestServerVolumeAttachmentScenario-1064473967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-68ac8c7b-bf60-48a2-b0e0-c507cc572d83 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:47 devstack sudo[96624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-68ac8c7b-bf60-48a2-b0e0-c507cc572d83 Aug 28 09:39:47 devstack sudo[96624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:47 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-9aa49759-bacf-4f8f-b1ed-ccee90b10aa6 tempest-SnapshotsActionsTest-765698309 None] Delete snapshot completed successfully. Aug 28 09:39:47 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-9aa49759-bacf-4f8f-b1ed-ccee90b10aa6 tempest-SnapshotsActionsTest-765698309 None] Lock "cinder-dee06454-4775-43ec-858a-23fd58abd6c8-delete_snapshot" released by "delete_snapshot" :: held 2.160s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:39:48 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-43290928-ec79-4ea6-9530-6e0b1507fb59 tempest-SnapshotsActionsTest-765698309 None] Acquiring lock "cinder-2694b58b-5a76-451f-880b-8d714f34d880-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:39:48 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-43290928-ec79-4ea6-9530-6e0b1507fb59 tempest-SnapshotsActionsTest-765698309 None] Lock "cinder-2694b58b-5a76-451f-880b-8d714f34d880-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:39:48 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-43290928-ec79-4ea6-9530-6e0b1507fb59 tempest-SnapshotsActionsTest-765698309 None] Acquiring lock "cinder-quobyte-2694b58b-5a76-451f-880b-8d714f34d880" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:39:48 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-43290928-ec79-4ea6-9530-6e0b1507fb59 tempest-SnapshotsActionsTest-765698309 None] Lock "cinder-quobyte-2694b58b-5a76-451f-880b-8d714f34d880" acquired by "delete_volume" :: waited 0.029s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:39:48 devstack sudo[96624]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:48 devstack sudo[96621]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:48 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b877a8-519b-4a19-a40c-872c95eeb94f]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:39:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-43290928-ec79-4ea6-9530-6e0b1507fb59 tempest-SnapshotsActionsTest-765698309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6d732e9c-b338-439a-852a-a7c90b253483 tempest-VolumesDeleteCascade-1232137414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04" returned: 0 in 0.768s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-85c1a736-c509-4de6-947e-3c49110b628d tempest-TestServerVolumeAttachmentScenario-1064473967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-68ac8c7b-bf60-48a2-b0e0-c507cc572d83" returned: 0 in 0.583s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6d732e9c-b338-439a-852a-a7c90b253483 tempest-VolumesDeleteCascade-1232137414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04.96711593-2a42-4d51-85d8-600a4a3ab547 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:48 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-85c1a736-c509-4de6-947e-3c49110b628d tempest-TestServerVolumeAttachmentScenario-1064473967 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:39:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-85c1a736-c509-4de6-947e-3c49110b628d tempest-TestServerVolumeAttachmentScenario-1064473967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:39:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-4520e5a5-f71f-446d-a59f-dd2ce3bb3b81 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.127s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:39:48 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-4520e5a5-f71f-446d-a59f-dd2ce3bb3b81 tempest-TestServerVolumeAttachmentScenario-1064473967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-172121087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df4f9f4e-2a7a-4b0f-a489-c3aebc7cf713,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00f445b42931424280f85357bd4c4997',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:39:44Z,use_quota=True,user_id='1e547c4210f04355b142dd68b736912d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:39:48 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-4520e5a5-f71f-446d-a59f-dd2ce3bb3b81 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Creating volume df4f9f4e-2a7a-4b0f-a489-c3aebc7cf713 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:39:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-4520e5a5-f71f-446d-a59f-dd2ce3bb3b81 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:39:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-4520e5a5-f71f-446d-a59f-dd2ce3bb3b81 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:39:48 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-4520e5a5-f71f-446d-a59f-dd2ce3bb3b81 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:39:48 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-4520e5a5-f71f-446d-a59f-dd2ce3bb3b81 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:39:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-4520e5a5-f71f-446d-a59f-dd2ce3bb3b81 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:39:48 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-4520e5a5-f71f-446d-a59f-dd2ce3bb3b81 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:39:48 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-4520e5a5-f71f-446d-a59f-dd2ce3bb3b81 tempest-TestServerVolumeAttachmentScenario-1064473967 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:39:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4520e5a5-f71f-446d-a59f-dd2ce3bb3b81 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-df4f9f4e-2a7a-4b0f-a489-c3aebc7cf713 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:48 devstack sudo[96634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04.96711593-2a42-4d51-85d8-600a4a3ab547 Aug 28 09:39:48 devstack sudo[96634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:48 devstack sudo[96636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-df4f9f4e-2a7a-4b0f-a489-c3aebc7cf713 1073741824 Aug 28 09:39:48 devstack sudo[96636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:48 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-85c1a736-c509-4de6-947e-3c49110b628d tempest-TestServerVolumeAttachmentScenario-1064473967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cc0113b-0e8c-477e-ac6f-369a11bb6468) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68ac8c7b-bf60-48a2-b0e0-c507cc572d83', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:48 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-85c1a736-c509-4de6-947e-3c49110b628d tempest-TestServerVolumeAttachmentScenario-1064473967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ca1b10e-dff6-4553-a9ae-ba1d18b9cfc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:48 devstack sudo[96633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880 Aug 28 09:39:48 devstack sudo[96633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:48 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-85c1a736-c509-4de6-947e-3c49110b628d tempest-TestServerVolumeAttachmentScenario-1064473967 None] Volume volume-68ac8c7b-bf60-48a2-b0e0-c507cc572d83 (68ac8c7b-bf60-48a2-b0e0-c507cc572d83): created successfully Aug 28 09:39:48 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-85c1a736-c509-4de6-947e-3c49110b628d tempest-TestServerVolumeAttachmentScenario-1064473967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ca1b10e-dff6-4553-a9ae-ba1d18b9cfc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:48 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-85c1a736-c509-4de6-947e-3c49110b628d tempest-TestServerVolumeAttachmentScenario-1064473967 None] Flow 'volume_create_manager' (24cb8fc6-871f-4988-a146-1dded9f72d18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:39:48 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-85c1a736-c509-4de6-947e-3c49110b628d tempest-TestServerVolumeAttachmentScenario-1064473967 None] Created volume successfully. Aug 28 09:39:48 devstack sudo[96634]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6d732e9c-b338-439a-852a-a7c90b253483 tempest-VolumesDeleteCascade-1232137414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04.96711593-2a42-4d51-85d8-600a4a3ab547" returned: 0 in 0.491s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6d732e9c-b338-439a-852a-a7c90b253483 tempest-VolumesDeleteCascade-1232137414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04.96711593-2a42-4d51-85d8-600a4a3ab547 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:49 devstack sudo[96649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04.96711593-2a42-4d51-85d8-600a4a3ab547 Aug 28 09:39:49 devstack sudo[96649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:49 devstack sudo[96633]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-43290928-ec79-4ea6-9530-6e0b1507fb59 tempest-SnapshotsActionsTest-765698309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880" returned: 0 in 0.606s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-43290928-ec79-4ea6-9530-6e0b1507fb59 tempest-SnapshotsActionsTest-765698309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:39:49 devstack sudo[96652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880 Aug 28 09:39:49 devstack sudo[96652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:49 devstack sudo[96636]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4520e5a5-f71f-446d-a59f-dd2ce3bb3b81 tempest-TestServerVolumeAttachmentScenario-1064473967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-df4f9f4e-2a7a-4b0f-a489-c3aebc7cf713 1073741824" returned: 0 in 0.622s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4520e5a5-f71f-446d-a59f-dd2ce3bb3b81 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-df4f9f4e-2a7a-4b0f-a489-c3aebc7cf713 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:49 devstack sudo[96654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-df4f9f4e-2a7a-4b0f-a489-c3aebc7cf713 Aug 28 09:39:49 devstack sudo[96654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:49 devstack sudo[96649]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6d732e9c-b338-439a-852a-a7c90b253483 tempest-VolumesDeleteCascade-1232137414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04.96711593-2a42-4d51-85d8-600a4a3ab547" returned: 0 in 0.434s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:49 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6d732e9c-b338-439a-852a-a7c90b253483 tempest-VolumesDeleteCascade-1232137414 None] Lock "cinder-quobyte-96711593-2a42-4d51-85d8-600a4a3ab547" released by "_delete_snapshot" :: held 2.318s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:39:49 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6d732e9c-b338-439a-852a-a7c90b253483 tempest-VolumesDeleteCascade-1232137414 None] Lock "cinder-quobyte-4d6c688e-44ae-4a43-9bc7-7ba49f788f04" released by "delete_snapshot" :: held 2.357s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:39:49 devstack sudo[96652]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-43290928-ec79-4ea6-9530-6e0b1507fb59 tempest-SnapshotsActionsTest-765698309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2694b58b-5a76-451f-880b-8d714f34d880" returned: 0 in 0.448s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:49 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-43290928-ec79-4ea6-9530-6e0b1507fb59 tempest-SnapshotsActionsTest-765698309 None] Lock "cinder-quobyte-2694b58b-5a76-451f-880b-8d714f34d880" released by "delete_volume" :: held 1.148s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:39:49 devstack sudo[96654]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4520e5a5-f71f-446d-a59f-dd2ce3bb3b81 tempest-TestServerVolumeAttachmentScenario-1064473967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-df4f9f4e-2a7a-4b0f-a489-c3aebc7cf713" returned: 0 in 0.389s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:49 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-4520e5a5-f71f-446d-a59f-dd2ce3bb3b81 tempest-TestServerVolumeAttachmentScenario-1064473967 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:39:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-4520e5a5-f71f-446d-a59f-dd2ce3bb3b81 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:39:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.484s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:39:49 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] Cloning volume 6a436825-aaee-4332-9d52-4a5336589cb0 to volume 6678db6a-8dfa-4441-a3df-43a496dc8fcb Aug 28 09:39:49 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-4520e5a5-f71f-446d-a59f-dd2ce3bb3b81 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a075ad7e-3919-4d6b-a718-7a23de5b149a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df4f9f4e-2a7a-4b0f-a489-c3aebc7cf713', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:49 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-4520e5a5-f71f-446d-a59f-dd2ce3bb3b81 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8272ab7-e04d-4cd8-9d37-cd4cf729ca83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:39:49 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-43290928-ec79-4ea6-9530-6e0b1507fb59 tempest-SnapshotsActionsTest-765698309 None] Created reservations ['fb4c17db-4c91-4560-8a81-ff1c0c8bcdf1', '9d762921-537f-4076-9284-67da4a01354d', 'f5c3e07b-8cb9-43fd-9b50-3e88b2850790', '4df16527-3198-4127-90dc-97fbd5d9cff3'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:39:49 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-6d732e9c-b338-439a-852a-a7c90b253483 tempest-VolumesDeleteCascade-1232137414 None] Created reservations ['3990f737-3ad9-4c20-93ab-61f82399a01d', '92e75f67-933f-43a7-b625-4df376aab636', '19a33420-ad40-45c7-8574-8a2540bca116', 'fdbb61a9-462f-4f11-95fb-de39e68cc077'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:39:49 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-4520e5a5-f71f-446d-a59f-dd2ce3bb3b81 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Volume volume-df4f9f4e-2a7a-4b0f-a489-c3aebc7cf713 (df4f9f4e-2a7a-4b0f-a489-c3aebc7cf713): created successfully Aug 28 09:39:49 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-4520e5a5-f71f-446d-a59f-dd2ce3bb3b81 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8272ab7-e04d-4cd8-9d37-cd4cf729ca83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:39:49 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-4520e5a5-f71f-446d-a59f-dd2ce3bb3b81 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Flow 'volume_create_manager' (92d418ca-a65c-4497-bd50-acd1704fc23c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:39:49 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] Creating offline snapshot ffc9c1fb-d258-49e8-88d7-b824e0a22433 of volume 6a436825-aaee-4332-9d52-4a5336589cb0 {{(pid=86081) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:39:49 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-4520e5a5-f71f-446d-a59f-dd2ce3bb3b81 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Created volume successfully. Aug 28 09:39:49 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ac2d42-d80f-4fd2-982a-7c5ce8da8801]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:39:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-43290928-ec79-4ea6-9530-6e0b1507fb59 tempest-SnapshotsActionsTest-765698309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:39:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-43290928-ec79-4ea6-9530-6e0b1507fb59 tempest-SnapshotsActionsTest-765698309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:39:49 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-43290928-ec79-4ea6-9530-6e0b1507fb59 tempest-SnapshotsActionsTest-765698309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:39:49 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-43290928-ec79-4ea6-9530-6e0b1507fb59 tempest-SnapshotsActionsTest-765698309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:39:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-43290928-ec79-4ea6-9530-6e0b1507fb59 tempest-SnapshotsActionsTest-765698309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:39:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-43290928-ec79-4ea6-9530-6e0b1507fb59 tempest-SnapshotsActionsTest-765698309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:49 devstack sudo[96660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:39:49 devstack sudo[96660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:49 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-6d732e9c-b338-439a-852a-a7c90b253483 tempest-VolumesDeleteCascade-1232137414 None] Delete snapshot completed successfully. Aug 28 09:39:49 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6d732e9c-b338-439a-852a-a7c90b253483 tempest-VolumesDeleteCascade-1232137414 None] Lock "cinder-96711593-2a42-4d51-85d8-600a4a3ab547-delete_snapshot" released by "delete_snapshot" :: held 2.818s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:39:49 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6d732e9c-b338-439a-852a-a7c90b253483 tempest-VolumesDeleteCascade-1232137414 None] Snapshots deleted, issuing volume delete {{(pid=86081) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 28 09:39:49 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6d732e9c-b338-439a-852a-a7c90b253483 tempest-VolumesDeleteCascade-1232137414 None] Acquiring lock "cinder-quobyte-4d6c688e-44ae-4a43-9bc7-7ba49f788f04" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:39:49 devstack sudo[96659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0 Aug 28 09:39:49 devstack sudo[96659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:49 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6d732e9c-b338-439a-852a-a7c90b253483 tempest-VolumesDeleteCascade-1232137414 None] Lock "cinder-quobyte-4d6c688e-44ae-4a43-9bc7-7ba49f788f04" acquired by "delete_volume" :: waited 0.021s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:39:50 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21ee12c-2d10-45f2-bd6d-baccbcb28f3c]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:39:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6d732e9c-b338-439a-852a-a7c90b253483 tempest-VolumesDeleteCascade-1232137414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:50 devstack sudo[96663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04 Aug 28 09:39:50 devstack sudo[96663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:50 devstack sudo[96660]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-43290928-ec79-4ea6-9530-6e0b1507fb59 tempest-SnapshotsActionsTest-765698309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.374s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:50 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-43290928-ec79-4ea6-9530-6e0b1507fb59 tempest-SnapshotsActionsTest-765698309 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:39:50 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-43290928-ec79-4ea6-9530-6e0b1507fb59 tempest-SnapshotsActionsTest-765698309 None] Deleted volume successfully. Aug 28 09:39:50 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-43290928-ec79-4ea6-9530-6e0b1507fb59 tempest-SnapshotsActionsTest-765698309 None] Lock "cinder-2694b58b-5a76-451f-880b-8d714f34d880-delete_volume" released by "delete_volume" :: held 1.970s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:39:50 devstack sudo[96659]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0" returned: 0 in 0.536s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0.ffc9c1fb-d258-49e8-88d7-b824e0a22433 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:50 devstack sudo[96671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0.ffc9c1fb-d258-49e8-88d7-b824e0a22433 1G Aug 28 09:39:50 devstack sudo[96671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:50 devstack sudo[96663]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6d732e9c-b338-439a-852a-a7c90b253483 tempest-VolumesDeleteCascade-1232137414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04" returned: 0 in 0.557s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6d732e9c-b338-439a-852a-a7c90b253483 tempest-VolumesDeleteCascade-1232137414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:50 devstack sudo[96679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04 Aug 28 09:39:50 devstack sudo[96679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:50 devstack sudo[96679]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6d732e9c-b338-439a-852a-a7c90b253483 tempest-VolumesDeleteCascade-1232137414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4d6c688e-44ae-4a43-9bc7-7ba49f788f04" returned: 0 in 0.366s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:50 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6d732e9c-b338-439a-852a-a7c90b253483 tempest-VolumesDeleteCascade-1232137414 None] Lock "cinder-quobyte-4d6c688e-44ae-4a43-9bc7-7ba49f788f04" released by "delete_volume" :: held 1.034s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:39:50 devstack sudo[96671]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0.ffc9c1fb-d258-49e8-88d7-b824e0a22433 1G" returned: 0 in 0.663s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a436825-aaee-4332-9d52-4a5336589cb0 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0.ffc9c1fb-d258-49e8-88d7-b824e0a22433 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:51 devstack sudo[96694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a436825-aaee-4332-9d52-4a5336589cb0 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0.ffc9c1fb-d258-49e8-88d7-b824e0a22433 Aug 28 09:39:51 devstack sudo[96694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:51 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-6d732e9c-b338-439a-852a-a7c90b253483 tempest-VolumesDeleteCascade-1232137414 None] Created reservations ['943279a5-8de2-4537-95a7-2c546497c0f1', '53460ee9-c004-4b4f-bc1d-96c2b3f082e8', '97f120f0-6189-49c2-bffc-46acebf66f95', '83bb5c29-bfb4-4834-93fe-8840d634c038'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:39:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-6d732e9c-b338-439a-852a-a7c90b253483 tempest-VolumesDeleteCascade-1232137414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:39:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-6d732e9c-b338-439a-852a-a7c90b253483 tempest-VolumesDeleteCascade-1232137414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:39:51 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-6d732e9c-b338-439a-852a-a7c90b253483 tempest-VolumesDeleteCascade-1232137414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:39:51 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-6d732e9c-b338-439a-852a-a7c90b253483 tempest-VolumesDeleteCascade-1232137414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:39:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-6d732e9c-b338-439a-852a-a7c90b253483 tempest-VolumesDeleteCascade-1232137414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:39:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6d732e9c-b338-439a-852a-a7c90b253483 tempest-VolumesDeleteCascade-1232137414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:51 devstack sudo[96699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:39:51 devstack sudo[96699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:51 devstack sudo[96694]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:51 devstack sudo[96699]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a436825-aaee-4332-9d52-4a5336589cb0 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0.ffc9c1fb-d258-49e8-88d7-b824e0a22433" returned: 0 in 0.551s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:51 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0.ffc9c1fb-d258-49e8-88d7-b824e0a22433 is being set with open permissions: ugo+rw: NotImplementedError Aug 28 09:39:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0.ffc9c1fb-d258-49e8-88d7-b824e0a22433 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6d732e9c-b338-439a-852a-a7c90b253483 tempest-VolumesDeleteCascade-1232137414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.358s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:51 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-6d732e9c-b338-439a-852a-a7c90b253483 tempest-VolumesDeleteCascade-1232137414 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:39:51 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-6d732e9c-b338-439a-852a-a7c90b253483 tempest-VolumesDeleteCascade-1232137414 None] Deleted volume successfully. Aug 28 09:39:51 devstack sudo[96705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0.ffc9c1fb-d258-49e8-88d7-b824e0a22433 Aug 28 09:39:51 devstack sudo[96705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:51 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6d732e9c-b338-439a-852a-a7c90b253483 tempest-VolumesDeleteCascade-1232137414 None] Lock "cinder-4d6c688e-44ae-4a43-9bc7-7ba49f788f04-delete_volume" released by "delete_volume" :: held 4.616s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:39:51 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-80a25a6d-80a2-4171-8971-c09c16da55ad tempest-VolumesDeleteCascade-1232137414 None] Acquiring lock "cinder-17423d1c-1343-41de-888a-b17bc3807c86-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:39:51 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-80a25a6d-80a2-4171-8971-c09c16da55ad tempest-VolumesDeleteCascade-1232137414 None] Lock "cinder-17423d1c-1343-41de-888a-b17bc3807c86-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:39:51 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-80a25a6d-80a2-4171-8971-c09c16da55ad tempest-VolumesDeleteCascade-1232137414 None] Acquiring lock "cinder-quobyte-17423d1c-1343-41de-888a-b17bc3807c86" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:39:51 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-80a25a6d-80a2-4171-8971-c09c16da55ad tempest-VolumesDeleteCascade-1232137414 None] Lock "cinder-quobyte-17423d1c-1343-41de-888a-b17bc3807c86" acquired by "delete_volume" :: waited 0.025s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:39:51 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[acaeea28-721c-4ce6-89c5-d180c478d91a]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:39:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-80a25a6d-80a2-4171-8971-c09c16da55ad tempest-VolumesDeleteCascade-1232137414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-17423d1c-1343-41de-888a-b17bc3807c86 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:51 devstack sudo[96705]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0.ffc9c1fb-d258-49e8-88d7-b824e0a22433" returned: 0 in 0.327s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:51 devstack sudo[96711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0.info Aug 28 09:39:51 devstack sudo[96711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:52 devstack sudo[96708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-17423d1c-1343-41de-888a-b17bc3807c86 Aug 28 09:39:52 devstack sudo[96708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:52 devstack sudo[96711]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0.info" returned: 0 in 0.358s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:52 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0.info is being set with open permissions: ugo+rw: NotImplementedError Aug 28 09:39:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:52 devstack sudo[96715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0.info Aug 28 09:39:52 devstack sudo[96715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:52 devstack sudo[96708]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-80a25a6d-80a2-4171-8971-c09c16da55ad tempest-VolumesDeleteCascade-1232137414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-17423d1c-1343-41de-888a-b17bc3807c86" returned: 0 in 0.574s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-80a25a6d-80a2-4171-8971-c09c16da55ad tempest-VolumesDeleteCascade-1232137414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-17423d1c-1343-41de-888a-b17bc3807c86 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:52 devstack sudo[96720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-17423d1c-1343-41de-888a-b17bc3807c86 Aug 28 09:39:52 devstack sudo[96720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:52 devstack sudo[96715]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0.info" returned: 0 in 0.321s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:52 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] Acquiring lock "cinder-quobyte-6678db6a-8dfa-4441-a3df-43a496dc8fcb" by "_copy_volume_from_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:39:52 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] Lock "cinder-quobyte-6678db6a-8dfa-4441-a3df-43a496dc8fcb" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:39:52 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] snapshot: ffc9c1fb-d258-49e8-88d7-b824e0a22433, volume: 6678db6a-8dfa-4441-a3df-43a496dc8fcb, {{(pid=86081) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 28 09:39:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:39:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:39:52 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:39:52 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:39:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:39:52 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0485fc-18d7-43e5-98a5-2e12160dddb6]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:39:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0.ffc9c1fb-d258-49e8-88d7-b824e0a22433 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:52 devstack sudo[96720]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-80a25a6d-80a2-4171-8971-c09c16da55ad tempest-VolumesDeleteCascade-1232137414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-17423d1c-1343-41de-888a-b17bc3807c86" returned: 0 in 0.357s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:52 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-80a25a6d-80a2-4171-8971-c09c16da55ad tempest-VolumesDeleteCascade-1232137414 None] Lock "cinder-quobyte-17423d1c-1343-41de-888a-b17bc3807c86" released by "delete_volume" :: held 0.994s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:39:52 devstack sudo[96723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0.ffc9c1fb-d258-49e8-88d7-b824e0a22433 Aug 28 09:39:52 devstack sudo[96723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:52 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-80a25a6d-80a2-4171-8971-c09c16da55ad tempest-VolumesDeleteCascade-1232137414 None] Created reservations ['c0e33453-2800-4e5a-ab51-3604cb2d9825', '2d71f186-3307-4a8f-90fd-bcbfe545c0f0', 'bcb034bc-b49a-46b9-b880-17c996ee8f0c', 'd527047b-8abe-4a34-928c-9c6a15300bef'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:39:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-80a25a6d-80a2-4171-8971-c09c16da55ad tempest-VolumesDeleteCascade-1232137414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:39:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-80a25a6d-80a2-4171-8971-c09c16da55ad tempest-VolumesDeleteCascade-1232137414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:39:53 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-80a25a6d-80a2-4171-8971-c09c16da55ad tempest-VolumesDeleteCascade-1232137414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:39:53 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-80a25a6d-80a2-4171-8971-c09c16da55ad tempest-VolumesDeleteCascade-1232137414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:39:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-80a25a6d-80a2-4171-8971-c09c16da55ad tempest-VolumesDeleteCascade-1232137414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:39:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-80a25a6d-80a2-4171-8971-c09c16da55ad tempest-VolumesDeleteCascade-1232137414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:53 devstack sudo[96726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:39:53 devstack sudo[96726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:53 devstack sudo[96723]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0.ffc9c1fb-d258-49e8-88d7-b824e0a22433" returned: 0 in 0.515s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:53 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a436825-aaee-4332-9d52-4a5336589cb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:39:53 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f0e943-a45e-4ad5-b816-663877d703af]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:39:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:53 devstack sudo[96732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0 Aug 28 09:39:53 devstack sudo[96732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:39:53 devstack sudo[96726]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-80a25a6d-80a2-4171-8971-c09c16da55ad tempest-VolumesDeleteCascade-1232137414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.408s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:53 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-80a25a6d-80a2-4171-8971-c09c16da55ad tempest-VolumesDeleteCascade-1232137414 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:39:53 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-80a25a6d-80a2-4171-8971-c09c16da55ad tempest-VolumesDeleteCascade-1232137414 None] Deleted volume successfully. Aug 28 09:39:53 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-80a25a6d-80a2-4171-8971-c09c16da55ad tempest-VolumesDeleteCascade-1232137414 None] Lock "cinder-17423d1c-1343-41de-888a-b17bc3807c86-delete_volume" released by "delete_volume" :: held 1.830s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:39:53 devstack sudo[96732]: pam_unix(sudo:session): session closed for user root Aug 28 09:39:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0" returned: 0 in 0.501s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:39:53 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] will copy from snapshot at /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0 {{(pid=86081) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 28 09:39:53 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] Creating direct copy from snapshot {{(pid=86081) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 28 09:39:53 devstack cinder-volume[86081]: DEBUG cinder.utils [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] Path /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6678db6a-8dfa-4441-a3df-43a496dc8fcb not found in is_blk_device check {{(pid=86081) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 28 09:39:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6678db6a-8dfa-4441-a3df-43a496dc8fcb {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:39:53 devstack sudo[96739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6678db6a-8dfa-4441-a3df-43a496dc8fcb Aug 28 09:39:53 devstack sudo[96739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:02 devstack sudo[96739]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6678db6a-8dfa-4441-a3df-43a496dc8fcb" returned: 0 in 8.948s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:02 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] Image conversion details: src /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0, size 1024.00 MB, duration 8.95 sec, destination /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6678db6a-8dfa-4441-a3df-43a496dc8fcb {{(pid=86081) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 09:40:02 devstack cinder-volume[86081]: INFO cinder.image.image_utils [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] Converted 1024.00 MB image at 114.42 MB/s Aug 28 09:40:02 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6678db6a-8dfa-4441-a3df-43a496dc8fcb is being set with open permissions: ugo+rw: NotImplementedError Aug 28 09:40:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6678db6a-8dfa-4441-a3df-43a496dc8fcb {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:02 devstack sudo[96824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6678db6a-8dfa-4441-a3df-43a496dc8fcb Aug 28 09:40:02 devstack sudo[96824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:03 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writing DB stats cinder:SELECT=99,cinder:DELETE=4,cinder:UPDATE=111,cinder:INSERT=29 {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:40:03 devstack sudo[96824]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6678db6a-8dfa-4441-a3df-43a496dc8fcb" returned: 0 in 0.445s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:03 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] Lock "cinder-quobyte-6678db6a-8dfa-4441-a3df-43a496dc8fcb" released by "_copy_volume_from_snapshot" :: held 10.512s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:40:03 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] Acquiring lock "cinder-quobyte-ffc9c1fb-d258-49e8-88d7-b824e0a22433" by "_delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:40:03 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] Lock "cinder-quobyte-ffc9c1fb-d258-49e8-88d7-b824e0a22433" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:40:03 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] Deleting offline snapshot ffc9c1fb-d258-49e8-88d7-b824e0a22433 of volume 6a436825-aaee-4332-9d52-4a5336589cb0 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:40:03 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] snapshot_file for this snap is: volume-6a436825-aaee-4332-9d52-4a5336589cb0.ffc9c1fb-d258-49e8-88d7-b824e0a22433 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:40:03 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dac9175-1be4-42be-91e5-ebbea4dacd19]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:40:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0.ffc9c1fb-d258-49e8-88d7-b824e0a22433 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:03 devstack sudo[96831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0.ffc9c1fb-d258-49e8-88d7-b824e0a22433 Aug 28 09:40:03 devstack sudo[96831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:03 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writing DB stats cinder:SELECT=105,cinder:UPDATE=118,cinder:DELETE=11,cinder:INSERT=33 {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:40:03 devstack sudo[96831]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0.ffc9c1fb-d258-49e8-88d7-b824e0a22433" returned: 0 in 0.646s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:03 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a436825-aaee-4332-9d52-4a5336589cb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:40:03 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae88c3c-6aac-4124-b018-926dd1f53164]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:40:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:04 devstack sudo[96839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0 Aug 28 09:40:04 devstack sudo[96839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:04 devstack sudo[96839]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0" returned: 0 in 0.687s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0.ffc9c1fb-d258-49e8-88d7-b824e0a22433 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:04 devstack sudo[96844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0.ffc9c1fb-d258-49e8-88d7-b824e0a22433 Aug 28 09:40:04 devstack sudo[96844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:05 devstack sudo[96844]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0.ffc9c1fb-d258-49e8-88d7-b824e0a22433" returned: 0 in 0.449s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0.ffc9c1fb-d258-49e8-88d7-b824e0a22433 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:05 devstack sudo[96850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0.ffc9c1fb-d258-49e8-88d7-b824e0a22433 Aug 28 09:40:05 devstack sudo[96850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:05 devstack sudo[96850]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0.ffc9c1fb-d258-49e8-88d7-b824e0a22433" returned: 0 in 0.504s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:05 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] Lock "cinder-quobyte-ffc9c1fb-d258-49e8-88d7-b824e0a22433" released by "_delete_snapshot" :: held 2.458s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:40:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.110s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:40:05 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-2bd741c8-2aa9-431e-9055-463c43a8ffd2 tempest-GroupsV314Test-865056381 None] Create group from source-group-41753295-33c3-4904-91b0-c13b5c0909f7 completed successfully. Aug 28 09:40:07 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-d33e7a20-d93c-44ef-9a47-198a365b98cf tempest-VolumesTransfersV355Test-438809708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:40:07 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-d33e7a20-d93c-44ef-9a47-198a365b98cf tempest-VolumesTransfersV355Test-438809708 None] Flow 'volume_create_manager' (64f31d92-4875-44f3-aa7b-879c1575ed06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:40:07 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-d33e7a20-d93c-44ef-9a47-198a365b98cf tempest-VolumesTransfersV355Test-438809708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d74a4a48-061f-4d28-96d6-1e41bb43e7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:40:07 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-d33e7a20-d93c-44ef-9a47-198a365b98cf tempest-VolumesTransfersV355Test-438809708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d74a4a48-061f-4d28-96d6-1e41bb43e7b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:40:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-974937207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48a8cd55-78b2-433c-af06-2939cee3ac09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bd62c55b2204039805ca39980e47b97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:40:07Z,use_quota=True,user_id='05ac2ff85de54501b8b864751aa2ebc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:40:07 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-d33e7a20-d93c-44ef-9a47-198a365b98cf tempest-VolumesTransfersV355Test-438809708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59efeb08-d4a7-4cb4-9ee8-5bb6c5bd36ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:40:07 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-d33e7a20-d93c-44ef-9a47-198a365b98cf tempest-VolumesTransfersV355Test-438809708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59efeb08-d4a7-4cb4-9ee8-5bb6c5bd36ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:40:07 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-d33e7a20-d93c-44ef-9a47-198a365b98cf tempest-VolumesTransfersV355Test-438809708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb1bff64-ea08-46ba-b436-37b3c246e9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:40:07 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-d33e7a20-d93c-44ef-9a47-198a365b98cf tempest-VolumesTransfersV355Test-438809708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb1bff64-ea08-46ba-b436-37b3c246e9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48a8cd55-78b2-433c-af06-2939cee3ac09', 'volume_name': 'volume-48a8cd55-78b2-433c-af06-2939cee3ac09', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:40:07 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-d33e7a20-d93c-44ef-9a47-198a365b98cf tempest-VolumesTransfersV355Test-438809708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (899af833-aa3c-4819-a681-efa743663f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:40:07 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-d33e7a20-d93c-44ef-9a47-198a365b98cf tempest-VolumesTransfersV355Test-438809708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (899af833-aa3c-4819-a681-efa743663f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:40:07 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-d33e7a20-d93c-44ef-9a47-198a365b98cf tempest-VolumesTransfersV355Test-438809708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a876c94-a383-41d0-9958-9745967e12c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:40:07 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-d33e7a20-d93c-44ef-9a47-198a365b98cf tempest-VolumesTransfersV355Test-438809708 None] Volume 48a8cd55-78b2-433c-af06-2939cee3ac09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48a8cd55-78b2-433c-af06-2939cee3ac09', 'volume_size': 1} Aug 28 09:40:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-d33e7a20-d93c-44ef-9a47-198a365b98cf tempest-VolumesTransfersV355Test-438809708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:40:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-d33e7a20-d93c-44ef-9a47-198a365b98cf tempest-VolumesTransfersV355Test-438809708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:40:07 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-d33e7a20-d93c-44ef-9a47-198a365b98cf tempest-VolumesTransfersV355Test-438809708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:40:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-974937207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48a8cd55-78b2-433c-af06-2939cee3ac09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bd62c55b2204039805ca39980e47b97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:40:07Z,use_quota=True,user_id='05ac2ff85de54501b8b864751aa2ebc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:40:07 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-d33e7a20-d93c-44ef-9a47-198a365b98cf tempest-VolumesTransfersV355Test-438809708 None] Creating volume 48a8cd55-78b2-433c-af06-2939cee3ac09 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:40:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-d33e7a20-d93c-44ef-9a47-198a365b98cf tempest-VolumesTransfersV355Test-438809708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:40:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-d33e7a20-d93c-44ef-9a47-198a365b98cf tempest-VolumesTransfersV355Test-438809708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:40:07 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-d33e7a20-d93c-44ef-9a47-198a365b98cf tempest-VolumesTransfersV355Test-438809708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:40:07 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-d33e7a20-d93c-44ef-9a47-198a365b98cf tempest-VolumesTransfersV355Test-438809708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:40:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-d33e7a20-d93c-44ef-9a47-198a365b98cf tempest-VolumesTransfersV355Test-438809708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:40:07 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-d33e7a20-d93c-44ef-9a47-198a365b98cf tempest-VolumesTransfersV355Test-438809708 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:40:07 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-d33e7a20-d93c-44ef-9a47-198a365b98cf tempest-VolumesTransfersV355Test-438809708 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:40:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d33e7a20-d93c-44ef-9a47-198a365b98cf tempest-VolumesTransfersV355Test-438809708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-48a8cd55-78b2-433c-af06-2939cee3ac09 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:07 devstack sudo[96853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-48a8cd55-78b2-433c-af06-2939cee3ac09 1073741824 Aug 28 09:40:07 devstack sudo[96853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:07 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e885c3e8-eb7d-44c5-8b0f-aff0922a4da1 tempest-GroupsV314Test-865056381 None] Acquiring lock "cinder-quobyte-6678db6a-8dfa-4441-a3df-43a496dc8fcb" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:40:07 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e885c3e8-eb7d-44c5-8b0f-aff0922a4da1 tempest-GroupsV314Test-865056381 None] Lock "cinder-quobyte-6678db6a-8dfa-4441-a3df-43a496dc8fcb" acquired by "delete_volume" :: waited 0.050s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:40:07 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[57600833-8dc9-4a21-99ad-c6c23c5dc637]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:40:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e885c3e8-eb7d-44c5-8b0f-aff0922a4da1 tempest-GroupsV314Test-865056381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6678db6a-8dfa-4441-a3df-43a496dc8fcb {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:07 devstack sudo[96871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6678db6a-8dfa-4441-a3df-43a496dc8fcb Aug 28 09:40:07 devstack sudo[96871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:07 devstack sudo[96871]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e885c3e8-eb7d-44c5-8b0f-aff0922a4da1 tempest-GroupsV314Test-865056381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6678db6a-8dfa-4441-a3df-43a496dc8fcb" returned: 0 in 0.498s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e885c3e8-eb7d-44c5-8b0f-aff0922a4da1 tempest-GroupsV314Test-865056381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6678db6a-8dfa-4441-a3df-43a496dc8fcb {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:07 devstack sudo[96900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6678db6a-8dfa-4441-a3df-43a496dc8fcb Aug 28 09:40:07 devstack sudo[96900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:08 devstack sudo[96853]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d33e7a20-d93c-44ef-9a47-198a365b98cf tempest-VolumesTransfersV355Test-438809708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-48a8cd55-78b2-433c-af06-2939cee3ac09 1073741824" returned: 0 in 0.872s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d33e7a20-d93c-44ef-9a47-198a365b98cf tempest-VolumesTransfersV355Test-438809708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-48a8cd55-78b2-433c-af06-2939cee3ac09 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:08 devstack sudo[96904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-48a8cd55-78b2-433c-af06-2939cee3ac09 Aug 28 09:40:08 devstack sudo[96904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:08 devstack sudo[96900]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e885c3e8-eb7d-44c5-8b0f-aff0922a4da1 tempest-GroupsV314Test-865056381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6678db6a-8dfa-4441-a3df-43a496dc8fcb" returned: 0 in 0.399s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:08 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e885c3e8-eb7d-44c5-8b0f-aff0922a4da1 tempest-GroupsV314Test-865056381 None] Lock "cinder-quobyte-6678db6a-8dfa-4441-a3df-43a496dc8fcb" released by "delete_volume" :: held 0.957s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:40:08 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-e885c3e8-eb7d-44c5-8b0f-aff0922a4da1 tempest-GroupsV314Test-865056381 None] Created reservations ['ee632309-d3b1-437e-be5c-447c2ae01c63'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:40:08 devstack cinder-volume[86081]: WARNING cinder.quota [None req-e885c3e8-eb7d-44c5-8b0f-aff0922a4da1 tempest-GroupsV314Test-865056381 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1362033015 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1362033015, it is now deprecated. Please use the default quota class for default quota. Aug 28 09:40:08 devstack cinder-volume[86081]: WARNING cinder.quota [None req-e885c3e8-eb7d-44c5-8b0f-aff0922a4da1 tempest-GroupsV314Test-865056381 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1362033015 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1362033015, it is now deprecated. Please use the default quota class for default quota. Aug 28 09:40:08 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-e885c3e8-eb7d-44c5-8b0f-aff0922a4da1 tempest-GroupsV314Test-865056381 None] Created reservations ['71644a12-d28a-4151-b436-d8847e85a5ef', '6bf89105-e0fb-4738-b676-301be5e37477', '086fcdc1-bf3e-42a1-9d83-b5d618476025', '7fe1e7b8-7477-444d-bbf8-e198c42825ce'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:40:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e885c3e8-eb7d-44c5-8b0f-aff0922a4da1 tempest-GroupsV314Test-865056381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:40:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e885c3e8-eb7d-44c5-8b0f-aff0922a4da1 tempest-GroupsV314Test-865056381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:40:08 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e885c3e8-eb7d-44c5-8b0f-aff0922a4da1 tempest-GroupsV314Test-865056381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:40:08 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e885c3e8-eb7d-44c5-8b0f-aff0922a4da1 tempest-GroupsV314Test-865056381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:40:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e885c3e8-eb7d-44c5-8b0f-aff0922a4da1 tempest-GroupsV314Test-865056381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:40:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e885c3e8-eb7d-44c5-8b0f-aff0922a4da1 tempest-GroupsV314Test-865056381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:08 devstack sudo[96904]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d33e7a20-d93c-44ef-9a47-198a365b98cf tempest-VolumesTransfersV355Test-438809708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-48a8cd55-78b2-433c-af06-2939cee3ac09" returned: 0 in 0.457s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:08 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-d33e7a20-d93c-44ef-9a47-198a365b98cf tempest-VolumesTransfersV355Test-438809708 None] <== create_volume: return (1440ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:40:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-d33e7a20-d93c-44ef-9a47-198a365b98cf tempest-VolumesTransfersV355Test-438809708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.444s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:40:08 devstack sudo[96908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:40:08 devstack sudo[96908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:08 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-d33e7a20-d93c-44ef-9a47-198a365b98cf tempest-VolumesTransfersV355Test-438809708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a876c94-a383-41d0-9958-9745967e12c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48a8cd55-78b2-433c-af06-2939cee3ac09', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:40:08 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-d33e7a20-d93c-44ef-9a47-198a365b98cf tempest-VolumesTransfersV355Test-438809708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30bc55c2-ecbf-4764-8a06-2f33cfafbbb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:40:08 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-d33e7a20-d93c-44ef-9a47-198a365b98cf tempest-VolumesTransfersV355Test-438809708 None] Volume volume-48a8cd55-78b2-433c-af06-2939cee3ac09 (48a8cd55-78b2-433c-af06-2939cee3ac09): created successfully Aug 28 09:40:08 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-d33e7a20-d93c-44ef-9a47-198a365b98cf tempest-VolumesTransfersV355Test-438809708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30bc55c2-ecbf-4764-8a06-2f33cfafbbb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:40:08 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-d33e7a20-d93c-44ef-9a47-198a365b98cf tempest-VolumesTransfersV355Test-438809708 None] Flow 'volume_create_manager' (64f31d92-4875-44f3-aa7b-879c1575ed06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:40:08 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-d33e7a20-d93c-44ef-9a47-198a365b98cf tempest-VolumesTransfersV355Test-438809708 None] Created volume successfully. Aug 28 09:40:08 devstack sudo[96908]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e885c3e8-eb7d-44c5-8b0f-aff0922a4da1 tempest-GroupsV314Test-865056381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.332s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:08 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-e885c3e8-eb7d-44c5-8b0f-aff0922a4da1 tempest-GroupsV314Test-865056381 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:40:08 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-e885c3e8-eb7d-44c5-8b0f-aff0922a4da1 tempest-GroupsV314Test-865056381 None] Delete group completed successfully. Aug 28 09:40:10 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a18c4a8d-ce23-4c6d-a16b-87b242071b95 tempest-GroupsV314Test-865056381 None] Acquiring lock "cinder-quobyte-6a436825-aaee-4332-9d52-4a5336589cb0" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:40:10 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a18c4a8d-ce23-4c6d-a16b-87b242071b95 tempest-GroupsV314Test-865056381 None] Lock "cinder-quobyte-6a436825-aaee-4332-9d52-4a5336589cb0" acquired by "delete_volume" :: waited 0.022s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:40:10 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[b199b820-37c1-45ee-816f-3cece989b99b]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:40:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a18c4a8d-ce23-4c6d-a16b-87b242071b95 tempest-GroupsV314Test-865056381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:10 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-2b806535-bca6-4c19-a79e-d81b7fd2dd2e tempest-VolumesTransfersV355Test-2025907172 None] Transfer volume completed successfully. Aug 28 09:40:10 devstack sudo[96946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0 Aug 28 09:40:10 devstack sudo[96946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:10 devstack sudo[96946]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a18c4a8d-ce23-4c6d-a16b-87b242071b95 tempest-GroupsV314Test-865056381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0" returned: 0 in 0.457s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a18c4a8d-ce23-4c6d-a16b-87b242071b95 tempest-GroupsV314Test-865056381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:10 devstack sudo[96951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0 Aug 28 09:40:10 devstack sudo[96951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:10 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c5344e9c-cd2b-473b-a30f-360db4a1b622 tempest-VolumesTransfersV355Test-110571632 None] Acquiring lock "cinder-48a8cd55-78b2-433c-af06-2939cee3ac09-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:40:10 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c5344e9c-cd2b-473b-a30f-360db4a1b622 tempest-VolumesTransfersV355Test-110571632 None] Lock "cinder-48a8cd55-78b2-433c-af06-2939cee3ac09-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:40:10 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c5344e9c-cd2b-473b-a30f-360db4a1b622 tempest-VolumesTransfersV355Test-110571632 None] Acquiring lock "cinder-quobyte-48a8cd55-78b2-433c-af06-2939cee3ac09" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:40:10 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c5344e9c-cd2b-473b-a30f-360db4a1b622 tempest-VolumesTransfersV355Test-110571632 None] Lock "cinder-quobyte-48a8cd55-78b2-433c-af06-2939cee3ac09" acquired by "delete_volume" :: waited 0.016s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:40:10 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f90b19f-8c9f-4537-a2d5-224e2eac0b17]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:40:10 devstack sudo[96951]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c5344e9c-cd2b-473b-a30f-360db4a1b622 tempest-VolumesTransfersV355Test-110571632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-48a8cd55-78b2-433c-af06-2939cee3ac09 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a18c4a8d-ce23-4c6d-a16b-87b242071b95 tempest-GroupsV314Test-865056381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a436825-aaee-4332-9d52-4a5336589cb0" returned: 0 in 0.296s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:10 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a18c4a8d-ce23-4c6d-a16b-87b242071b95 tempest-GroupsV314Test-865056381 None] Lock "cinder-quobyte-6a436825-aaee-4332-9d52-4a5336589cb0" released by "delete_volume" :: held 0.829s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:40:10 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-a18c4a8d-ce23-4c6d-a16b-87b242071b95 tempest-GroupsV314Test-865056381 None] Created reservations ['eb3315d0-80d7-4ae0-8e9f-facddca995f5'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:40:10 devstack sudo[96954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-48a8cd55-78b2-433c-af06-2939cee3ac09 Aug 28 09:40:10 devstack sudo[96954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:11 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-a18c4a8d-ce23-4c6d-a16b-87b242071b95 tempest-GroupsV314Test-865056381 None] Created reservations ['a8ba8cae-f57f-4d31-97db-dfaf81c75952', 'f182b4ed-5196-4bfa-bc97-840e918fbe5a', 'ae28d535-90e7-4908-9aa8-d1a4022ddd34', '07a8aac4-783d-4825-affd-aea161d3777c'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:40:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a18c4a8d-ce23-4c6d-a16b-87b242071b95 tempest-GroupsV314Test-865056381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:40:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a18c4a8d-ce23-4c6d-a16b-87b242071b95 tempest-GroupsV314Test-865056381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:40:11 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-a18c4a8d-ce23-4c6d-a16b-87b242071b95 tempest-GroupsV314Test-865056381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:40:11 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-a18c4a8d-ce23-4c6d-a16b-87b242071b95 tempest-GroupsV314Test-865056381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:40:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a18c4a8d-ce23-4c6d-a16b-87b242071b95 tempest-GroupsV314Test-865056381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:40:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a18c4a8d-ce23-4c6d-a16b-87b242071b95 tempest-GroupsV314Test-865056381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:11 devstack sudo[96956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:40:11 devstack sudo[96956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:11 devstack sudo[96954]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c5344e9c-cd2b-473b-a30f-360db4a1b622 tempest-VolumesTransfersV355Test-110571632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-48a8cd55-78b2-433c-af06-2939cee3ac09" returned: 0 in 0.438s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c5344e9c-cd2b-473b-a30f-360db4a1b622 tempest-VolumesTransfersV355Test-110571632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-48a8cd55-78b2-433c-af06-2939cee3ac09 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:11 devstack sudo[96961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-48a8cd55-78b2-433c-af06-2939cee3ac09 Aug 28 09:40:11 devstack sudo[96961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:11 devstack sudo[96956]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a18c4a8d-ce23-4c6d-a16b-87b242071b95 tempest-GroupsV314Test-865056381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.307s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:11 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-a18c4a8d-ce23-4c6d-a16b-87b242071b95 tempest-GroupsV314Test-865056381 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:40:11 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-a18c4a8d-ce23-4c6d-a16b-87b242071b95 tempest-GroupsV314Test-865056381 None] Delete group completed successfully. Aug 28 09:40:11 devstack sudo[96961]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c5344e9c-cd2b-473b-a30f-360db4a1b622 tempest-VolumesTransfersV355Test-110571632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-48a8cd55-78b2-433c-af06-2939cee3ac09" returned: 0 in 0.313s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:11 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c5344e9c-cd2b-473b-a30f-360db4a1b622 tempest-VolumesTransfersV355Test-110571632 None] Lock "cinder-quobyte-48a8cd55-78b2-433c-af06-2939cee3ac09" released by "delete_volume" :: held 0.809s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:40:11 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-c5344e9c-cd2b-473b-a30f-360db4a1b622 tempest-VolumesTransfersV355Test-110571632 None] Created reservations ['dec15f0f-a4f1-44b7-ba49-a1ff73346add', '6511bb4a-3386-43c5-94f8-0029bb56476c', 'd26e5fd2-8222-49ee-9cce-4023b78e8551', '6195906f-b421-4017-a438-2772e6b1b87e'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:40:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-c5344e9c-cd2b-473b-a30f-360db4a1b622 tempest-VolumesTransfersV355Test-110571632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:40:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-c5344e9c-cd2b-473b-a30f-360db4a1b622 tempest-VolumesTransfersV355Test-110571632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:40:11 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-c5344e9c-cd2b-473b-a30f-360db4a1b622 tempest-VolumesTransfersV355Test-110571632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:40:11 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-c5344e9c-cd2b-473b-a30f-360db4a1b622 tempest-VolumesTransfersV355Test-110571632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:40:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-c5344e9c-cd2b-473b-a30f-360db4a1b622 tempest-VolumesTransfersV355Test-110571632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:40:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c5344e9c-cd2b-473b-a30f-360db4a1b622 tempest-VolumesTransfersV355Test-110571632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:11 devstack sudo[96965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:40:11 devstack sudo[96965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:12 devstack sudo[96965]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c5344e9c-cd2b-473b-a30f-360db4a1b622 tempest-VolumesTransfersV355Test-110571632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.287s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:12 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-c5344e9c-cd2b-473b-a30f-360db4a1b622 tempest-VolumesTransfersV355Test-110571632 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:40:12 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-c5344e9c-cd2b-473b-a30f-360db4a1b622 tempest-VolumesTransfersV355Test-110571632 None] Deleted volume successfully. Aug 28 09:40:12 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c5344e9c-cd2b-473b-a30f-360db4a1b622 tempest-VolumesTransfersV355Test-110571632 None] Lock "cinder-48a8cd55-78b2-433c-af06-2939cee3ac09-delete_volume" released by "delete_volume" :: held 1.341s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:40:12 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-35a6d5a7-5638-4552-86d3-ba90dce5c94a tempest-VolumesTransfersV355Test-438809708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:40:12 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-35a6d5a7-5638-4552-86d3-ba90dce5c94a tempest-VolumesTransfersV355Test-438809708 None] Flow 'volume_create_manager' (5519a528-f7e3-48cc-a8f2-c460bcc3f173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:40:12 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-35a6d5a7-5638-4552-86d3-ba90dce5c94a tempest-VolumesTransfersV355Test-438809708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74f9d2f3-d141-45ad-93c0-110ffb36c26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:40:12 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-35a6d5a7-5638-4552-86d3-ba90dce5c94a tempest-VolumesTransfersV355Test-438809708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74f9d2f3-d141-45ad-93c0-110ffb36c26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:40:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1770588062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e71c7da-8fc1-43c6-bfaf-7986584b6774,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bd62c55b2204039805ca39980e47b97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:40:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:40:12Z,use_quota=True,user_id='05ac2ff85de54501b8b864751aa2ebc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:40:12 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-35a6d5a7-5638-4552-86d3-ba90dce5c94a tempest-VolumesTransfersV355Test-438809708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eeb785f-07aa-4e46-874a-f3a5022c7766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:40:12 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-35a6d5a7-5638-4552-86d3-ba90dce5c94a tempest-VolumesTransfersV355Test-438809708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eeb785f-07aa-4e46-874a-f3a5022c7766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:40:12 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-35a6d5a7-5638-4552-86d3-ba90dce5c94a tempest-VolumesTransfersV355Test-438809708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb4802a3-7aaa-443c-85ca-c016a292fa9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:40:12 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-35a6d5a7-5638-4552-86d3-ba90dce5c94a tempest-VolumesTransfersV355Test-438809708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb4802a3-7aaa-443c-85ca-c016a292fa9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e71c7da-8fc1-43c6-bfaf-7986584b6774', 'volume_name': 'volume-4e71c7da-8fc1-43c6-bfaf-7986584b6774', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:40:12 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-35a6d5a7-5638-4552-86d3-ba90dce5c94a tempest-VolumesTransfersV355Test-438809708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddd4e138-d1cf-474b-ac91-9fada5585496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:40:12 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-35a6d5a7-5638-4552-86d3-ba90dce5c94a tempest-VolumesTransfersV355Test-438809708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddd4e138-d1cf-474b-ac91-9fada5585496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:40:12 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-35a6d5a7-5638-4552-86d3-ba90dce5c94a tempest-VolumesTransfersV355Test-438809708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (848ceb97-9b20-4898-9219-847fb33399ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:40:12 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-35a6d5a7-5638-4552-86d3-ba90dce5c94a tempest-VolumesTransfersV355Test-438809708 None] Volume 4e71c7da-8fc1-43c6-bfaf-7986584b6774: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e71c7da-8fc1-43c6-bfaf-7986584b6774', 'volume_size': 1} Aug 28 09:40:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-35a6d5a7-5638-4552-86d3-ba90dce5c94a tempest-VolumesTransfersV355Test-438809708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:40:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-35a6d5a7-5638-4552-86d3-ba90dce5c94a tempest-VolumesTransfersV355Test-438809708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:40:12 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-35a6d5a7-5638-4552-86d3-ba90dce5c94a tempest-VolumesTransfersV355Test-438809708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:40:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1770588062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e71c7da-8fc1-43c6-bfaf-7986584b6774,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bd62c55b2204039805ca39980e47b97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:40:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:40:12Z,use_quota=True,user_id='05ac2ff85de54501b8b864751aa2ebc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:40:12 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-35a6d5a7-5638-4552-86d3-ba90dce5c94a tempest-VolumesTransfersV355Test-438809708 None] Creating volume 4e71c7da-8fc1-43c6-bfaf-7986584b6774 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:40:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-35a6d5a7-5638-4552-86d3-ba90dce5c94a tempest-VolumesTransfersV355Test-438809708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:40:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-35a6d5a7-5638-4552-86d3-ba90dce5c94a tempest-VolumesTransfersV355Test-438809708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:40:12 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-35a6d5a7-5638-4552-86d3-ba90dce5c94a tempest-VolumesTransfersV355Test-438809708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:40:12 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-35a6d5a7-5638-4552-86d3-ba90dce5c94a tempest-VolumesTransfersV355Test-438809708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:40:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-35a6d5a7-5638-4552-86d3-ba90dce5c94a tempest-VolumesTransfersV355Test-438809708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:40:12 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-35a6d5a7-5638-4552-86d3-ba90dce5c94a tempest-VolumesTransfersV355Test-438809708 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:40:12 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-35a6d5a7-5638-4552-86d3-ba90dce5c94a tempest-VolumesTransfersV355Test-438809708 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:40:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-35a6d5a7-5638-4552-86d3-ba90dce5c94a tempest-VolumesTransfersV355Test-438809708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4e71c7da-8fc1-43c6-bfaf-7986584b6774 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:12 devstack sudo[96968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4e71c7da-8fc1-43c6-bfaf-7986584b6774 1073741824 Aug 28 09:40:12 devstack sudo[96968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:13 devstack sudo[96968]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-35a6d5a7-5638-4552-86d3-ba90dce5c94a tempest-VolumesTransfersV355Test-438809708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4e71c7da-8fc1-43c6-bfaf-7986584b6774 1073741824" returned: 0 in 0.507s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-35a6d5a7-5638-4552-86d3-ba90dce5c94a tempest-VolumesTransfersV355Test-438809708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4e71c7da-8fc1-43c6-bfaf-7986584b6774 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:13 devstack sudo[96975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4e71c7da-8fc1-43c6-bfaf-7986584b6774 Aug 28 09:40:13 devstack sudo[96975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:13 devstack sudo[96975]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-35a6d5a7-5638-4552-86d3-ba90dce5c94a tempest-VolumesTransfersV355Test-438809708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4e71c7da-8fc1-43c6-bfaf-7986584b6774" returned: 0 in 0.312s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:13 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-35a6d5a7-5638-4552-86d3-ba90dce5c94a tempest-VolumesTransfersV355Test-438809708 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:40:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-35a6d5a7-5638-4552-86d3-ba90dce5c94a tempest-VolumesTransfersV355Test-438809708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:40:13 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-35a6d5a7-5638-4552-86d3-ba90dce5c94a tempest-VolumesTransfersV355Test-438809708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (848ceb97-9b20-4898-9219-847fb33399ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e71c7da-8fc1-43c6-bfaf-7986584b6774', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:40:13 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-35a6d5a7-5638-4552-86d3-ba90dce5c94a tempest-VolumesTransfersV355Test-438809708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (806e601d-dee6-44c3-83e4-98e36f187118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:40:13 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-35a6d5a7-5638-4552-86d3-ba90dce5c94a tempest-VolumesTransfersV355Test-438809708 None] Volume volume-4e71c7da-8fc1-43c6-bfaf-7986584b6774 (4e71c7da-8fc1-43c6-bfaf-7986584b6774): created successfully Aug 28 09:40:13 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-35a6d5a7-5638-4552-86d3-ba90dce5c94a tempest-VolumesTransfersV355Test-438809708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (806e601d-dee6-44c3-83e4-98e36f187118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:40:13 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-35a6d5a7-5638-4552-86d3-ba90dce5c94a tempest-VolumesTransfersV355Test-438809708 None] Flow 'volume_create_manager' (5519a528-f7e3-48cc-a8f2-c460bcc3f173) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:40:13 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-35a6d5a7-5638-4552-86d3-ba90dce5c94a tempest-VolumesTransfersV355Test-438809708 None] Created volume successfully. Aug 28 09:40:14 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-880e06ef-38ae-40c1-939d-045425249bf7 tempest-VolumesTransfersV355Test-110571632 None] Acquiring lock "cinder-4e71c7da-8fc1-43c6-bfaf-7986584b6774-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:40:14 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-880e06ef-38ae-40c1-939d-045425249bf7 tempest-VolumesTransfersV355Test-110571632 None] Lock "cinder-4e71c7da-8fc1-43c6-bfaf-7986584b6774-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:40:15 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-880e06ef-38ae-40c1-939d-045425249bf7 tempest-VolumesTransfersV355Test-110571632 None] Acquiring lock "cinder-quobyte-4e71c7da-8fc1-43c6-bfaf-7986584b6774" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:40:15 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-880e06ef-38ae-40c1-939d-045425249bf7 tempest-VolumesTransfersV355Test-110571632 None] Lock "cinder-quobyte-4e71c7da-8fc1-43c6-bfaf-7986584b6774" acquired by "delete_volume" :: waited 0.025s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:40:15 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6d7995-6ed7-4f98-be94-e253f89a7775]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:40:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-880e06ef-38ae-40c1-939d-045425249bf7 tempest-VolumesTransfersV355Test-110571632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4e71c7da-8fc1-43c6-bfaf-7986584b6774 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:15 devstack sudo[96978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4e71c7da-8fc1-43c6-bfaf-7986584b6774 Aug 28 09:40:15 devstack sudo[96978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:15 devstack sudo[96978]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-880e06ef-38ae-40c1-939d-045425249bf7 tempest-VolumesTransfersV355Test-110571632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4e71c7da-8fc1-43c6-bfaf-7986584b6774" returned: 0 in 0.407s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-880e06ef-38ae-40c1-939d-045425249bf7 tempest-VolumesTransfersV355Test-110571632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4e71c7da-8fc1-43c6-bfaf-7986584b6774 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:15 devstack sudo[96983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4e71c7da-8fc1-43c6-bfaf-7986584b6774 Aug 28 09:40:15 devstack sudo[96983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:15 devstack sudo[96983]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-880e06ef-38ae-40c1-939d-045425249bf7 tempest-VolumesTransfersV355Test-110571632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4e71c7da-8fc1-43c6-bfaf-7986584b6774" returned: 0 in 0.262s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:15 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-880e06ef-38ae-40c1-939d-045425249bf7 tempest-VolumesTransfersV355Test-110571632 None] Lock "cinder-quobyte-4e71c7da-8fc1-43c6-bfaf-7986584b6774" released by "delete_volume" :: held 0.725s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:40:15 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-880e06ef-38ae-40c1-939d-045425249bf7 tempest-VolumesTransfersV355Test-110571632 None] Created reservations ['75905fa8-0c03-437e-9164-6fe4785e72bb', '9965fd20-b637-47aa-b8f8-e3f69c04d7a9', '530f39f6-1606-4a98-ae6c-53b6d014bd6f', 'b88ab956-31c8-4c41-ad72-eada8e96471c'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:40:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-880e06ef-38ae-40c1-939d-045425249bf7 tempest-VolumesTransfersV355Test-110571632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:40:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-880e06ef-38ae-40c1-939d-045425249bf7 tempest-VolumesTransfersV355Test-110571632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:40:15 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-880e06ef-38ae-40c1-939d-045425249bf7 tempest-VolumesTransfersV355Test-110571632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:40:15 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-880e06ef-38ae-40c1-939d-045425249bf7 tempest-VolumesTransfersV355Test-110571632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:40:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-880e06ef-38ae-40c1-939d-045425249bf7 tempest-VolumesTransfersV355Test-110571632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:40:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-880e06ef-38ae-40c1-939d-045425249bf7 tempest-VolumesTransfersV355Test-110571632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:15 devstack sudo[96986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:40:15 devstack sudo[96986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:16 devstack sudo[96986]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-880e06ef-38ae-40c1-939d-045425249bf7 tempest-VolumesTransfersV355Test-110571632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.269s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:16 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-880e06ef-38ae-40c1-939d-045425249bf7 tempest-VolumesTransfersV355Test-110571632 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:40:16 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-880e06ef-38ae-40c1-939d-045425249bf7 tempest-VolumesTransfersV355Test-110571632 None] Deleted volume successfully. Aug 28 09:40:16 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-880e06ef-38ae-40c1-939d-045425249bf7 tempest-VolumesTransfersV355Test-110571632 None] Lock "cinder-4e71c7da-8fc1-43c6-bfaf-7986584b6774-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:40:19 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-654c57e1-12d0-43de-8d4f-ca2a09d7ce79 tempest-VolumeQuotasNegativeTestJSON-1951755848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:40:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-654c57e1-12d0-43de-8d4f-ca2a09d7ce79 tempest-VolumeQuotasNegativeTestJSON-1951755848 None] Flow 'volume_create_manager' (a6bd15bf-8cac-49e2-a25e-a0c46fb9a059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:40:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-654c57e1-12d0-43de-8d4f-ca2a09d7ce79 tempest-VolumeQuotasNegativeTestJSON-1951755848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (352c5ca4-2153-415a-bf3d-d0f96e6b8f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:40:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-654c57e1-12d0-43de-8d4f-ca2a09d7ce79 tempest-VolumeQuotasNegativeTestJSON-1951755848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (352c5ca4-2153-415a-bf3d-d0f96e6b8f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:40:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-629560928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=231525a1-60cd-40cc-b7c8-25db0c5b819f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03938bbe55374eab809a121fdc35e0ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:40:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:40:19Z,use_quota=True,user_id='4bc9435ba4374fb582a4dede60a9acba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:40:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-654c57e1-12d0-43de-8d4f-ca2a09d7ce79 tempest-VolumeQuotasNegativeTestJSON-1951755848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdfa1812-7b8e-43fa-8e6d-2c0f63180cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:40:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-654c57e1-12d0-43de-8d4f-ca2a09d7ce79 tempest-VolumeQuotasNegativeTestJSON-1951755848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdfa1812-7b8e-43fa-8e6d-2c0f63180cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:40:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-654c57e1-12d0-43de-8d4f-ca2a09d7ce79 tempest-VolumeQuotasNegativeTestJSON-1951755848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10de1dac-320b-46a3-87b6-a2465be5bc71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:40:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-654c57e1-12d0-43de-8d4f-ca2a09d7ce79 tempest-VolumeQuotasNegativeTestJSON-1951755848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10de1dac-320b-46a3-87b6-a2465be5bc71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '231525a1-60cd-40cc-b7c8-25db0c5b819f', 'volume_name': 'volume-231525a1-60cd-40cc-b7c8-25db0c5b819f', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:40:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-654c57e1-12d0-43de-8d4f-ca2a09d7ce79 tempest-VolumeQuotasNegativeTestJSON-1951755848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc7f5660-842a-4e20-bc4b-019394334884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:40:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-654c57e1-12d0-43de-8d4f-ca2a09d7ce79 tempest-VolumeQuotasNegativeTestJSON-1951755848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc7f5660-842a-4e20-bc4b-019394334884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:40:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-654c57e1-12d0-43de-8d4f-ca2a09d7ce79 tempest-VolumeQuotasNegativeTestJSON-1951755848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2537e5c-aa18-4526-8ff5-54b483b72894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:40:19 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-654c57e1-12d0-43de-8d4f-ca2a09d7ce79 tempest-VolumeQuotasNegativeTestJSON-1951755848 None] Volume 231525a1-60cd-40cc-b7c8-25db0c5b819f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-231525a1-60cd-40cc-b7c8-25db0c5b819f', 'volume_size': 1} Aug 28 09:40:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-654c57e1-12d0-43de-8d4f-ca2a09d7ce79 tempest-VolumeQuotasNegativeTestJSON-1951755848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:40:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-654c57e1-12d0-43de-8d4f-ca2a09d7ce79 tempest-VolumeQuotasNegativeTestJSON-1951755848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:40:19 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-654c57e1-12d0-43de-8d4f-ca2a09d7ce79 tempest-VolumeQuotasNegativeTestJSON-1951755848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:40:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-629560928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=231525a1-60cd-40cc-b7c8-25db0c5b819f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03938bbe55374eab809a121fdc35e0ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:40:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:40:19Z,use_quota=True,user_id='4bc9435ba4374fb582a4dede60a9acba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:40:19 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-654c57e1-12d0-43de-8d4f-ca2a09d7ce79 tempest-VolumeQuotasNegativeTestJSON-1951755848 None] Creating volume 231525a1-60cd-40cc-b7c8-25db0c5b819f {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:40:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-654c57e1-12d0-43de-8d4f-ca2a09d7ce79 tempest-VolumeQuotasNegativeTestJSON-1951755848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:40:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-654c57e1-12d0-43de-8d4f-ca2a09d7ce79 tempest-VolumeQuotasNegativeTestJSON-1951755848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:40:19 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-654c57e1-12d0-43de-8d4f-ca2a09d7ce79 tempest-VolumeQuotasNegativeTestJSON-1951755848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:40:19 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-654c57e1-12d0-43de-8d4f-ca2a09d7ce79 tempest-VolumeQuotasNegativeTestJSON-1951755848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:40:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-654c57e1-12d0-43de-8d4f-ca2a09d7ce79 tempest-VolumeQuotasNegativeTestJSON-1951755848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:40:19 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-654c57e1-12d0-43de-8d4f-ca2a09d7ce79 tempest-VolumeQuotasNegativeTestJSON-1951755848 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:40:19 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-654c57e1-12d0-43de-8d4f-ca2a09d7ce79 tempest-VolumeQuotasNegativeTestJSON-1951755848 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:40:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-654c57e1-12d0-43de-8d4f-ca2a09d7ce79 tempest-VolumeQuotasNegativeTestJSON-1951755848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-231525a1-60cd-40cc-b7c8-25db0c5b819f 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:19 devstack sudo[96993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-231525a1-60cd-40cc-b7c8-25db0c5b819f 1073741824 Aug 28 09:40:19 devstack sudo[96993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:20 devstack sudo[96993]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-654c57e1-12d0-43de-8d4f-ca2a09d7ce79 tempest-VolumeQuotasNegativeTestJSON-1951755848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-231525a1-60cd-40cc-b7c8-25db0c5b819f 1073741824" returned: 0 in 0.584s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-654c57e1-12d0-43de-8d4f-ca2a09d7ce79 tempest-VolumeQuotasNegativeTestJSON-1951755848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-231525a1-60cd-40cc-b7c8-25db0c5b819f {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:20 devstack sudo[96999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-231525a1-60cd-40cc-b7c8-25db0c5b819f Aug 28 09:40:20 devstack sudo[96999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:20 devstack sudo[96999]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-654c57e1-12d0-43de-8d4f-ca2a09d7ce79 tempest-VolumeQuotasNegativeTestJSON-1951755848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-231525a1-60cd-40cc-b7c8-25db0c5b819f" returned: 0 in 0.281s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:20 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-654c57e1-12d0-43de-8d4f-ca2a09d7ce79 tempest-VolumeQuotasNegativeTestJSON-1951755848 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:40:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-654c57e1-12d0-43de-8d4f-ca2a09d7ce79 tempest-VolumeQuotasNegativeTestJSON-1951755848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:40:20 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-654c57e1-12d0-43de-8d4f-ca2a09d7ce79 tempest-VolumeQuotasNegativeTestJSON-1951755848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2537e5c-aa18-4526-8ff5-54b483b72894) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-231525a1-60cd-40cc-b7c8-25db0c5b819f', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:40:20 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-654c57e1-12d0-43de-8d4f-ca2a09d7ce79 tempest-VolumeQuotasNegativeTestJSON-1951755848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8faa7495-18e0-45c4-bf15-3409d87dd118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:40:20 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-654c57e1-12d0-43de-8d4f-ca2a09d7ce79 tempest-VolumeQuotasNegativeTestJSON-1951755848 None] Volume volume-231525a1-60cd-40cc-b7c8-25db0c5b819f (231525a1-60cd-40cc-b7c8-25db0c5b819f): created successfully Aug 28 09:40:20 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-654c57e1-12d0-43de-8d4f-ca2a09d7ce79 tempest-VolumeQuotasNegativeTestJSON-1951755848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8faa7495-18e0-45c4-bf15-3409d87dd118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:40:20 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-654c57e1-12d0-43de-8d4f-ca2a09d7ce79 tempest-VolumeQuotasNegativeTestJSON-1951755848 None] Flow 'volume_create_manager' (a6bd15bf-8cac-49e2-a25e-a0c46fb9a059) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:40:20 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-654c57e1-12d0-43de-8d4f-ca2a09d7ce79 tempest-VolumeQuotasNegativeTestJSON-1951755848 None] Created volume successfully. Aug 28 09:40:22 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-df84404c-1492-42f4-a33f-2fc16bf5ce7e tempest-VolumeQuotasNegativeTestJSON-1951755848 None] Acquiring lock "cinder-231525a1-60cd-40cc-b7c8-25db0c5b819f-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:40:22 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-df84404c-1492-42f4-a33f-2fc16bf5ce7e tempest-VolumeQuotasNegativeTestJSON-1951755848 None] Lock "cinder-231525a1-60cd-40cc-b7c8-25db0c5b819f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:40:22 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-df84404c-1492-42f4-a33f-2fc16bf5ce7e tempest-VolumeQuotasNegativeTestJSON-1951755848 None] Acquiring lock "cinder-quobyte-231525a1-60cd-40cc-b7c8-25db0c5b819f" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:40:22 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-df84404c-1492-42f4-a33f-2fc16bf5ce7e tempest-VolumeQuotasNegativeTestJSON-1951755848 None] Lock "cinder-quobyte-231525a1-60cd-40cc-b7c8-25db0c5b819f" acquired by "delete_volume" :: waited 0.026s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:40:22 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[a139d71a-8cd8-4179-86c0-7351d6d6321a]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:40:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-df84404c-1492-42f4-a33f-2fc16bf5ce7e tempest-VolumeQuotasNegativeTestJSON-1951755848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-231525a1-60cd-40cc-b7c8-25db0c5b819f {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:22 devstack sudo[97004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-231525a1-60cd-40cc-b7c8-25db0c5b819f Aug 28 09:40:22 devstack sudo[97004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:23 devstack sudo[97004]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-df84404c-1492-42f4-a33f-2fc16bf5ce7e tempest-VolumeQuotasNegativeTestJSON-1951755848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-231525a1-60cd-40cc-b7c8-25db0c5b819f" returned: 0 in 0.435s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-df84404c-1492-42f4-a33f-2fc16bf5ce7e tempest-VolumeQuotasNegativeTestJSON-1951755848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-231525a1-60cd-40cc-b7c8-25db0c5b819f {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:23 devstack sudo[97010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-231525a1-60cd-40cc-b7c8-25db0c5b819f Aug 28 09:40:23 devstack sudo[97010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:23 devstack sudo[97010]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-df84404c-1492-42f4-a33f-2fc16bf5ce7e tempest-VolumeQuotasNegativeTestJSON-1951755848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-231525a1-60cd-40cc-b7c8-25db0c5b819f" returned: 0 in 0.321s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:23 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-df84404c-1492-42f4-a33f-2fc16bf5ce7e tempest-VolumeQuotasNegativeTestJSON-1951755848 None] Lock "cinder-quobyte-231525a1-60cd-40cc-b7c8-25db0c5b819f" released by "delete_volume" :: held 0.811s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:40:23 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-df84404c-1492-42f4-a33f-2fc16bf5ce7e tempest-VolumeQuotasNegativeTestJSON-1951755848 None] Created reservations ['1aeebdc2-1899-44a0-82a6-984cb4e5b26b', '39d579ac-c8dd-495c-957e-945ce84a578f', 'bf91c589-8a6a-4379-ba3e-b441710a27c6', '615c0844-efc0-4600-84d3-699ad18bfedb'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:40:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-df84404c-1492-42f4-a33f-2fc16bf5ce7e tempest-VolumeQuotasNegativeTestJSON-1951755848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:40:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-df84404c-1492-42f4-a33f-2fc16bf5ce7e tempest-VolumeQuotasNegativeTestJSON-1951755848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:40:23 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-df84404c-1492-42f4-a33f-2fc16bf5ce7e tempest-VolumeQuotasNegativeTestJSON-1951755848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:40:23 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-df84404c-1492-42f4-a33f-2fc16bf5ce7e tempest-VolumeQuotasNegativeTestJSON-1951755848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:40:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-df84404c-1492-42f4-a33f-2fc16bf5ce7e tempest-VolumeQuotasNegativeTestJSON-1951755848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:40:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-df84404c-1492-42f4-a33f-2fc16bf5ce7e tempest-VolumeQuotasNegativeTestJSON-1951755848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:23 devstack sudo[97016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:40:23 devstack sudo[97016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:24 devstack sudo[97016]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-df84404c-1492-42f4-a33f-2fc16bf5ce7e tempest-VolumeQuotasNegativeTestJSON-1951755848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.346s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:24 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-df84404c-1492-42f4-a33f-2fc16bf5ce7e tempest-VolumeQuotasNegativeTestJSON-1951755848 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:40:24 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-df84404c-1492-42f4-a33f-2fc16bf5ce7e tempest-VolumeQuotasNegativeTestJSON-1951755848 None] Deleted volume successfully. Aug 28 09:40:24 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-df84404c-1492-42f4-a33f-2fc16bf5ce7e tempest-VolumeQuotasNegativeTestJSON-1951755848 None] Lock "cinder-231525a1-60cd-40cc-b7c8-25db0c5b819f-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:40:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-278ec50f-8a13-496c-8bf8-749fc3eacf3b req-02122da5-2ac3-4e91-ae0f-8f7333bd6684 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:40:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-278ec50f-8a13-496c-8bf8-749fc3eacf3b req-02122da5-2ac3-4e91-ae0f-8f7333bd6684 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:40:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-278ec50f-8a13-496c-8bf8-749fc3eacf3b req-02122da5-2ac3-4e91-ae0f-8f7333bd6684 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:40:24 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-278ec50f-8a13-496c-8bf8-749fc3eacf3b req-02122da5-2ac3-4e91-ae0f-8f7333bd6684 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b', 'name': 'volume-68ac8c7b-bf60-48a2-b0e0-c507cc572d83', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c1e4cebd-626c-4fbf-83e9-d8408b5b236f', 'enforce_multipath': True} {{(pid=86081) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 09:40:24 devstack cinder-volume[86081]: INFO cinder.volume.manager [req-278ec50f-8a13-496c-8bf8-749fc3eacf3b req-02122da5-2ac3-4e91-ae0f-8f7333bd6684 tempest-TestServerVolumeAttachmentScenario-1064473967 None] attachment_update completed successfully. Aug 28 09:40:25 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-8896fe9a-6a3f-4d05-b085-84843b8bc9a8 tempest-VolumesTransfersV357Test-834098134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:40:25 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8896fe9a-6a3f-4d05-b085-84843b8bc9a8 tempest-VolumesTransfersV357Test-834098134 None] Flow 'volume_create_manager' (136f2c34-c1f1-48ec-a79c-35cf00b8b742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:40:25 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8896fe9a-6a3f-4d05-b085-84843b8bc9a8 tempest-VolumesTransfersV357Test-834098134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d303d307-133c-47b9-a270-8457c18db884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:40:25 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8896fe9a-6a3f-4d05-b085-84843b8bc9a8 tempest-VolumesTransfersV357Test-834098134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d303d307-133c-47b9-a270-8457c18db884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:40:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2051633957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6190bbc4-1f29-44c9-ad9f-f02fc8c68d20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b2562aa3e4e4a8e93c3298753f40fa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:40:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:40:26Z,use_quota=True,user_id='bba27377207f44ea94c6d12edc00046b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:40:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8896fe9a-6a3f-4d05-b085-84843b8bc9a8 tempest-VolumesTransfersV357Test-834098134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97250f38-87e3-4615-afbc-82605a34976a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:40:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8896fe9a-6a3f-4d05-b085-84843b8bc9a8 tempest-VolumesTransfersV357Test-834098134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97250f38-87e3-4615-afbc-82605a34976a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:40:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8896fe9a-6a3f-4d05-b085-84843b8bc9a8 tempest-VolumesTransfersV357Test-834098134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6474658b-16c6-419e-aaba-00197a7b17ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:40:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8896fe9a-6a3f-4d05-b085-84843b8bc9a8 tempest-VolumesTransfersV357Test-834098134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6474658b-16c6-419e-aaba-00197a7b17ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6190bbc4-1f29-44c9-ad9f-f02fc8c68d20', 'volume_name': 'volume-6190bbc4-1f29-44c9-ad9f-f02fc8c68d20', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:40:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8896fe9a-6a3f-4d05-b085-84843b8bc9a8 tempest-VolumesTransfersV357Test-834098134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ad9ae20-d49b-4956-a7bb-f72b507966ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:40:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8896fe9a-6a3f-4d05-b085-84843b8bc9a8 tempest-VolumesTransfersV357Test-834098134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ad9ae20-d49b-4956-a7bb-f72b507966ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:40:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8896fe9a-6a3f-4d05-b085-84843b8bc9a8 tempest-VolumesTransfersV357Test-834098134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b89940ea-b574-4e0f-9620-881b43e7d701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:40:26 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-8896fe9a-6a3f-4d05-b085-84843b8bc9a8 tempest-VolumesTransfersV357Test-834098134 None] Volume 6190bbc4-1f29-44c9-ad9f-f02fc8c68d20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6190bbc4-1f29-44c9-ad9f-f02fc8c68d20', 'volume_size': 1} Aug 28 09:40:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8896fe9a-6a3f-4d05-b085-84843b8bc9a8 tempest-VolumesTransfersV357Test-834098134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:40:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8896fe9a-6a3f-4d05-b085-84843b8bc9a8 tempest-VolumesTransfersV357Test-834098134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:40:26 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-8896fe9a-6a3f-4d05-b085-84843b8bc9a8 tempest-VolumesTransfersV357Test-834098134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:40:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2051633957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6190bbc4-1f29-44c9-ad9f-f02fc8c68d20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b2562aa3e4e4a8e93c3298753f40fa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:40:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:40:26Z,use_quota=True,user_id='bba27377207f44ea94c6d12edc00046b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:40:26 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-8896fe9a-6a3f-4d05-b085-84843b8bc9a8 tempest-VolumesTransfersV357Test-834098134 None] Creating volume 6190bbc4-1f29-44c9-ad9f-f02fc8c68d20 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:40:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8896fe9a-6a3f-4d05-b085-84843b8bc9a8 tempest-VolumesTransfersV357Test-834098134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:40:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8896fe9a-6a3f-4d05-b085-84843b8bc9a8 tempest-VolumesTransfersV357Test-834098134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:40:26 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-8896fe9a-6a3f-4d05-b085-84843b8bc9a8 tempest-VolumesTransfersV357Test-834098134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:40:26 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-8896fe9a-6a3f-4d05-b085-84843b8bc9a8 tempest-VolumesTransfersV357Test-834098134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:40:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8896fe9a-6a3f-4d05-b085-84843b8bc9a8 tempest-VolumesTransfersV357Test-834098134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:40:26 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-8896fe9a-6a3f-4d05-b085-84843b8bc9a8 tempest-VolumesTransfersV357Test-834098134 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:40:26 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-8896fe9a-6a3f-4d05-b085-84843b8bc9a8 tempest-VolumesTransfersV357Test-834098134 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:40:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8896fe9a-6a3f-4d05-b085-84843b8bc9a8 tempest-VolumesTransfersV357Test-834098134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6190bbc4-1f29-44c9-ad9f-f02fc8c68d20 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:26 devstack sudo[97410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6190bbc4-1f29-44c9-ad9f-f02fc8c68d20 1073741824 Aug 28 09:40:26 devstack sudo[97410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:26 devstack sudo[97410]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8896fe9a-6a3f-4d05-b085-84843b8bc9a8 tempest-VolumesTransfersV357Test-834098134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6190bbc4-1f29-44c9-ad9f-f02fc8c68d20 1073741824" returned: 0 in 0.696s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:26 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d5e5a30-faa1-465e-b662-1526195b6bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:40:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8d5e5a30-faa1-465e-b662-1526195b6bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Flow 'volume_create_manager' (99fb6d9b-d7cf-4b96-b91e-246013d003f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:40:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8d5e5a30-faa1-465e-b662-1526195b6bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dbe1ad2-619a-4b8c-a1db-1962e1889292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:40:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8d5e5a30-faa1-465e-b662-1526195b6bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dbe1ad2-619a-4b8c-a1db-1962e1889292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:40:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-603057291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e70d7ab-bd90-408f-b1eb-46dad1c00864,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17db5506415745558d39ef43da0e8c63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:40:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:40:27Z,use_quota=True,user_id='1413ca5c9d854f648bcb3a20d69fcc90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:40:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8d5e5a30-faa1-465e-b662-1526195b6bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b823b5d-3099-4134-a8e9-b32361ff35fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:40:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8d5e5a30-faa1-465e-b662-1526195b6bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b823b5d-3099-4134-a8e9-b32361ff35fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:40:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8d5e5a30-faa1-465e-b662-1526195b6bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c759ad2-911e-4d5b-968b-a473504cbb71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:40:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8d5e5a30-faa1-465e-b662-1526195b6bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c759ad2-911e-4d5b-968b-a473504cbb71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e70d7ab-bd90-408f-b1eb-46dad1c00864', 'volume_name': 'volume-2e70d7ab-bd90-408f-b1eb-46dad1c00864', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:40:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8d5e5a30-faa1-465e-b662-1526195b6bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e23f0c0-3454-4e12-a817-2187f48bd2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:40:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8d5e5a30-faa1-465e-b662-1526195b6bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e23f0c0-3454-4e12-a817-2187f48bd2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:40:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8d5e5a30-faa1-465e-b662-1526195b6bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db31feee-e4cc-42d8-acea-b3c399af0652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:40:26 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-8d5e5a30-faa1-465e-b662-1526195b6bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Volume 2e70d7ab-bd90-408f-b1eb-46dad1c00864: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e70d7ab-bd90-408f-b1eb-46dad1c00864', 'volume_size': 1} Aug 28 09:40:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8d5e5a30-faa1-465e-b662-1526195b6bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:40:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8896fe9a-6a3f-4d05-b085-84843b8bc9a8 tempest-VolumesTransfersV357Test-834098134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6190bbc4-1f29-44c9-ad9f-f02fc8c68d20 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:26 devstack sudo[97415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6190bbc4-1f29-44c9-ad9f-f02fc8c68d20 Aug 28 09:40:26 devstack sudo[97415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:27 devstack sudo[97415]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8896fe9a-6a3f-4d05-b085-84843b8bc9a8 tempest-VolumesTransfersV357Test-834098134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6190bbc4-1f29-44c9-ad9f-f02fc8c68d20" returned: 0 in 0.259s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:27 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-8896fe9a-6a3f-4d05-b085-84843b8bc9a8 tempest-VolumesTransfersV357Test-834098134 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:40:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8896fe9a-6a3f-4d05-b085-84843b8bc9a8 tempest-VolumesTransfersV357Test-834098134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:40:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8d5e5a30-faa1-465e-b662-1526195b6bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.269s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:40:27 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-8d5e5a30-faa1-465e-b662-1526195b6bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:40:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-603057291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e70d7ab-bd90-408f-b1eb-46dad1c00864,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17db5506415745558d39ef43da0e8c63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:40:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:40:27Z,use_quota=True,user_id='1413ca5c9d854f648bcb3a20d69fcc90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:40:27 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-8d5e5a30-faa1-465e-b662-1526195b6bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Creating volume 2e70d7ab-bd90-408f-b1eb-46dad1c00864 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:40:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8d5e5a30-faa1-465e-b662-1526195b6bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:40:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8d5e5a30-faa1-465e-b662-1526195b6bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:40:27 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-8d5e5a30-faa1-465e-b662-1526195b6bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:40:27 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-8d5e5a30-faa1-465e-b662-1526195b6bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:40:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8d5e5a30-faa1-465e-b662-1526195b6bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:40:27 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-8d5e5a30-faa1-465e-b662-1526195b6bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:40:27 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-8d5e5a30-faa1-465e-b662-1526195b6bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:40:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8d5e5a30-faa1-465e-b662-1526195b6bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e70d7ab-bd90-408f-b1eb-46dad1c00864 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:27 devstack sudo[97418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e70d7ab-bd90-408f-b1eb-46dad1c00864 1073741824 Aug 28 09:40:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8896fe9a-6a3f-4d05-b085-84843b8bc9a8 tempest-VolumesTransfersV357Test-834098134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b89940ea-b574-4e0f-9620-881b43e7d701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6190bbc4-1f29-44c9-ad9f-f02fc8c68d20', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:40:27 devstack sudo[97418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8896fe9a-6a3f-4d05-b085-84843b8bc9a8 tempest-VolumesTransfersV357Test-834098134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f623cbfd-ac8e-4ba6-8d05-1d54cfd1063b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:40:27 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-8896fe9a-6a3f-4d05-b085-84843b8bc9a8 tempest-VolumesTransfersV357Test-834098134 None] Volume volume-6190bbc4-1f29-44c9-ad9f-f02fc8c68d20 (6190bbc4-1f29-44c9-ad9f-f02fc8c68d20): created successfully Aug 28 09:40:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8896fe9a-6a3f-4d05-b085-84843b8bc9a8 tempest-VolumesTransfersV357Test-834098134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f623cbfd-ac8e-4ba6-8d05-1d54cfd1063b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:40:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8896fe9a-6a3f-4d05-b085-84843b8bc9a8 tempest-VolumesTransfersV357Test-834098134 None] Flow 'volume_create_manager' (136f2c34-c1f1-48ec-a79c-35cf00b8b742) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:40:27 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-8896fe9a-6a3f-4d05-b085-84843b8bc9a8 tempest-VolumesTransfersV357Test-834098134 None] Created volume successfully. Aug 28 09:40:27 devstack sudo[97418]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8d5e5a30-faa1-465e-b662-1526195b6bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e70d7ab-bd90-408f-b1eb-46dad1c00864 1073741824" returned: 0 in 0.596s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8d5e5a30-faa1-465e-b662-1526195b6bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e70d7ab-bd90-408f-b1eb-46dad1c00864 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:27 devstack sudo[97426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e70d7ab-bd90-408f-b1eb-46dad1c00864 Aug 28 09:40:27 devstack sudo[97426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:28 devstack sudo[97426]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8d5e5a30-faa1-465e-b662-1526195b6bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e70d7ab-bd90-408f-b1eb-46dad1c00864" returned: 0 in 0.321s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:28 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-8d5e5a30-faa1-465e-b662-1526195b6bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:40:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8d5e5a30-faa1-465e-b662-1526195b6bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:40:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8d5e5a30-faa1-465e-b662-1526195b6bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db31feee-e4cc-42d8-acea-b3c399af0652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e70d7ab-bd90-408f-b1eb-46dad1c00864', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:40:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8d5e5a30-faa1-465e-b662-1526195b6bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b32d9b33-f78d-4b39-9d1c-dd296fe43963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:40:28 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-8d5e5a30-faa1-465e-b662-1526195b6bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Volume volume-2e70d7ab-bd90-408f-b1eb-46dad1c00864 (2e70d7ab-bd90-408f-b1eb-46dad1c00864): created successfully Aug 28 09:40:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8d5e5a30-faa1-465e-b662-1526195b6bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b32d9b33-f78d-4b39-9d1c-dd296fe43963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:40:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8d5e5a30-faa1-465e-b662-1526195b6bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Flow 'volume_create_manager' (99fb6d9b-d7cf-4b96-b91e-246013d003f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:40:28 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-8d5e5a30-faa1-465e-b662-1526195b6bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Created volume successfully. Aug 28 09:40:28 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-fc7d532d-44ef-4d04-94a6-790d760c8ebc tempest-VolumesTransfersV357Test-600004164 None] Transfer volume completed successfully. Aug 28 09:40:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b2213fe9-6edd-437b-b77b-5b53f17bc448 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:40:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b2213fe9-6edd-437b-b77b-5b53f17bc448 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:40:29 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-b2213fe9-6edd-437b-b77b-5b53f17bc448 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Creating offline snapshot a93509b2-52e8-4ec8-821e-81390478b2b0 of volume 2e70d7ab-bd90-408f-b1eb-46dad1c00864 {{(pid=86081) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:40:29 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a84e309-8480-491a-b9ca-a46df07b4752]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:40:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b2213fe9-6edd-437b-b77b-5b53f17bc448 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e70d7ab-bd90-408f-b1eb-46dad1c00864 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:29 devstack sudo[97436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e70d7ab-bd90-408f-b1eb-46dad1c00864 Aug 28 09:40:29 devstack sudo[97436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:29 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-98c303ad-ebc7-42d0-ab7e-e789af48c7b2 tempest-VolumesTransfersV357Test-169951230 None] Acquiring lock "cinder-6190bbc4-1f29-44c9-ad9f-f02fc8c68d20-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:40:29 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-98c303ad-ebc7-42d0-ab7e-e789af48c7b2 tempest-VolumesTransfersV357Test-169951230 None] Lock "cinder-6190bbc4-1f29-44c9-ad9f-f02fc8c68d20-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:40:29 devstack sudo[97436]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b2213fe9-6edd-437b-b77b-5b53f17bc448 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e70d7ab-bd90-408f-b1eb-46dad1c00864" returned: 0 in 0.448s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b2213fe9-6edd-437b-b77b-5b53f17bc448 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e70d7ab-bd90-408f-b1eb-46dad1c00864,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e70d7ab-bd90-408f-b1eb-46dad1c00864.a93509b2-52e8-4ec8-821e-81390478b2b0 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:29 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-98c303ad-ebc7-42d0-ab7e-e789af48c7b2 tempest-VolumesTransfersV357Test-169951230 None] Acquiring lock "cinder-quobyte-6190bbc4-1f29-44c9-ad9f-f02fc8c68d20" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:40:29 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-98c303ad-ebc7-42d0-ab7e-e789af48c7b2 tempest-VolumesTransfersV357Test-169951230 None] Lock "cinder-quobyte-6190bbc4-1f29-44c9-ad9f-f02fc8c68d20" acquired by "delete_volume" :: waited 0.022s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:40:29 devstack sudo[97443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e70d7ab-bd90-408f-b1eb-46dad1c00864,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e70d7ab-bd90-408f-b1eb-46dad1c00864.a93509b2-52e8-4ec8-821e-81390478b2b0 1G Aug 28 09:40:29 devstack sudo[97443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:30 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0217e6-db59-4f0a-9505-9c0bbb40b151]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:40:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-98c303ad-ebc7-42d0-ab7e-e789af48c7b2 tempest-VolumesTransfersV357Test-169951230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6190bbc4-1f29-44c9-ad9f-f02fc8c68d20 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:30 devstack sudo[97445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6190bbc4-1f29-44c9-ad9f-f02fc8c68d20 Aug 28 09:40:30 devstack sudo[97445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:30 devstack sudo[97445]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-98c303ad-ebc7-42d0-ab7e-e789af48c7b2 tempest-VolumesTransfersV357Test-169951230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6190bbc4-1f29-44c9-ad9f-f02fc8c68d20" returned: 0 in 0.440s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-98c303ad-ebc7-42d0-ab7e-e789af48c7b2 tempest-VolumesTransfersV357Test-169951230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6190bbc4-1f29-44c9-ad9f-f02fc8c68d20 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:30 devstack sudo[97443]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b2213fe9-6edd-437b-b77b-5b53f17bc448 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e70d7ab-bd90-408f-b1eb-46dad1c00864,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e70d7ab-bd90-408f-b1eb-46dad1c00864.a93509b2-52e8-4ec8-821e-81390478b2b0 1G" returned: 0 in 0.527s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b2213fe9-6edd-437b-b77b-5b53f17bc448 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e70d7ab-bd90-408f-b1eb-46dad1c00864 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e70d7ab-bd90-408f-b1eb-46dad1c00864.a93509b2-52e8-4ec8-821e-81390478b2b0 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:30 devstack sudo[97457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6190bbc4-1f29-44c9-ad9f-f02fc8c68d20 Aug 28 09:40:30 devstack sudo[97457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:30 devstack sudo[97458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e70d7ab-bd90-408f-b1eb-46dad1c00864 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e70d7ab-bd90-408f-b1eb-46dad1c00864.a93509b2-52e8-4ec8-821e-81390478b2b0 Aug 28 09:40:30 devstack sudo[97458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:30 devstack sudo[97458]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b2213fe9-6edd-437b-b77b-5b53f17bc448 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e70d7ab-bd90-408f-b1eb-46dad1c00864 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e70d7ab-bd90-408f-b1eb-46dad1c00864.a93509b2-52e8-4ec8-821e-81390478b2b0" returned: 0 in 0.360s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:30 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-b2213fe9-6edd-437b-b77b-5b53f17bc448 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e70d7ab-bd90-408f-b1eb-46dad1c00864.a93509b2-52e8-4ec8-821e-81390478b2b0 is being set with open permissions: ugo+rw Aug 28 09:40:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b2213fe9-6edd-437b-b77b-5b53f17bc448 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e70d7ab-bd90-408f-b1eb-46dad1c00864.a93509b2-52e8-4ec8-821e-81390478b2b0 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:30 devstack sudo[97457]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-98c303ad-ebc7-42d0-ab7e-e789af48c7b2 tempest-VolumesTransfersV357Test-169951230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6190bbc4-1f29-44c9-ad9f-f02fc8c68d20" returned: 0 in 0.417s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:30 devstack sudo[97466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e70d7ab-bd90-408f-b1eb-46dad1c00864.a93509b2-52e8-4ec8-821e-81390478b2b0 Aug 28 09:40:30 devstack sudo[97466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:30 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-98c303ad-ebc7-42d0-ab7e-e789af48c7b2 tempest-VolumesTransfersV357Test-169951230 None] Lock "cinder-quobyte-6190bbc4-1f29-44c9-ad9f-f02fc8c68d20" released by "delete_volume" :: held 0.923s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:40:30 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-98c303ad-ebc7-42d0-ab7e-e789af48c7b2 tempest-VolumesTransfersV357Test-169951230 None] Created reservations ['1bbecb31-146f-449d-bf79-5478631ada5f', '18e0c979-6eaa-483c-8155-e04b20ab2bb0', '35bd9132-1e96-4b5d-b999-2ab8d5cad5ab', 'e1f083b7-1226-4d72-b086-aaedd3a3d7f3'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:40:31 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-04cd3a8f-fbfe-4155-96fd-4f4d646ddbba tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:40:31 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-04cd3a8f-fbfe-4155-96fd-4f4d646ddbba tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Flow 'volume_create_manager' (6d1ad25c-e415-47f7-9800-7338d115e9d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:40:31 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-04cd3a8f-fbfe-4155-96fd-4f4d646ddbba tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (245ba92d-e1fa-4152-be5c-397862a38064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:40:31 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-04cd3a8f-fbfe-4155-96fd-4f4d646ddbba tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (245ba92d-e1fa-4152-be5c-397862a38064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:40:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-876883767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=286ce3e5-8153-4e26-a98c-42092905b613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='500d2d99ba764d368da3b6810d1391a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:40:31Z,use_quota=True,user_id='46cf3ecb5d164167ba224e4366205f58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(40605594-676d-4f79-ba79-2e234747ecbc),volume_type_id=40605594-676d-4f79-ba79-2e234747ecbc)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:40:31 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-04cd3a8f-fbfe-4155-96fd-4f4d646ddbba tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bf55050-0a9f-464a-bfb0-f0d7bc91ba2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:40:31 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-04cd3a8f-fbfe-4155-96fd-4f4d646ddbba tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bf55050-0a9f-464a-bfb0-f0d7bc91ba2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:40:31 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-04cd3a8f-fbfe-4155-96fd-4f4d646ddbba tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a23dfce-8767-4a35-b079-6b83488a3285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:40:31 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-04cd3a8f-fbfe-4155-96fd-4f4d646ddbba tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a23dfce-8767-4a35-b079-6b83488a3285) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '286ce3e5-8153-4e26-a98c-42092905b613', 'volume_name': 'volume-286ce3e5-8153-4e26-a98c-42092905b613', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:40:31 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-04cd3a8f-fbfe-4155-96fd-4f4d646ddbba tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3765369f-6dd6-406a-aef3-87bf90fab6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:40:31 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-04cd3a8f-fbfe-4155-96fd-4f4d646ddbba tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3765369f-6dd6-406a-aef3-87bf90fab6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:40:31 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-04cd3a8f-fbfe-4155-96fd-4f4d646ddbba tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8756b766-ff37-4ede-a5fb-f2161568ca4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:40:31 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-04cd3a8f-fbfe-4155-96fd-4f4d646ddbba tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Volume 286ce3e5-8153-4e26-a98c-42092905b613: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-286ce3e5-8153-4e26-a98c-42092905b613', 'volume_size': 1} Aug 28 09:40:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-04cd3a8f-fbfe-4155-96fd-4f4d646ddbba tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:40:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-98c303ad-ebc7-42d0-ab7e-e789af48c7b2 tempest-VolumesTransfersV357Test-169951230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:40:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-98c303ad-ebc7-42d0-ab7e-e789af48c7b2 tempest-VolumesTransfersV357Test-169951230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:40:31 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-98c303ad-ebc7-42d0-ab7e-e789af48c7b2 tempest-VolumesTransfersV357Test-169951230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:40:31 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-98c303ad-ebc7-42d0-ab7e-e789af48c7b2 tempest-VolumesTransfersV357Test-169951230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:40:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-98c303ad-ebc7-42d0-ab7e-e789af48c7b2 tempest-VolumesTransfersV357Test-169951230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:40:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-98c303ad-ebc7-42d0-ab7e-e789af48c7b2 tempest-VolumesTransfersV357Test-169951230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:31 devstack sudo[97477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:40:31 devstack sudo[97477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:31 devstack sudo[97466]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b2213fe9-6edd-437b-b77b-5b53f17bc448 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e70d7ab-bd90-408f-b1eb-46dad1c00864.a93509b2-52e8-4ec8-821e-81390478b2b0" returned: 0 in 0.360s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b2213fe9-6edd-437b-b77b-5b53f17bc448 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e70d7ab-bd90-408f-b1eb-46dad1c00864.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:31 devstack sudo[97479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e70d7ab-bd90-408f-b1eb-46dad1c00864.info Aug 28 09:40:31 devstack sudo[97479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-0c879dd0-5651-439d-a90a-d9081ab06a45 req-390c3f13-7f43-44c8-a6b0-1657711693c7 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:40:31 devstack sudo[97477]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-98c303ad-ebc7-42d0-ab7e-e789af48c7b2 tempest-VolumesTransfersV357Test-169951230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.269s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:31 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-98c303ad-ebc7-42d0-ab7e-e789af48c7b2 tempest-VolumesTransfersV357Test-169951230 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:40:31 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-98c303ad-ebc7-42d0-ab7e-e789af48c7b2 tempest-VolumesTransfersV357Test-169951230 None] Deleted volume successfully. Aug 28 09:40:31 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-98c303ad-ebc7-42d0-ab7e-e789af48c7b2 tempest-VolumesTransfersV357Test-169951230 None] Lock "cinder-6190bbc4-1f29-44c9-ad9f-f02fc8c68d20-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:40:31 devstack sudo[97479]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b2213fe9-6edd-437b-b77b-5b53f17bc448 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e70d7ab-bd90-408f-b1eb-46dad1c00864.info" returned: 0 in 0.282s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:31 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-b2213fe9-6edd-437b-b77b-5b53f17bc448 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e70d7ab-bd90-408f-b1eb-46dad1c00864.info is being set with open permissions: ugo+rw Aug 28 09:40:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b2213fe9-6edd-437b-b77b-5b53f17bc448 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e70d7ab-bd90-408f-b1eb-46dad1c00864.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:31 devstack sudo[97483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e70d7ab-bd90-408f-b1eb-46dad1c00864.info Aug 28 09:40:31 devstack sudo[97483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:31 devstack sudo[97483]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b2213fe9-6edd-437b-b77b-5b53f17bc448 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e70d7ab-bd90-408f-b1eb-46dad1c00864.info" returned: 0 in 0.253s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b2213fe9-6edd-437b-b77b-5b53f17bc448 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.358s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:40:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-04cd3a8f-fbfe-4155-96fd-4f4d646ddbba tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.680s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:40:31 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-04cd3a8f-fbfe-4155-96fd-4f4d646ddbba tempest-VolumeRetypeWithoutMigrationTest-762310469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:40:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-876883767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=286ce3e5-8153-4e26-a98c-42092905b613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='500d2d99ba764d368da3b6810d1391a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:40:31Z,use_quota=True,user_id='46cf3ecb5d164167ba224e4366205f58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(40605594-676d-4f79-ba79-2e234747ecbc),volume_type_id=40605594-676d-4f79-ba79-2e234747ecbc)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:40:31 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-04cd3a8f-fbfe-4155-96fd-4f4d646ddbba tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Creating volume 286ce3e5-8153-4e26-a98c-42092905b613 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:40:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-04cd3a8f-fbfe-4155-96fd-4f4d646ddbba tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:40:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-04cd3a8f-fbfe-4155-96fd-4f4d646ddbba tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:40:31 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-04cd3a8f-fbfe-4155-96fd-4f4d646ddbba tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:40:31 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-04cd3a8f-fbfe-4155-96fd-4f4d646ddbba tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:40:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-04cd3a8f-fbfe-4155-96fd-4f4d646ddbba tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:40:31 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-04cd3a8f-fbfe-4155-96fd-4f4d646ddbba tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:40:31 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-04cd3a8f-fbfe-4155-96fd-4f4d646ddbba tempest-VolumeRetypeWithoutMigrationTest-762310469 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:40:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-04cd3a8f-fbfe-4155-96fd-4f4d646ddbba tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-286ce3e5-8153-4e26-a98c-42092905b613 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:31 devstack sudo[97486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-286ce3e5-8153-4e26-a98c-42092905b613 1073741824 Aug 28 09:40:31 devstack sudo[97486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:31 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-b2213fe9-6edd-437b-b77b-5b53f17bc448 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Create snapshot completed successfully Aug 28 09:40:32 devstack sudo[97486]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-04cd3a8f-fbfe-4155-96fd-4f4d646ddbba tempest-VolumeRetypeWithoutMigrationTest-762310469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-286ce3e5-8153-4e26-a98c-42092905b613 1073741824" returned: 0 in 0.412s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-04cd3a8f-fbfe-4155-96fd-4f4d646ddbba tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-286ce3e5-8153-4e26-a98c-42092905b613 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:32 devstack sudo[97492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-286ce3e5-8153-4e26-a98c-42092905b613 Aug 28 09:40:32 devstack sudo[97492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:32 devstack sudo[97492]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-04cd3a8f-fbfe-4155-96fd-4f4d646ddbba tempest-VolumeRetypeWithoutMigrationTest-762310469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-286ce3e5-8153-4e26-a98c-42092905b613" returned: 0 in 0.268s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:32 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-04cd3a8f-fbfe-4155-96fd-4f4d646ddbba tempest-VolumeRetypeWithoutMigrationTest-762310469 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:40:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-04cd3a8f-fbfe-4155-96fd-4f4d646ddbba tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:40:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-0c879dd0-5651-439d-a90a-d9081ab06a45 req-390c3f13-7f43-44c8-a6b0-1657711693c7 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.246s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:40:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-04cd3a8f-fbfe-4155-96fd-4f4d646ddbba tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8756b766-ff37-4ede-a5fb-f2161568ca4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-286ce3e5-8153-4e26-a98c-42092905b613', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:40:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-04cd3a8f-fbfe-4155-96fd-4f4d646ddbba tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48de07ff-e882-496c-b6df-26eea0754d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:40:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-0c879dd0-5651-439d-a90a-d9081ab06a45 req-390c3f13-7f43-44c8-a6b0-1657711693c7 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:40:32 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-04cd3a8f-fbfe-4155-96fd-4f4d646ddbba tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Volume volume-286ce3e5-8153-4e26-a98c-42092905b613 (286ce3e5-8153-4e26-a98c-42092905b613): created successfully Aug 28 09:40:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-04cd3a8f-fbfe-4155-96fd-4f4d646ddbba tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48de07ff-e882-496c-b6df-26eea0754d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:40:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-04cd3a8f-fbfe-4155-96fd-4f4d646ddbba tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Flow 'volume_create_manager' (6d1ad25c-e415-47f7-9800-7338d115e9d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:40:32 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-04cd3a8f-fbfe-4155-96fd-4f4d646ddbba tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Created volume successfully. Aug 28 09:40:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-0c879dd0-5651-439d-a90a-d9081ab06a45 req-390c3f13-7f43-44c8-a6b0-1657711693c7 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b', 'name': 'volume-df4f9f4e-2a7a-4b0f-a489-c3aebc7cf713', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '18aca8b2-78b8-498b-ba0b-55cc15dbba3e', 'enforce_multipath': True} {{(pid=86081) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 09:40:32 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-89457ebe-2385-4a88-9b85-f5f52546822e tempest-VolumesTransfersV357Test-834098134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:40:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-89457ebe-2385-4a88-9b85-f5f52546822e tempest-VolumesTransfersV357Test-834098134 None] Flow 'volume_create_manager' (3fa46ec0-bccb-4322-ae07-dce3e603ee8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:40:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-89457ebe-2385-4a88-9b85-f5f52546822e tempest-VolumesTransfersV357Test-834098134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e849f7e2-f264-4e63-a863-59296eeb4bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:40:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-89457ebe-2385-4a88-9b85-f5f52546822e tempest-VolumesTransfersV357Test-834098134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e849f7e2-f264-4e63-a863-59296eeb4bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1248957754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce04fc31-d4d0-46f6-b781-359891e34b82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b2562aa3e4e4a8e93c3298753f40fa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:40:33Z,use_quota=True,user_id='bba27377207f44ea94c6d12edc00046b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:40:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-89457ebe-2385-4a88-9b85-f5f52546822e tempest-VolumesTransfersV357Test-834098134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (992c95c5-4994-406d-89dd-76f2829d8f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:40:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-89457ebe-2385-4a88-9b85-f5f52546822e tempest-VolumesTransfersV357Test-834098134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (992c95c5-4994-406d-89dd-76f2829d8f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:40:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-89457ebe-2385-4a88-9b85-f5f52546822e tempest-VolumesTransfersV357Test-834098134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e322cbc-2bf3-403f-8279-1ca0f30c764d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:40:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-89457ebe-2385-4a88-9b85-f5f52546822e tempest-VolumesTransfersV357Test-834098134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e322cbc-2bf3-403f-8279-1ca0f30c764d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce04fc31-d4d0-46f6-b781-359891e34b82', 'volume_name': 'volume-ce04fc31-d4d0-46f6-b781-359891e34b82', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:40:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-89457ebe-2385-4a88-9b85-f5f52546822e tempest-VolumesTransfersV357Test-834098134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (def9d549-9951-4f11-9323-1116c53ec55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:40:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-89457ebe-2385-4a88-9b85-f5f52546822e tempest-VolumesTransfersV357Test-834098134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (def9d549-9951-4f11-9323-1116c53ec55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:40:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-89457ebe-2385-4a88-9b85-f5f52546822e tempest-VolumesTransfersV357Test-834098134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f7f638e-8eac-44c9-9836-fa1ed31007e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:40:32 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-89457ebe-2385-4a88-9b85-f5f52546822e tempest-VolumesTransfersV357Test-834098134 None] Volume ce04fc31-d4d0-46f6-b781-359891e34b82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce04fc31-d4d0-46f6-b781-359891e34b82', 'volume_size': 1} Aug 28 09:40:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-89457ebe-2385-4a88-9b85-f5f52546822e tempest-VolumesTransfersV357Test-834098134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:40:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-89457ebe-2385-4a88-9b85-f5f52546822e tempest-VolumesTransfersV357Test-834098134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:40:32 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-89457ebe-2385-4a88-9b85-f5f52546822e tempest-VolumesTransfersV357Test-834098134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1248957754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce04fc31-d4d0-46f6-b781-359891e34b82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b2562aa3e4e4a8e93c3298753f40fa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:40:33Z,use_quota=True,user_id='bba27377207f44ea94c6d12edc00046b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:40:32 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-89457ebe-2385-4a88-9b85-f5f52546822e tempest-VolumesTransfersV357Test-834098134 None] Creating volume ce04fc31-d4d0-46f6-b781-359891e34b82 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:40:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-89457ebe-2385-4a88-9b85-f5f52546822e tempest-VolumesTransfersV357Test-834098134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:40:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-89457ebe-2385-4a88-9b85-f5f52546822e tempest-VolumesTransfersV357Test-834098134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:40:32 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-89457ebe-2385-4a88-9b85-f5f52546822e tempest-VolumesTransfersV357Test-834098134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:40:32 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-89457ebe-2385-4a88-9b85-f5f52546822e tempest-VolumesTransfersV357Test-834098134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:40:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-89457ebe-2385-4a88-9b85-f5f52546822e tempest-VolumesTransfersV357Test-834098134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:40:32 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-89457ebe-2385-4a88-9b85-f5f52546822e tempest-VolumesTransfersV357Test-834098134 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:40:32 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-89457ebe-2385-4a88-9b85-f5f52546822e tempest-VolumesTransfersV357Test-834098134 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:40:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-89457ebe-2385-4a88-9b85-f5f52546822e tempest-VolumesTransfersV357Test-834098134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ce04fc31-d4d0-46f6-b781-359891e34b82 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:32 devstack cinder-volume[86081]: INFO cinder.volume.manager [req-0c879dd0-5651-439d-a90a-d9081ab06a45 req-390c3f13-7f43-44c8-a6b0-1657711693c7 tempest-TestServerVolumeAttachmentScenario-1064473967 None] attachment_update completed successfully. Aug 28 09:40:32 devstack sudo[97495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ce04fc31-d4d0-46f6-b781-359891e34b82 1073741824 Aug 28 09:40:32 devstack sudo[97495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:33 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-11b8509a-928a-4298-b9d9-311ed6ac6609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Acquiring lock "cinder-a93509b2-52e8-4ec8-821e-81390478b2b0-delete_snapshot" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:40:33 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-11b8509a-928a-4298-b9d9-311ed6ac6609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Lock "cinder-a93509b2-52e8-4ec8-821e-81390478b2b0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:40:33 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-11b8509a-928a-4298-b9d9-311ed6ac6609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Acquiring lock "cinder-quobyte-2e70d7ab-bd90-408f-b1eb-46dad1c00864" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:40:33 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-11b8509a-928a-4298-b9d9-311ed6ac6609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Lock "cinder-quobyte-2e70d7ab-bd90-408f-b1eb-46dad1c00864" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:40:33 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-11b8509a-928a-4298-b9d9-311ed6ac6609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Acquiring lock "cinder-quobyte-a93509b2-52e8-4ec8-821e-81390478b2b0" by "_delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:40:33 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-11b8509a-928a-4298-b9d9-311ed6ac6609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Lock "cinder-quobyte-a93509b2-52e8-4ec8-821e-81390478b2b0" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:40:33 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-11b8509a-928a-4298-b9d9-311ed6ac6609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Deleting offline snapshot a93509b2-52e8-4ec8-821e-81390478b2b0 of volume 2e70d7ab-bd90-408f-b1eb-46dad1c00864 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:40:33 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-11b8509a-928a-4298-b9d9-311ed6ac6609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] snapshot_file for this snap is: volume-2e70d7ab-bd90-408f-b1eb-46dad1c00864.a93509b2-52e8-4ec8-821e-81390478b2b0 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:40:33 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d39400-d06f-4d21-9e20-94f2f3283165]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:40:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-11b8509a-928a-4298-b9d9-311ed6ac6609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e70d7ab-bd90-408f-b1eb-46dad1c00864.a93509b2-52e8-4ec8-821e-81390478b2b0 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:33 devstack sudo[97495]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-89457ebe-2385-4a88-9b85-f5f52546822e tempest-VolumesTransfersV357Test-834098134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ce04fc31-d4d0-46f6-b781-359891e34b82 1073741824" returned: 0 in 0.628s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-89457ebe-2385-4a88-9b85-f5f52546822e tempest-VolumesTransfersV357Test-834098134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ce04fc31-d4d0-46f6-b781-359891e34b82 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:33 devstack sudo[97503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e70d7ab-bd90-408f-b1eb-46dad1c00864.a93509b2-52e8-4ec8-821e-81390478b2b0 Aug 28 09:40:33 devstack sudo[97503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:33 devstack sudo[97504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ce04fc31-d4d0-46f6-b781-359891e34b82 Aug 28 09:40:33 devstack sudo[97504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-83ef1d87-0432-42ec-aba1-a8edcdd7e467 tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:40:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-83ef1d87-0432-42ec-aba1-a8edcdd7e467 tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:40:33 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-83ef1d87-0432-42ec-aba1-a8edcdd7e467 tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:40:33 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-83ef1d87-0432-42ec-aba1-a8edcdd7e467 tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:40:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-83ef1d87-0432-42ec-aba1-a8edcdd7e467 tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:40:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-83ef1d87-0432-42ec-aba1-a8edcdd7e467 tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:33 devstack sudo[97507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:40:33 devstack sudo[97507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:33 devstack sudo[97504]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-89457ebe-2385-4a88-9b85-f5f52546822e tempest-VolumesTransfersV357Test-834098134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ce04fc31-d4d0-46f6-b781-359891e34b82" returned: 0 in 0.340s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:33 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-89457ebe-2385-4a88-9b85-f5f52546822e tempest-VolumesTransfersV357Test-834098134 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:40:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-89457ebe-2385-4a88-9b85-f5f52546822e tempest-VolumesTransfersV357Test-834098134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:40:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-89457ebe-2385-4a88-9b85-f5f52546822e tempest-VolumesTransfersV357Test-834098134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f7f638e-8eac-44c9-9836-fa1ed31007e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce04fc31-d4d0-46f6-b781-359891e34b82', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:40:33 devstack sudo[97503]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-89457ebe-2385-4a88-9b85-f5f52546822e tempest-VolumesTransfersV357Test-834098134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a04cd11e-687a-49bc-a50d-2d095a3bc775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:40:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-11b8509a-928a-4298-b9d9-311ed6ac6609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e70d7ab-bd90-408f-b1eb-46dad1c00864.a93509b2-52e8-4ec8-821e-81390478b2b0" returned: 0 in 0.450s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:33 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-11b8509a-928a-4298-b9d9-311ed6ac6609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e70d7ab-bd90-408f-b1eb-46dad1c00864(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:40:33 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-89457ebe-2385-4a88-9b85-f5f52546822e tempest-VolumesTransfersV357Test-834098134 None] Volume volume-ce04fc31-d4d0-46f6-b781-359891e34b82 (ce04fc31-d4d0-46f6-b781-359891e34b82): created successfully Aug 28 09:40:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-89457ebe-2385-4a88-9b85-f5f52546822e tempest-VolumesTransfersV357Test-834098134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a04cd11e-687a-49bc-a50d-2d095a3bc775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:40:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-89457ebe-2385-4a88-9b85-f5f52546822e tempest-VolumesTransfersV357Test-834098134 None] Flow 'volume_create_manager' (3fa46ec0-bccb-4322-ae07-dce3e603ee8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:40:33 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a4c7ff-5f82-4e52-8957-a45267cf848a]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:40:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-11b8509a-928a-4298-b9d9-311ed6ac6609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e70d7ab-bd90-408f-b1eb-46dad1c00864 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:33 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-89457ebe-2385-4a88-9b85-f5f52546822e tempest-VolumesTransfersV357Test-834098134 None] Created volume successfully. Aug 28 09:40:33 devstack sudo[97507]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-83ef1d87-0432-42ec-aba1-a8edcdd7e467 tempest-VolumeRetypeWithoutMigrationTest-762310469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.251s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:33 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-83ef1d87-0432-42ec-aba1-a8edcdd7e467 tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:40:33 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-83ef1d87-0432-42ec-aba1-a8edcdd7e467 tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Retype volume completed successfully. Aug 28 09:40:33 devstack sudo[97513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e70d7ab-bd90-408f-b1eb-46dad1c00864 Aug 28 09:40:33 devstack sudo[97513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:34 devstack sudo[97513]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-11b8509a-928a-4298-b9d9-311ed6ac6609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e70d7ab-bd90-408f-b1eb-46dad1c00864" returned: 0 in 0.363s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-11b8509a-928a-4298-b9d9-311ed6ac6609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e70d7ab-bd90-408f-b1eb-46dad1c00864.a93509b2-52e8-4ec8-821e-81390478b2b0 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:34 devstack sudo[97519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e70d7ab-bd90-408f-b1eb-46dad1c00864.a93509b2-52e8-4ec8-821e-81390478b2b0 Aug 28 09:40:34 devstack sudo[97519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:34 devstack sudo[97519]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-11b8509a-928a-4298-b9d9-311ed6ac6609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e70d7ab-bd90-408f-b1eb-46dad1c00864.a93509b2-52e8-4ec8-821e-81390478b2b0" returned: 0 in 0.391s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-11b8509a-928a-4298-b9d9-311ed6ac6609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e70d7ab-bd90-408f-b1eb-46dad1c00864.a93509b2-52e8-4ec8-821e-81390478b2b0 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:34 devstack sudo[97526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e70d7ab-bd90-408f-b1eb-46dad1c00864.a93509b2-52e8-4ec8-821e-81390478b2b0 Aug 28 09:40:34 devstack sudo[97526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:34 devstack sudo[97526]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-11b8509a-928a-4298-b9d9-311ed6ac6609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e70d7ab-bd90-408f-b1eb-46dad1c00864.a93509b2-52e8-4ec8-821e-81390478b2b0" returned: 0 in 0.296s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:34 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-31135ff2-cb01-489a-8d30-dcc3d32c9a52 tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Acquiring lock "cinder-286ce3e5-8153-4e26-a98c-42092905b613-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:40:34 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-31135ff2-cb01-489a-8d30-dcc3d32c9a52 tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Lock "cinder-286ce3e5-8153-4e26-a98c-42092905b613-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:40:35 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-11b8509a-928a-4298-b9d9-311ed6ac6609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Lock "cinder-quobyte-a93509b2-52e8-4ec8-821e-81390478b2b0" released by "_delete_snapshot" :: held 1.693s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:40:35 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-11b8509a-928a-4298-b9d9-311ed6ac6609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Lock "cinder-quobyte-2e70d7ab-bd90-408f-b1eb-46dad1c00864" released by "delete_snapshot" :: held 1.731s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:40:35 devstack cinder-volume[86081]: INFO cinder.volume.manager [req-d45ad1ea-8881-4c63-8dd3-ebd403e74520 req-cb28923d-58f7-4723-992d-714df5423401 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Terminate volume connection completed successfully. Aug 28 09:40:35 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-d45ad1ea-8881-4c63-8dd3-ebd403e74520 req-cb28923d-58f7-4723-992d-714df5423401 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Deleting attachment 18aca8b2-78b8-498b-ba0b-55cc15dbba3e. {{(pid=86081) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 09:40:35 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-31135ff2-cb01-489a-8d30-dcc3d32c9a52 tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Acquiring lock "cinder-quobyte-286ce3e5-8153-4e26-a98c-42092905b613" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:40:35 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-31135ff2-cb01-489a-8d30-dcc3d32c9a52 tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Lock "cinder-quobyte-286ce3e5-8153-4e26-a98c-42092905b613" acquired by "delete_volume" :: waited 0.025s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:40:35 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8fe6ca-10ea-44f4-bd85-32d3b456036e]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:40:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-31135ff2-cb01-489a-8d30-dcc3d32c9a52 tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-286ce3e5-8153-4e26-a98c-42092905b613 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:35 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-11b8509a-928a-4298-b9d9-311ed6ac6609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Created reservations ['b25191b2-d022-49d3-af31-611efd6c3044', '26873f52-93cb-4b3c-b9ec-b1f8aa5a0dfb', 'fd19da8d-af17-40ef-a4fd-b7cb9685a74a', '8805892d-06f0-4318-9b79-6531d9aa0a0c'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:40:35 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6b4f23cd-f1ff-4c51-9c5c-56af14e79bff tempest-VolumesTransfersV357Test-169951230 None] Acquiring lock "cinder-ce04fc31-d4d0-46f6-b781-359891e34b82-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:40:35 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6b4f23cd-f1ff-4c51-9c5c-56af14e79bff tempest-VolumesTransfersV357Test-169951230 None] Lock "cinder-ce04fc31-d4d0-46f6-b781-359891e34b82-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:40:35 devstack sudo[97531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-286ce3e5-8153-4e26-a98c-42092905b613 Aug 28 09:40:35 devstack sudo[97531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:35 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6b4f23cd-f1ff-4c51-9c5c-56af14e79bff tempest-VolumesTransfersV357Test-169951230 None] Acquiring lock "cinder-quobyte-ce04fc31-d4d0-46f6-b781-359891e34b82" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:40:35 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-11b8509a-928a-4298-b9d9-311ed6ac6609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Delete snapshot completed successfully. Aug 28 09:40:35 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-11b8509a-928a-4298-b9d9-311ed6ac6609 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Lock "cinder-a93509b2-52e8-4ec8-821e-81390478b2b0-delete_snapshot" released by "delete_snapshot" :: held 2.017s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:40:35 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6b4f23cd-f1ff-4c51-9c5c-56af14e79bff tempest-VolumesTransfersV357Test-169951230 None] Lock "cinder-quobyte-ce04fc31-d4d0-46f6-b781-359891e34b82" acquired by "delete_volume" :: waited 0.015s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:40:35 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dda4cae-e274-48b2-8ffc-d6534af8ca74]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:40:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6b4f23cd-f1ff-4c51-9c5c-56af14e79bff tempest-VolumesTransfersV357Test-169951230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ce04fc31-d4d0-46f6-b781-359891e34b82 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:35 devstack sudo[97533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ce04fc31-d4d0-46f6-b781-359891e34b82 Aug 28 09:40:35 devstack sudo[97533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:35 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6c06f596-7522-4f99-a124-169a46643344 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Acquiring lock "cinder-2e70d7ab-bd90-408f-b1eb-46dad1c00864-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:40:35 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6c06f596-7522-4f99-a124-169a46643344 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Lock "cinder-2e70d7ab-bd90-408f-b1eb-46dad1c00864-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:40:35 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6c06f596-7522-4f99-a124-169a46643344 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Acquiring lock "cinder-quobyte-2e70d7ab-bd90-408f-b1eb-46dad1c00864" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:40:35 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6c06f596-7522-4f99-a124-169a46643344 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Lock "cinder-quobyte-2e70d7ab-bd90-408f-b1eb-46dad1c00864" acquired by "delete_volume" :: waited 0.017s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:40:35 devstack sudo[97531]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-31135ff2-cb01-489a-8d30-dcc3d32c9a52 tempest-VolumeRetypeWithoutMigrationTest-762310469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-286ce3e5-8153-4e26-a98c-42092905b613" returned: 0 in 0.461s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-31135ff2-cb01-489a-8d30-dcc3d32c9a52 tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-286ce3e5-8153-4e26-a98c-42092905b613 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:35 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1aa290a-bf1e-4c89-a741-31b093b2fb0b]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:40:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6c06f596-7522-4f99-a124-169a46643344 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e70d7ab-bd90-408f-b1eb-46dad1c00864 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:35 devstack sudo[97538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-286ce3e5-8153-4e26-a98c-42092905b613 Aug 28 09:40:35 devstack sudo[97538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:35 devstack sudo[97533]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6b4f23cd-f1ff-4c51-9c5c-56af14e79bff tempest-VolumesTransfersV357Test-169951230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ce04fc31-d4d0-46f6-b781-359891e34b82" returned: 0 in 0.435s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6b4f23cd-f1ff-4c51-9c5c-56af14e79bff tempest-VolumesTransfersV357Test-169951230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ce04fc31-d4d0-46f6-b781-359891e34b82 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:35 devstack sudo[97539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e70d7ab-bd90-408f-b1eb-46dad1c00864 Aug 28 09:40:35 devstack sudo[97539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:35 devstack sudo[97546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ce04fc31-d4d0-46f6-b781-359891e34b82 Aug 28 09:40:35 devstack sudo[97546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:35 devstack sudo[97538]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-31135ff2-cb01-489a-8d30-dcc3d32c9a52 tempest-VolumeRetypeWithoutMigrationTest-762310469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-286ce3e5-8153-4e26-a98c-42092905b613" returned: 0 in 0.306s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:35 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-31135ff2-cb01-489a-8d30-dcc3d32c9a52 tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Lock "cinder-quobyte-286ce3e5-8153-4e26-a98c-42092905b613" released by "delete_volume" :: held 0.825s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:40:35 devstack cinder-volume[86081]: WARNING cinder.quota [None req-31135ff2-cb01-489a-8d30-dcc3d32c9a52 tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 28 09:40:35 devstack cinder-volume[86081]: WARNING cinder.quota [None req-31135ff2-cb01-489a-8d30-dcc3d32c9a52 tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 28 09:40:35 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-31135ff2-cb01-489a-8d30-dcc3d32c9a52 tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Created reservations ['777ebdfa-ce03-415a-b042-b54766c59fac', '01643d1f-4dec-42ca-b16e-e8ab0bc2fa99', 'f33bfc39-6348-44c1-a5d8-d4554620c888', '2f916faf-a553-40e5-a188-c4058341a713'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:40:36 devstack sudo[97539]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6c06f596-7522-4f99-a124-169a46643344 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e70d7ab-bd90-408f-b1eb-46dad1c00864" returned: 0 in 0.451s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6c06f596-7522-4f99-a124-169a46643344 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e70d7ab-bd90-408f-b1eb-46dad1c00864 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:36 devstack sudo[97546]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-31135ff2-cb01-489a-8d30-dcc3d32c9a52 tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:40:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-31135ff2-cb01-489a-8d30-dcc3d32c9a52 tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:40:36 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-31135ff2-cb01-489a-8d30-dcc3d32c9a52 tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:40:36 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-31135ff2-cb01-489a-8d30-dcc3d32c9a52 tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:40:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-31135ff2-cb01-489a-8d30-dcc3d32c9a52 tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:40:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-31135ff2-cb01-489a-8d30-dcc3d32c9a52 tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:36 devstack sudo[97553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e70d7ab-bd90-408f-b1eb-46dad1c00864 Aug 28 09:40:36 devstack sudo[97553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6b4f23cd-f1ff-4c51-9c5c-56af14e79bff tempest-VolumesTransfersV357Test-169951230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ce04fc31-d4d0-46f6-b781-359891e34b82" returned: 0 in 0.356s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:36 devstack sudo[97555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:40:36 devstack sudo[97555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:36 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6b4f23cd-f1ff-4c51-9c5c-56af14e79bff tempest-VolumesTransfersV357Test-169951230 None] Lock "cinder-quobyte-ce04fc31-d4d0-46f6-b781-359891e34b82" released by "delete_volume" :: held 0.855s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:40:36 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-6b4f23cd-f1ff-4c51-9c5c-56af14e79bff tempest-VolumesTransfersV357Test-169951230 None] Created reservations ['226e8011-b823-4fe3-b39c-13f0251264b1', 'fff4aae3-3022-4340-93a5-8e1ad78656da', '4aa26a14-82e8-4041-a358-6cc72254b64a', '9bae3f3f-c1a9-4ba0-aea6-f5e91e747f5c'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:40:36 devstack sudo[97553]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6c06f596-7522-4f99-a124-169a46643344 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2e70d7ab-bd90-408f-b1eb-46dad1c00864" returned: 0 in 0.319s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:36 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6c06f596-7522-4f99-a124-169a46643344 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Lock "cinder-quobyte-2e70d7ab-bd90-408f-b1eb-46dad1c00864" released by "delete_volume" :: held 0.854s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:40:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-6b4f23cd-f1ff-4c51-9c5c-56af14e79bff tempest-VolumesTransfersV357Test-169951230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:40:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-6b4f23cd-f1ff-4c51-9c5c-56af14e79bff tempest-VolumesTransfersV357Test-169951230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:40:36 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-6b4f23cd-f1ff-4c51-9c5c-56af14e79bff tempest-VolumesTransfersV357Test-169951230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:40:36 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-6b4f23cd-f1ff-4c51-9c5c-56af14e79bff tempest-VolumesTransfersV357Test-169951230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:40:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-6b4f23cd-f1ff-4c51-9c5c-56af14e79bff tempest-VolumesTransfersV357Test-169951230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:40:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6b4f23cd-f1ff-4c51-9c5c-56af14e79bff tempest-VolumesTransfersV357Test-169951230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:36 devstack sudo[97558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:40:36 devstack sudo[97558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:36 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-6c06f596-7522-4f99-a124-169a46643344 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Created reservations ['d32c2890-05af-4488-b4e4-565fc5436963', '194f5d02-b6e6-40a1-a22f-2d09f53f655e', '3eada55b-ffdd-4e7f-a9f9-7617b29d9fb8', 'c10d4d3a-6905-488b-8481-31aab9e4af1b'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:40:36 devstack sudo[97555]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-31135ff2-cb01-489a-8d30-dcc3d32c9a52 tempest-VolumeRetypeWithoutMigrationTest-762310469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.486s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:36 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-31135ff2-cb01-489a-8d30-dcc3d32c9a52 tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:40:36 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-31135ff2-cb01-489a-8d30-dcc3d32c9a52 tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Deleted volume successfully. Aug 28 09:40:36 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-31135ff2-cb01-489a-8d30-dcc3d32c9a52 tempest-VolumeRetypeWithoutMigrationTest-762310469 None] Lock "cinder-286ce3e5-8153-4e26-a98c-42092905b613-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:40:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-6c06f596-7522-4f99-a124-169a46643344 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:40:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-6c06f596-7522-4f99-a124-169a46643344 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:40:36 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-6c06f596-7522-4f99-a124-169a46643344 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:40:36 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-6c06f596-7522-4f99-a124-169a46643344 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:40:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-6c06f596-7522-4f99-a124-169a46643344 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:40:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6c06f596-7522-4f99-a124-169a46643344 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:36 devstack sudo[97563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:40:36 devstack sudo[97563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:36 devstack cinder-volume[86081]: INFO cinder.volume.manager [req-164cab0c-6573-49e1-b8b1-1e9068af2a0e req-34fec942-5933-49b9-8f41-eb9c38bceb20 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Terminate volume connection completed successfully. Aug 28 09:40:36 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-164cab0c-6573-49e1-b8b1-1e9068af2a0e req-34fec942-5933-49b9-8f41-eb9c38bceb20 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Deleting attachment c1e4cebd-626c-4fbf-83e9-d8408b5b236f. {{(pid=86081) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 09:40:36 devstack sudo[97558]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6b4f23cd-f1ff-4c51-9c5c-56af14e79bff tempest-VolumesTransfersV357Test-169951230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.367s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:36 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-6b4f23cd-f1ff-4c51-9c5c-56af14e79bff tempest-VolumesTransfersV357Test-169951230 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:40:36 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-6b4f23cd-f1ff-4c51-9c5c-56af14e79bff tempest-VolumesTransfersV357Test-169951230 None] Deleted volume successfully. Aug 28 09:40:36 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6b4f23cd-f1ff-4c51-9c5c-56af14e79bff tempest-VolumesTransfersV357Test-169951230 None] Lock "cinder-ce04fc31-d4d0-46f6-b781-359891e34b82-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:40:37 devstack sudo[97563]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6c06f596-7522-4f99-a124-169a46643344 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.329s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:37 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-6c06f596-7522-4f99-a124-169a46643344 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:40:37 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-6c06f596-7522-4f99-a124-169a46643344 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Deleted volume successfully. Aug 28 09:40:37 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6c06f596-7522-4f99-a124-169a46643344 tempest-VolumeSnapshotQuotasNegativeTestJSON-1498918808 None] Lock "cinder-2e70d7ab-bd90-408f-b1eb-46dad1c00864-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:40:38 devstack cinder-volume[86081]: DEBUG oslo_service.periodic_task [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86081) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:40:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:40:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:40:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:40:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:40:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:40:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:38 devstack sudo[97597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:40:38 devstack sudo[97597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:38 devstack sudo[97597]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.544s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:38 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:40:38 devstack cinder-volume[86081]: DEBUG oslo_service.periodic_task [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running periodic task VolumeManager._thread_info {{(pid=86081) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:40:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] thread count: 28 {{(pid=86081) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 09:40:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] thread info: [<_MainThread(MainThread, started 129914189705344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86081) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 09:40:42 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a9e7f457-b79c-4673-9041-ab9b7ed2bb29 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Acquiring lock "cinder-df4f9f4e-2a7a-4b0f-a489-c3aebc7cf713-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:40:42 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a9e7f457-b79c-4673-9041-ab9b7ed2bb29 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Lock "cinder-df4f9f4e-2a7a-4b0f-a489-c3aebc7cf713-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:40:42 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a9e7f457-b79c-4673-9041-ab9b7ed2bb29 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Acquiring lock "cinder-quobyte-df4f9f4e-2a7a-4b0f-a489-c3aebc7cf713" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:40:42 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a9e7f457-b79c-4673-9041-ab9b7ed2bb29 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Lock "cinder-quobyte-df4f9f4e-2a7a-4b0f-a489-c3aebc7cf713" acquired by "delete_volume" :: waited 0.021s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:40:42 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89d4614-9245-4030-a824-19fc061bb1d8]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:40:42 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a9e7f457-b79c-4673-9041-ab9b7ed2bb29 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-df4f9f4e-2a7a-4b0f-a489-c3aebc7cf713 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:42 devstack sudo[97621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-df4f9f4e-2a7a-4b0f-a489-c3aebc7cf713 Aug 28 09:40:42 devstack sudo[97621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:43 devstack sudo[97621]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a9e7f457-b79c-4673-9041-ab9b7ed2bb29 tempest-TestServerVolumeAttachmentScenario-1064473967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-df4f9f4e-2a7a-4b0f-a489-c3aebc7cf713" returned: 0 in 0.431s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a9e7f457-b79c-4673-9041-ab9b7ed2bb29 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-df4f9f4e-2a7a-4b0f-a489-c3aebc7cf713 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:43 devstack sudo[97627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-df4f9f4e-2a7a-4b0f-a489-c3aebc7cf713 Aug 28 09:40:43 devstack sudo[97627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:43 devstack sudo[97627]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a9e7f457-b79c-4673-9041-ab9b7ed2bb29 tempest-TestServerVolumeAttachmentScenario-1064473967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-df4f9f4e-2a7a-4b0f-a489-c3aebc7cf713" returned: 0 in 0.304s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:43 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a9e7f457-b79c-4673-9041-ab9b7ed2bb29 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Lock "cinder-quobyte-df4f9f4e-2a7a-4b0f-a489-c3aebc7cf713" released by "delete_volume" :: held 0.794s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:40:43 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-a9e7f457-b79c-4673-9041-ab9b7ed2bb29 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Created reservations ['656644ec-e91b-4da1-99ca-1b3ed94aeac4', 'a18234ac-1d40-4bf0-b5f3-a6e9bb9e1f9c', '49b8afe3-7fdb-483f-b412-d14d4ee600d5', '05150994-ebaf-4856-9da7-26d87ae1389f'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:40:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a9e7f457-b79c-4673-9041-ab9b7ed2bb29 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:40:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a9e7f457-b79c-4673-9041-ab9b7ed2bb29 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:40:43 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-a9e7f457-b79c-4673-9041-ab9b7ed2bb29 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:40:43 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-a9e7f457-b79c-4673-9041-ab9b7ed2bb29 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:40:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a9e7f457-b79c-4673-9041-ab9b7ed2bb29 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:40:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a9e7f457-b79c-4673-9041-ab9b7ed2bb29 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:43 devstack sudo[97630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:40:43 devstack sudo[97630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:43 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8b1389a3-cef4-4ce0-9103-ca1f9e5f8ea0 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Acquiring lock "cinder-68ac8c7b-bf60-48a2-b0e0-c507cc572d83-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:40:43 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8b1389a3-cef4-4ce0-9103-ca1f9e5f8ea0 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Lock "cinder-68ac8c7b-bf60-48a2-b0e0-c507cc572d83-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:40:43 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8b1389a3-cef4-4ce0-9103-ca1f9e5f8ea0 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Acquiring lock "cinder-quobyte-68ac8c7b-bf60-48a2-b0e0-c507cc572d83" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:40:44 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8b1389a3-cef4-4ce0-9103-ca1f9e5f8ea0 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Lock "cinder-quobyte-68ac8c7b-bf60-48a2-b0e0-c507cc572d83" acquired by "delete_volume" :: waited 0.017s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:40:44 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa15da3d-04e1-40d9-8a12-8c96199d96e4]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:40:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8b1389a3-cef4-4ce0-9103-ca1f9e5f8ea0 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-68ac8c7b-bf60-48a2-b0e0-c507cc572d83 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:44 devstack sudo[97630]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a9e7f457-b79c-4673-9041-ab9b7ed2bb29 tempest-TestServerVolumeAttachmentScenario-1064473967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.321s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:44 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-a9e7f457-b79c-4673-9041-ab9b7ed2bb29 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:40:44 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-a9e7f457-b79c-4673-9041-ab9b7ed2bb29 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Deleted volume successfully. Aug 28 09:40:44 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a9e7f457-b79c-4673-9041-ab9b7ed2bb29 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Lock "cinder-df4f9f4e-2a7a-4b0f-a489-c3aebc7cf713-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:40:44 devstack sudo[97633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-68ac8c7b-bf60-48a2-b0e0-c507cc572d83 Aug 28 09:40:44 devstack sudo[97633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:44 devstack sudo[97633]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8b1389a3-cef4-4ce0-9103-ca1f9e5f8ea0 tempest-TestServerVolumeAttachmentScenario-1064473967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-68ac8c7b-bf60-48a2-b0e0-c507cc572d83" returned: 0 in 0.493s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8b1389a3-cef4-4ce0-9103-ca1f9e5f8ea0 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-68ac8c7b-bf60-48a2-b0e0-c507cc572d83 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:44 devstack sudo[97638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-68ac8c7b-bf60-48a2-b0e0-c507cc572d83 Aug 28 09:40:44 devstack sudo[97638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:44 devstack sudo[97638]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8b1389a3-cef4-4ce0-9103-ca1f9e5f8ea0 tempest-TestServerVolumeAttachmentScenario-1064473967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-68ac8c7b-bf60-48a2-b0e0-c507cc572d83" returned: 0 in 0.320s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:44 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8b1389a3-cef4-4ce0-9103-ca1f9e5f8ea0 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Lock "cinder-quobyte-68ac8c7b-bf60-48a2-b0e0-c507cc572d83" released by "delete_volume" :: held 0.870s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:40:44 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-8b1389a3-cef4-4ce0-9103-ca1f9e5f8ea0 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Created reservations ['00194f51-43f5-4ed8-9e7c-92598c311c15', '77a7f7d4-8747-4fe5-949f-bc6a6e939503', 'ac0a7aff-93c5-4f5a-b71d-27d26217347a', 'ed77e801-2fe3-4e41-98cb-40c0089c8978'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:40:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8b1389a3-cef4-4ce0-9103-ca1f9e5f8ea0 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:40:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8b1389a3-cef4-4ce0-9103-ca1f9e5f8ea0 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:40:45 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-8b1389a3-cef4-4ce0-9103-ca1f9e5f8ea0 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:40:45 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-8b1389a3-cef4-4ce0-9103-ca1f9e5f8ea0 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:40:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8b1389a3-cef4-4ce0-9103-ca1f9e5f8ea0 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:40:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8b1389a3-cef4-4ce0-9103-ca1f9e5f8ea0 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:45 devstack sudo[97641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:40:45 devstack sudo[97641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:45 devstack sudo[97641]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8b1389a3-cef4-4ce0-9103-ca1f9e5f8ea0 tempest-TestServerVolumeAttachmentScenario-1064473967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.344s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:45 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-8b1389a3-cef4-4ce0-9103-ca1f9e5f8ea0 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:40:45 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-8b1389a3-cef4-4ce0-9103-ca1f9e5f8ea0 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Deleted volume successfully. Aug 28 09:40:45 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8b1389a3-cef4-4ce0-9103-ca1f9e5f8ea0 tempest-TestServerVolumeAttachmentScenario-1064473967 None] Lock "cinder-68ac8c7b-bf60-48a2-b0e0-c507cc572d83-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:40:47 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-39e4e5d4-f920-4972-b480-c6bd0c653035 tempest-VolumesMetadataTest-1661754928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:40:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-39e4e5d4-f920-4972-b480-c6bd0c653035 tempest-VolumesMetadataTest-1661754928 None] Flow 'volume_create_manager' (32d30e5e-7481-4a35-bffd-2f4f77b845e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:40:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-39e4e5d4-f920-4972-b480-c6bd0c653035 tempest-VolumesMetadataTest-1661754928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3b31a9e-4743-4206-b18a-1c9665d68143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:40:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-39e4e5d4-f920-4972-b480-c6bd0c653035 tempest-VolumesMetadataTest-1661754928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3b31a9e-4743-4206-b18a-1c9665d68143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:40:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1177808615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88bb08d8-1e0b-48a3-a29e-6b613ec7459a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6abf7429f76443a08aba4d1157b5b863',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:40:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:40:47Z,use_quota=True,user_id='5fb97430562f4285a1b0bc0aa24245c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:40:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-39e4e5d4-f920-4972-b480-c6bd0c653035 tempest-VolumesMetadataTest-1661754928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfd6eb3b-cf76-47e1-98e9-dc6c0f53ed3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:40:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-39e4e5d4-f920-4972-b480-c6bd0c653035 tempest-VolumesMetadataTest-1661754928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfd6eb3b-cf76-47e1-98e9-dc6c0f53ed3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:40:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-39e4e5d4-f920-4972-b480-c6bd0c653035 tempest-VolumesMetadataTest-1661754928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50410371-0b83-4827-8f5b-acf2e53509b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:40:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-39e4e5d4-f920-4972-b480-c6bd0c653035 tempest-VolumesMetadataTest-1661754928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50410371-0b83-4827-8f5b-acf2e53509b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88bb08d8-1e0b-48a3-a29e-6b613ec7459a', 'volume_name': 'volume-88bb08d8-1e0b-48a3-a29e-6b613ec7459a', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:40:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-39e4e5d4-f920-4972-b480-c6bd0c653035 tempest-VolumesMetadataTest-1661754928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04c978cd-db55-477a-81eb-120d2f03fb42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:40:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-39e4e5d4-f920-4972-b480-c6bd0c653035 tempest-VolumesMetadataTest-1661754928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04c978cd-db55-477a-81eb-120d2f03fb42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:40:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-39e4e5d4-f920-4972-b480-c6bd0c653035 tempest-VolumesMetadataTest-1661754928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2e3b9b2-6ce5-4024-ac28-09360f53213d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:40:47 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-39e4e5d4-f920-4972-b480-c6bd0c653035 tempest-VolumesMetadataTest-1661754928 None] Volume 88bb08d8-1e0b-48a3-a29e-6b613ec7459a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88bb08d8-1e0b-48a3-a29e-6b613ec7459a', 'volume_size': 1} Aug 28 09:40:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-39e4e5d4-f920-4972-b480-c6bd0c653035 tempest-VolumesMetadataTest-1661754928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:40:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-39e4e5d4-f920-4972-b480-c6bd0c653035 tempest-VolumesMetadataTest-1661754928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:40:47 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-39e4e5d4-f920-4972-b480-c6bd0c653035 tempest-VolumesMetadataTest-1661754928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:40:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1177808615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88bb08d8-1e0b-48a3-a29e-6b613ec7459a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6abf7429f76443a08aba4d1157b5b863',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:40:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:40:47Z,use_quota=True,user_id='5fb97430562f4285a1b0bc0aa24245c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:40:47 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-39e4e5d4-f920-4972-b480-c6bd0c653035 tempest-VolumesMetadataTest-1661754928 None] Creating volume 88bb08d8-1e0b-48a3-a29e-6b613ec7459a {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:40:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-39e4e5d4-f920-4972-b480-c6bd0c653035 tempest-VolumesMetadataTest-1661754928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:40:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-39e4e5d4-f920-4972-b480-c6bd0c653035 tempest-VolumesMetadataTest-1661754928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:40:47 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-39e4e5d4-f920-4972-b480-c6bd0c653035 tempest-VolumesMetadataTest-1661754928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:40:47 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-39e4e5d4-f920-4972-b480-c6bd0c653035 tempest-VolumesMetadataTest-1661754928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:40:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-39e4e5d4-f920-4972-b480-c6bd0c653035 tempest-VolumesMetadataTest-1661754928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:40:47 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-39e4e5d4-f920-4972-b480-c6bd0c653035 tempest-VolumesMetadataTest-1661754928 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:40:47 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-39e4e5d4-f920-4972-b480-c6bd0c653035 tempest-VolumesMetadataTest-1661754928 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:40:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-39e4e5d4-f920-4972-b480-c6bd0c653035 tempest-VolumesMetadataTest-1661754928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-88bb08d8-1e0b-48a3-a29e-6b613ec7459a 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:47 devstack sudo[97646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-88bb08d8-1e0b-48a3-a29e-6b613ec7459a 1073741824 Aug 28 09:40:47 devstack sudo[97646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:47 devstack sudo[97646]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-39e4e5d4-f920-4972-b480-c6bd0c653035 tempest-VolumesMetadataTest-1661754928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-88bb08d8-1e0b-48a3-a29e-6b613ec7459a 1073741824" returned: 0 in 0.542s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-39e4e5d4-f920-4972-b480-c6bd0c653035 tempest-VolumesMetadataTest-1661754928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-88bb08d8-1e0b-48a3-a29e-6b613ec7459a {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:47 devstack sudo[97652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-88bb08d8-1e0b-48a3-a29e-6b613ec7459a Aug 28 09:40:47 devstack sudo[97652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:48 devstack sudo[97652]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-39e4e5d4-f920-4972-b480-c6bd0c653035 tempest-VolumesMetadataTest-1661754928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-88bb08d8-1e0b-48a3-a29e-6b613ec7459a" returned: 0 in 0.265s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:48 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-39e4e5d4-f920-4972-b480-c6bd0c653035 tempest-VolumesMetadataTest-1661754928 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:40:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-39e4e5d4-f920-4972-b480-c6bd0c653035 tempest-VolumesMetadataTest-1661754928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:40:48 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-39e4e5d4-f920-4972-b480-c6bd0c653035 tempest-VolumesMetadataTest-1661754928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2e3b9b2-6ce5-4024-ac28-09360f53213d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88bb08d8-1e0b-48a3-a29e-6b613ec7459a', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:40:48 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-39e4e5d4-f920-4972-b480-c6bd0c653035 tempest-VolumesMetadataTest-1661754928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f7dd581-a6ca-4fb2-aa00-e7d70eb9d047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:40:48 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-39e4e5d4-f920-4972-b480-c6bd0c653035 tempest-VolumesMetadataTest-1661754928 None] Volume volume-88bb08d8-1e0b-48a3-a29e-6b613ec7459a (88bb08d8-1e0b-48a3-a29e-6b613ec7459a): created successfully Aug 28 09:40:48 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-39e4e5d4-f920-4972-b480-c6bd0c653035 tempest-VolumesMetadataTest-1661754928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f7dd581-a6ca-4fb2-aa00-e7d70eb9d047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:40:48 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-39e4e5d4-f920-4972-b480-c6bd0c653035 tempest-VolumesMetadataTest-1661754928 None] Flow 'volume_create_manager' (32d30e5e-7481-4a35-bffd-2f4f77b845e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:40:48 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-39e4e5d4-f920-4972-b480-c6bd0c653035 tempest-VolumesMetadataTest-1661754928 None] Created volume successfully. Aug 28 09:40:49 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-be394f81-0e9d-4dfc-b7c7-d4ab54dd816d tempest-VolumesMetadataTest-1661754928 None] Acquiring lock "cinder-88bb08d8-1e0b-48a3-a29e-6b613ec7459a-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:40:49 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-be394f81-0e9d-4dfc-b7c7-d4ab54dd816d tempest-VolumesMetadataTest-1661754928 None] Lock "cinder-88bb08d8-1e0b-48a3-a29e-6b613ec7459a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:40:50 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-be394f81-0e9d-4dfc-b7c7-d4ab54dd816d tempest-VolumesMetadataTest-1661754928 None] Acquiring lock "cinder-quobyte-88bb08d8-1e0b-48a3-a29e-6b613ec7459a" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:40:50 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-be394f81-0e9d-4dfc-b7c7-d4ab54dd816d tempest-VolumesMetadataTest-1661754928 None] Lock "cinder-quobyte-88bb08d8-1e0b-48a3-a29e-6b613ec7459a" acquired by "delete_volume" :: waited 0.021s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:40:50 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99d833b-4b8b-446c-9c44-2ece4a6b519b]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:40:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-be394f81-0e9d-4dfc-b7c7-d4ab54dd816d tempest-VolumesMetadataTest-1661754928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-88bb08d8-1e0b-48a3-a29e-6b613ec7459a {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:50 devstack sudo[97656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-88bb08d8-1e0b-48a3-a29e-6b613ec7459a Aug 28 09:40:50 devstack sudo[97656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:50 devstack sudo[97656]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-be394f81-0e9d-4dfc-b7c7-d4ab54dd816d tempest-VolumesMetadataTest-1661754928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-88bb08d8-1e0b-48a3-a29e-6b613ec7459a" returned: 0 in 0.500s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-be394f81-0e9d-4dfc-b7c7-d4ab54dd816d tempest-VolumesMetadataTest-1661754928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-88bb08d8-1e0b-48a3-a29e-6b613ec7459a {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:50 devstack sudo[97661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-88bb08d8-1e0b-48a3-a29e-6b613ec7459a Aug 28 09:40:50 devstack sudo[97661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:50 devstack sudo[97661]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-be394f81-0e9d-4dfc-b7c7-d4ab54dd816d tempest-VolumesMetadataTest-1661754928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-88bb08d8-1e0b-48a3-a29e-6b613ec7459a" returned: 0 in 0.327s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:50 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-be394f81-0e9d-4dfc-b7c7-d4ab54dd816d tempest-VolumesMetadataTest-1661754928 None] Lock "cinder-quobyte-88bb08d8-1e0b-48a3-a29e-6b613ec7459a" released by "delete_volume" :: held 0.883s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:40:51 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-be394f81-0e9d-4dfc-b7c7-d4ab54dd816d tempest-VolumesMetadataTest-1661754928 None] Created reservations ['318829d4-8c6e-4036-979f-3de69f63e3ed', 'e0d85d26-b219-474c-9d78-6e9a1420f2bb', '52bedda0-b400-4fda-8a41-6ed1dba2e3ae', '5b03da83-a3a7-434a-abda-4d1e3af6998b'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:40:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-be394f81-0e9d-4dfc-b7c7-d4ab54dd816d tempest-VolumesMetadataTest-1661754928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:40:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-be394f81-0e9d-4dfc-b7c7-d4ab54dd816d tempest-VolumesMetadataTest-1661754928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:40:51 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-be394f81-0e9d-4dfc-b7c7-d4ab54dd816d tempest-VolumesMetadataTest-1661754928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:40:51 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-be394f81-0e9d-4dfc-b7c7-d4ab54dd816d tempest-VolumesMetadataTest-1661754928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:40:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-be394f81-0e9d-4dfc-b7c7-d4ab54dd816d tempest-VolumesMetadataTest-1661754928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:40:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-be394f81-0e9d-4dfc-b7c7-d4ab54dd816d tempest-VolumesMetadataTest-1661754928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:51 devstack sudo[97665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:40:51 devstack sudo[97665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:51 devstack sudo[97665]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-be394f81-0e9d-4dfc-b7c7-d4ab54dd816d tempest-VolumesMetadataTest-1661754928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.468s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:51 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-be394f81-0e9d-4dfc-b7c7-d4ab54dd816d tempest-VolumesMetadataTest-1661754928 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:40:51 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-be394f81-0e9d-4dfc-b7c7-d4ab54dd816d tempest-VolumesMetadataTest-1661754928 None] Deleted volume successfully. Aug 28 09:40:51 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-be394f81-0e9d-4dfc-b7c7-d4ab54dd816d tempest-VolumesMetadataTest-1661754928 None] Lock "cinder-88bb08d8-1e0b-48a3-a29e-6b613ec7459a-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:40:57 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-35c78422-7fdd-433b-9345-34633dcec450 tempest-VolumesActionsTest-1474506135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:40:58 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-35c78422-7fdd-433b-9345-34633dcec450 tempest-VolumesActionsTest-1474506135 None] Flow 'volume_create_manager' (e1b2212e-1b70-4737-86bc-393d84ea27a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:40:58 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-35c78422-7fdd-433b-9345-34633dcec450 tempest-VolumesActionsTest-1474506135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98cc00b2-727c-4200-bf63-443de3484bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:40:58 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-35c78422-7fdd-433b-9345-34633dcec450 tempest-VolumesActionsTest-1474506135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98cc00b2-727c-4200-bf63-443de3484bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:40:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-489867013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a89d2e10-4915-4762-a79a-3859da8b5a40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19e9c57fb7cf48ea8f5286b0bf62dd25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:40:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:40:58Z,use_quota=True,user_id='8a8891058e0a4412bc00751d235b1ded',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:40:58 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-35c78422-7fdd-433b-9345-34633dcec450 tempest-VolumesActionsTest-1474506135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5e70b0a-6991-46f3-9d5e-76c08869dfdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:40:58 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-35c78422-7fdd-433b-9345-34633dcec450 tempest-VolumesActionsTest-1474506135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5e70b0a-6991-46f3-9d5e-76c08869dfdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:40:58 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-35c78422-7fdd-433b-9345-34633dcec450 tempest-VolumesActionsTest-1474506135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42fd4a26-6c1a-42c7-ba7c-737ac31660d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:40:58 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-35c78422-7fdd-433b-9345-34633dcec450 tempest-VolumesActionsTest-1474506135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42fd4a26-6c1a-42c7-ba7c-737ac31660d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a89d2e10-4915-4762-a79a-3859da8b5a40', 'volume_name': 'volume-a89d2e10-4915-4762-a79a-3859da8b5a40', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:40:58 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-35c78422-7fdd-433b-9345-34633dcec450 tempest-VolumesActionsTest-1474506135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cfd49bc-58aa-465a-8efa-dba5b155e2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:40:58 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-35c78422-7fdd-433b-9345-34633dcec450 tempest-VolumesActionsTest-1474506135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cfd49bc-58aa-465a-8efa-dba5b155e2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:40:58 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-35c78422-7fdd-433b-9345-34633dcec450 tempest-VolumesActionsTest-1474506135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb3292f3-e38b-4be7-aaaf-646c15f7636b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:40:58 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-35c78422-7fdd-433b-9345-34633dcec450 tempest-VolumesActionsTest-1474506135 None] Volume a89d2e10-4915-4762-a79a-3859da8b5a40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a89d2e10-4915-4762-a79a-3859da8b5a40', 'volume_size': 1} Aug 28 09:40:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-35c78422-7fdd-433b-9345-34633dcec450 tempest-VolumesActionsTest-1474506135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:40:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-35c78422-7fdd-433b-9345-34633dcec450 tempest-VolumesActionsTest-1474506135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:40:58 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-35c78422-7fdd-433b-9345-34633dcec450 tempest-VolumesActionsTest-1474506135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:40:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-489867013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a89d2e10-4915-4762-a79a-3859da8b5a40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19e9c57fb7cf48ea8f5286b0bf62dd25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:40:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:40:58Z,use_quota=True,user_id='8a8891058e0a4412bc00751d235b1ded',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:40:58 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-35c78422-7fdd-433b-9345-34633dcec450 tempest-VolumesActionsTest-1474506135 None] Creating volume a89d2e10-4915-4762-a79a-3859da8b5a40 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:40:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-35c78422-7fdd-433b-9345-34633dcec450 tempest-VolumesActionsTest-1474506135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:40:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-35c78422-7fdd-433b-9345-34633dcec450 tempest-VolumesActionsTest-1474506135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:40:58 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-35c78422-7fdd-433b-9345-34633dcec450 tempest-VolumesActionsTest-1474506135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:40:58 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-35c78422-7fdd-433b-9345-34633dcec450 tempest-VolumesActionsTest-1474506135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:40:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-35c78422-7fdd-433b-9345-34633dcec450 tempest-VolumesActionsTest-1474506135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:40:58 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-35c78422-7fdd-433b-9345-34633dcec450 tempest-VolumesActionsTest-1474506135 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:40:58 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-35c78422-7fdd-433b-9345-34633dcec450 tempest-VolumesActionsTest-1474506135 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:40:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-35c78422-7fdd-433b-9345-34633dcec450 tempest-VolumesActionsTest-1474506135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a89d2e10-4915-4762-a79a-3859da8b5a40 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:58 devstack sudo[97669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a89d2e10-4915-4762-a79a-3859da8b5a40 1073741824 Aug 28 09:40:58 devstack sudo[97669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:58 devstack sudo[97669]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-35c78422-7fdd-433b-9345-34633dcec450 tempest-VolumesActionsTest-1474506135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a89d2e10-4915-4762-a79a-3859da8b5a40 1073741824" returned: 0 in 0.524s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-35c78422-7fdd-433b-9345-34633dcec450 tempest-VolumesActionsTest-1474506135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a89d2e10-4915-4762-a79a-3859da8b5a40 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:40:58 devstack sudo[97675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a89d2e10-4915-4762-a79a-3859da8b5a40 Aug 28 09:40:58 devstack sudo[97675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:40:58 devstack sudo[97675]: pam_unix(sudo:session): session closed for user root Aug 28 09:40:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-35c78422-7fdd-433b-9345-34633dcec450 tempest-VolumesActionsTest-1474506135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a89d2e10-4915-4762-a79a-3859da8b5a40" returned: 0 in 0.308s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:40:58 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-35c78422-7fdd-433b-9345-34633dcec450 tempest-VolumesActionsTest-1474506135 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:40:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-35c78422-7fdd-433b-9345-34633dcec450 tempest-VolumesActionsTest-1474506135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:40:58 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-35c78422-7fdd-433b-9345-34633dcec450 tempest-VolumesActionsTest-1474506135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb3292f3-e38b-4be7-aaaf-646c15f7636b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a89d2e10-4915-4762-a79a-3859da8b5a40', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:40:59 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-35c78422-7fdd-433b-9345-34633dcec450 tempest-VolumesActionsTest-1474506135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33722536-2697-4375-9763-af3730a652e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:40:59 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-35c78422-7fdd-433b-9345-34633dcec450 tempest-VolumesActionsTest-1474506135 None] Volume volume-a89d2e10-4915-4762-a79a-3859da8b5a40 (a89d2e10-4915-4762-a79a-3859da8b5a40): created successfully Aug 28 09:40:59 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-35c78422-7fdd-433b-9345-34633dcec450 tempest-VolumesActionsTest-1474506135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33722536-2697-4375-9763-af3730a652e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:40:59 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-35c78422-7fdd-433b-9345-34633dcec450 tempest-VolumesActionsTest-1474506135 None] Flow 'volume_create_manager' (e1b2212e-1b70-4737-86bc-393d84ea27a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:40:59 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-35c78422-7fdd-433b-9345-34633dcec450 tempest-VolumesActionsTest-1474506135 None] Created volume successfully. Aug 28 09:41:09 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writing DB stats cinder:UPDATE=139,cinder:SELECT=120,cinder:INSERT=35,cinder:DELETE=9 {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:41:09 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writing DB stats cinder:UPDATE=154,cinder:SELECT=117,cinder:INSERT=29,cinder:DELETE=11 {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:41:38 devstack cinder-volume[86081]: DEBUG oslo_service.periodic_task [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86081) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:41:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:41:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:41:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:41:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:41:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:41:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:41:38 devstack sudo[97818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:41:38 devstack sudo[97818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:41:38 devstack sudo[97818]: pam_unix(sudo:session): session closed for user root Aug 28 09:41:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.490s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:41:38 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:41:38 devstack cinder-volume[86081]: DEBUG oslo_service.periodic_task [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running periodic task VolumeManager._thread_info {{(pid=86081) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:41:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] thread count: 28 {{(pid=86081) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 09:41:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] thread info: [<_MainThread(MainThread, started 129914189705344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86081) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 09:41:39 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6d5bcb72-5358-4ad0-ba70-827957d8677d tempest-VolumesActionsTest-1474506135 None] Acquiring lock "cinder-a89d2e10-4915-4762-a79a-3859da8b5a40" by "attach_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:41:39 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6d5bcb72-5358-4ad0-ba70-827957d8677d tempest-VolumesActionsTest-1474506135 None] Lock "cinder-a89d2e10-4915-4762-a79a-3859da8b5a40" acquired by "attach_volume" :: waited 0.037s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:41:39 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-6d5bcb72-5358-4ad0-ba70-827957d8677d tempest-VolumesActionsTest-1474506135 None] Attaching volume a89d2e10-4915-4762-a79a-3859da8b5a40 to instance 31dffa3b-1f59-413e-b0d2-d72f4cf147c4 at mountpoint /dev/vdb on host None. Aug 28 09:41:39 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-6d5bcb72-5358-4ad0-ba70-827957d8677d tempest-VolumesActionsTest-1474506135 None] Attach volume completed successfully. Aug 28 09:41:39 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6d5bcb72-5358-4ad0-ba70-827957d8677d tempest-VolumesActionsTest-1474506135 None] Lock "cinder-a89d2e10-4915-4762-a79a-3859da8b5a40" released by "attach_volume" :: held 0.277s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:41:39 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-7f7e11de-543e-480b-a3b7-08605311a137 tempest-VolumesActionsTest-1474506135 None] Acquiring lock "cinder-a89d2e10-4915-4762-a79a-3859da8b5a40-detach_volume" by "detach_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:41:39 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-7f7e11de-543e-480b-a3b7-08605311a137 tempest-VolumesActionsTest-1474506135 None] Lock "cinder-a89d2e10-4915-4762-a79a-3859da8b5a40-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:41:39 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-7f7e11de-543e-480b-a3b7-08605311a137 tempest-VolumesActionsTest-1474506135 None] Detaching volume a89d2e10-4915-4762-a79a-3859da8b5a40 from instance 31dffa3b-1f59-413e-b0d2-d72f4cf147c4. Aug 28 09:41:39 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-7f7e11de-543e-480b-a3b7-08605311a137 tempest-VolumesActionsTest-1474506135 None] Detach volume completed successfully. Aug 28 09:41:39 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-7f7e11de-543e-480b-a3b7-08605311a137 tempest-VolumesActionsTest-1474506135 None] Lock "cinder-a89d2e10-4915-4762-a79a-3859da8b5a40-detach_volume" released by "detach_volume" :: held 0.121s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:41:47 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-413f858b-747c-48ff-9c13-295eea025229 tempest-TestStampPattern-672193429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:41:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-413f858b-747c-48ff-9c13-295eea025229 tempest-TestStampPattern-672193429 None] Flow 'volume_create_manager' (904dcc13-1555-44d5-875e-960941661377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:41:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-413f858b-747c-48ff-9c13-295eea025229 tempest-TestStampPattern-672193429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4833bf7-08d6-4f92-85d1-a54ede92eb74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:41:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-413f858b-747c-48ff-9c13-295eea025229 tempest-TestStampPattern-672193429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4833bf7-08d6-4f92-85d1-a54ede92eb74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:41:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-486949255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdaebbe4-a086-4d5a-b030-ad882ad73b9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31cef57d393c4059a3ee0daa6439cc36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:41:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:41:47Z,use_quota=True,user_id='7f41fc2801a24bbd848aa7b3e6500d30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:41:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-413f858b-747c-48ff-9c13-295eea025229 tempest-TestStampPattern-672193429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6f39f3b-7e66-48d9-bc14-a363ef7fd17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:41:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-413f858b-747c-48ff-9c13-295eea025229 tempest-TestStampPattern-672193429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6f39f3b-7e66-48d9-bc14-a363ef7fd17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:41:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-413f858b-747c-48ff-9c13-295eea025229 tempest-TestStampPattern-672193429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cf50191-2a69-4319-a0c5-2111e833e8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:41:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-413f858b-747c-48ff-9c13-295eea025229 tempest-TestStampPattern-672193429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cf50191-2a69-4319-a0c5-2111e833e8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdaebbe4-a086-4d5a-b030-ad882ad73b9f', 'volume_name': 'volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:41:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-413f858b-747c-48ff-9c13-295eea025229 tempest-TestStampPattern-672193429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c710274c-f458-44bd-9252-fa9ef4987a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:41:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-413f858b-747c-48ff-9c13-295eea025229 tempest-TestStampPattern-672193429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c710274c-f458-44bd-9252-fa9ef4987a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:41:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-413f858b-747c-48ff-9c13-295eea025229 tempest-TestStampPattern-672193429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ed46e24-bedf-465f-a2da-7beb56d181ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:41:47 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-413f858b-747c-48ff-9c13-295eea025229 tempest-TestStampPattern-672193429 None] Volume fdaebbe4-a086-4d5a-b030-ad882ad73b9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f', 'volume_size': 1} Aug 28 09:41:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-413f858b-747c-48ff-9c13-295eea025229 tempest-TestStampPattern-672193429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:41:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-413f858b-747c-48ff-9c13-295eea025229 tempest-TestStampPattern-672193429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:41:47 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-413f858b-747c-48ff-9c13-295eea025229 tempest-TestStampPattern-672193429 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:41:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-486949255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdaebbe4-a086-4d5a-b030-ad882ad73b9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31cef57d393c4059a3ee0daa6439cc36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:41:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:41:47Z,use_quota=True,user_id='7f41fc2801a24bbd848aa7b3e6500d30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:41:47 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-413f858b-747c-48ff-9c13-295eea025229 tempest-TestStampPattern-672193429 None] Creating volume fdaebbe4-a086-4d5a-b030-ad882ad73b9f {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:41:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-413f858b-747c-48ff-9c13-295eea025229 tempest-TestStampPattern-672193429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:41:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-413f858b-747c-48ff-9c13-295eea025229 tempest-TestStampPattern-672193429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:41:47 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-413f858b-747c-48ff-9c13-295eea025229 tempest-TestStampPattern-672193429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:41:47 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-413f858b-747c-48ff-9c13-295eea025229 tempest-TestStampPattern-672193429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:41:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-413f858b-747c-48ff-9c13-295eea025229 tempest-TestStampPattern-672193429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:41:47 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-413f858b-747c-48ff-9c13-295eea025229 tempest-TestStampPattern-672193429 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:41:47 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-413f858b-747c-48ff-9c13-295eea025229 tempest-TestStampPattern-672193429 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:41:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-413f858b-747c-48ff-9c13-295eea025229 tempest-TestStampPattern-672193429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:41:47 devstack sudo[97868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f 1073741824 Aug 28 09:41:47 devstack sudo[97868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:41:48 devstack sudo[97868]: pam_unix(sudo:session): session closed for user root Aug 28 09:41:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-413f858b-747c-48ff-9c13-295eea025229 tempest-TestStampPattern-672193429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f 1073741824" returned: 0 in 1.331s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:41:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-413f858b-747c-48ff-9c13-295eea025229 tempest-TestStampPattern-672193429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:41:49 devstack sudo[97942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f Aug 28 09:41:49 devstack sudo[97942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:41:49 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:41:49 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] Flow 'volume_create_manager' (67b6c007-0c1c-4736-a113-a0b6cd8930c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:41:49 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c218f4d4-64be-4cfb-bacc-a52c4595e44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:41:49 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c218f4d4-64be-4cfb-bacc-a52c4595e44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2037022377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e222a76-8228-4415-bc2a-4ae174c92e03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e8035d689cf4898a9d6ea3867892e3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:41:50Z,use_quota=True,user_id='c4ae24a8d88a4bc2aaa35085c97a17f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:41:49 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9547bc0-dc4c-4d88-a439-b328d8bf6a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:41:49 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9547bc0-dc4c-4d88-a439-b328d8bf6a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:41:49 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6baa2e85-db13-4cbe-9186-55bd1ce6befa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:41:49 devstack cinder-volume[86081]: DEBUG cinder.image.glance [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] Creating Keystone auth plugin from conf {{(pid=86081) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 28 09:41:49 devstack sudo[97942]: pam_unix(sudo:session): session closed for user root Aug 28 09:41:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-413f858b-747c-48ff-9c13-295eea025229 tempest-TestStampPattern-672193429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f" returned: 0 in 0.843s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:41:49 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-413f858b-747c-48ff-9c13-295eea025229 tempest-TestStampPattern-672193429 None] <== create_volume: return (2344ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:41:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-413f858b-747c-48ff-9c13-295eea025229 tempest-TestStampPattern-672193429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.350s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:41:49 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-413f858b-747c-48ff-9c13-295eea025229 tempest-TestStampPattern-672193429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ed46e24-bedf-465f-a2da-7beb56d181ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:41:49 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-413f858b-747c-48ff-9c13-295eea025229 tempest-TestStampPattern-672193429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46122b27-a120-42c7-a61e-fb877ee9d4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:41:49 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-413f858b-747c-48ff-9c13-295eea025229 tempest-TestStampPattern-672193429 None] Volume volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f (fdaebbe4-a086-4d5a-b030-ad882ad73b9f): created successfully Aug 28 09:41:49 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-413f858b-747c-48ff-9c13-295eea025229 tempest-TestStampPattern-672193429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46122b27-a120-42c7-a61e-fb877ee9d4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:41:49 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-413f858b-747c-48ff-9c13-295eea025229 tempest-TestStampPattern-672193429 None] Flow 'volume_create_manager' (904dcc13-1555-44d5-875e-960941661377) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:41:49 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-413f858b-747c-48ff-9c13-295eea025229 tempest-TestStampPattern-672193429 None] Created volume successfully. Aug 28 09:41:51 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6baa2e85-db13-4cbe-9186-55bd1ce6befa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5e222a76-8228-4415-bc2a-4ae174c92e03', 'volume_name': 'volume-5e222a76-8228-4415-bc2a-4ae174c92e03', 'volume_size': 1, 'image_id': '4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b980c3c37cfa4760ad4846d0fd4baffc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'created_at': datetime.datetime(2026, 8, 28, 7, 25, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 7, 25, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:41:51 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03db43f8-65e3-4816-88f7-b12c11b686cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:41:51 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03db43f8-65e3-4816-88f7-b12c11b686cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:41:51 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (220d9b0d-198d-42d0-b6de-eb421652a878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:41:51 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] Volume 5e222a76-8228-4415-bc2a-4ae174c92e03: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5e222a76-8228-4415-bc2a-4ae174c92e03', 'volume_size': 1, 'image_id': '4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b980c3c37cfa4760ad4846d0fd4baffc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'created_at': datetime.datetime(2026, 8, 28, 7, 25, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 7, 25, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 28 09:41:51 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] Trying to clone 5e222a76-8228-4415-bc2a-4ae174c92e03 from image 4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'metadata': {}}]). {{(pid=86081) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 28 09:41:52 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_v3i3lc8ndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86081) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 28 09:41:52 devstack cinder-volume[86081]: INFO cinder.image.image_utils [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] Image download 20.69 MB at 20.69 MB/s Aug 28 09:41:52 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7fd53e8-3be0-404d-85e5-2368ccf55140]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:41:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_v3i3lc8ndevstack@QuobyteHD {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:41:52 devstack sudo[97960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_v3i3lc8ndevstack@QuobyteHD Aug 28 09:41:52 devstack sudo[97960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:41:53 devstack sudo[97960]: pam_unix(sudo:session): session closed for user root Aug 28 09:41:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_v3i3lc8ndevstack@QuobyteHD" returned: 0 in 0.884s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:41:53 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] Temporary image 4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0 is fetched for user c4ae24a8d88a4bc2aaa35085c97a17f1. {{(pid=86081) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 28 09:41:53 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e532f27-fe7d-45c6-b3dc-e5b97d7b00ed]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:41:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_v3i3lc8ndevstack@QuobyteHD {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:41:53 devstack sudo[97974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_v3i3lc8ndevstack@QuobyteHD Aug 28 09:41:53 devstack sudo[97974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:41:53 devstack sudo[97974]: pam_unix(sudo:session): session closed for user root Aug 28 09:41:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_v3i3lc8ndevstack@QuobyteHD" returned: 0 in 0.461s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:41:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:41:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:41:53 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2037022377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e222a76-8228-4415-bc2a-4ae174c92e03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e8035d689cf4898a9d6ea3867892e3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:41:50Z,use_quota=True,user_id='c4ae24a8d88a4bc2aaa35085c97a17f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:41:53 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] Creating volume 5e222a76-8228-4415-bc2a-4ae174c92e03 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:41:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:41:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:41:53 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:41:53 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:41:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:41:53 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:41:53 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:41:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-5e222a76-8228-4415-bc2a-4ae174c92e03 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:41:53 devstack sudo[97983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-5e222a76-8228-4415-bc2a-4ae174c92e03 1073741824 Aug 28 09:41:53 devstack sudo[97983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:41:54 devstack sudo[97983]: pam_unix(sudo:session): session closed for user root Aug 28 09:41:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-5e222a76-8228-4415-bc2a-4ae174c92e03 1073741824" returned: 0 in 0.949s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:41:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-5e222a76-8228-4415-bc2a-4ae174c92e03 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:41:54 devstack sudo[97991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-5e222a76-8228-4415-bc2a-4ae174c92e03 Aug 28 09:41:54 devstack sudo[97991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:41:54 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-21c00c17-2ae2-40ad-af5e-ab863cf57e14 tempest-VolumesActionsTest-566797683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:41:54 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-21c00c17-2ae2-40ad-af5e-ab863cf57e14 tempest-VolumesActionsTest-566797683 None] Flow 'volume_create_manager' (b4333e39-c29e-40b0-aca5-bafb431b4e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:41:54 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-21c00c17-2ae2-40ad-af5e-ab863cf57e14 tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79b82d98-7996-47b6-9ae8-737d108ca4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:41:55 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-21c00c17-2ae2-40ad-af5e-ab863cf57e14 tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79b82d98-7996-47b6-9ae8-737d108ca4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:41:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-183591025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53cd6d61-1db3-4f8b-971f-a591975de167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44365d73418f4b7d88bd4e0c8ae6a9ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:41:55Z,use_quota=True,user_id='f001ff07c17749efba791cfdf0507b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:41:55 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-21c00c17-2ae2-40ad-af5e-ab863cf57e14 tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac56d0b1-5d8d-4b53-96d8-eceb91a489d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:41:55 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-21c00c17-2ae2-40ad-af5e-ab863cf57e14 tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac56d0b1-5d8d-4b53-96d8-eceb91a489d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:41:55 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-21c00c17-2ae2-40ad-af5e-ab863cf57e14 tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84e3d832-18ef-4fd3-b3e7-fd1c5da962eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:41:55 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-21c00c17-2ae2-40ad-af5e-ab863cf57e14 tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84e3d832-18ef-4fd3-b3e7-fd1c5da962eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53cd6d61-1db3-4f8b-971f-a591975de167', 'volume_name': 'volume-53cd6d61-1db3-4f8b-971f-a591975de167', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:41:55 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-21c00c17-2ae2-40ad-af5e-ab863cf57e14 tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (289cef27-722a-440c-bb5b-6ff658406861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:41:55 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-21c00c17-2ae2-40ad-af5e-ab863cf57e14 tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (289cef27-722a-440c-bb5b-6ff658406861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:41:55 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-21c00c17-2ae2-40ad-af5e-ab863cf57e14 tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (021596e5-a4f2-4394-806a-ef6b8a1047a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:41:55 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-21c00c17-2ae2-40ad-af5e-ab863cf57e14 tempest-VolumesActionsTest-566797683 None] Volume 53cd6d61-1db3-4f8b-971f-a591975de167: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53cd6d61-1db3-4f8b-971f-a591975de167', 'volume_size': 1} Aug 28 09:41:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-21c00c17-2ae2-40ad-af5e-ab863cf57e14 tempest-VolumesActionsTest-566797683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:41:55 devstack sudo[97991]: pam_unix(sudo:session): session closed for user root Aug 28 09:41:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-5e222a76-8228-4415-bc2a-4ae174c92e03" returned: 0 in 0.635s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:41:55 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] <== create_volume: return (1726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:41:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.735s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:41:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-21c00c17-2ae2-40ad-af5e-ab863cf57e14 tempest-VolumesActionsTest-566797683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.343s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:41:55 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-21c00c17-2ae2-40ad-af5e-ab863cf57e14 tempest-VolumesActionsTest-566797683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:41:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-183591025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53cd6d61-1db3-4f8b-971f-a591975de167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44365d73418f4b7d88bd4e0c8ae6a9ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:41:55Z,use_quota=True,user_id='f001ff07c17749efba791cfdf0507b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:41:55 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-21c00c17-2ae2-40ad-af5e-ab863cf57e14 tempest-VolumesActionsTest-566797683 None] Creating volume 53cd6d61-1db3-4f8b-971f-a591975de167 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:41:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-21c00c17-2ae2-40ad-af5e-ab863cf57e14 tempest-VolumesActionsTest-566797683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:41:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-21c00c17-2ae2-40ad-af5e-ab863cf57e14 tempest-VolumesActionsTest-566797683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:41:55 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-21c00c17-2ae2-40ad-af5e-ab863cf57e14 tempest-VolumesActionsTest-566797683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:41:55 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-21c00c17-2ae2-40ad-af5e-ab863cf57e14 tempest-VolumesActionsTest-566797683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:41:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-21c00c17-2ae2-40ad-af5e-ab863cf57e14 tempest-VolumesActionsTest-566797683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:41:55 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-21c00c17-2ae2-40ad-af5e-ab863cf57e14 tempest-VolumesActionsTest-566797683 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:41:55 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-21c00c17-2ae2-40ad-af5e-ab863cf57e14 tempest-VolumesActionsTest-566797683 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:41:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-21c00c17-2ae2-40ad-af5e-ab863cf57e14 tempest-VolumesActionsTest-566797683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-53cd6d61-1db3-4f8b-971f-a591975de167 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:41:55 devstack sudo[98004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-53cd6d61-1db3-4f8b-971f-a591975de167 1073741824 Aug 28 09:41:55 devstack sudo[98004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:41:55 devstack cinder-volume[86081]: DEBUG cinder.volume.volume_utils [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] Attempting download of 4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0 ((None, [{'url': 'file:///opt/stack/data/glance/images/4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'metadata': {}}])) to volume 5e222a76-8228-4415-bc2a-4ae174c92e03. {{(pid=86081) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 28 09:41:55 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c11af7-1821-41e9-9793-5c407933b1e5]: (4, 'raw') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:41:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_p004mgb9 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:41:55 devstack sudo[98009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_p004mgb9 Aug 28 09:41:55 devstack sudo[98009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:41:56 devstack sudo[98009]: pam_unix(sudo:session): session closed for user root Aug 28 09:41:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_p004mgb9" returned: 0 in 0.546s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:41:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_p004mgb9 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:41:56 devstack sudo[98004]: pam_unix(sudo:session): session closed for user root Aug 28 09:41:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-21c00c17-2ae2-40ad-af5e-ab863cf57e14 tempest-VolumesActionsTest-566797683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-53cd6d61-1db3-4f8b-971f-a591975de167 1073741824" returned: 0 in 0.873s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:41:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-21c00c17-2ae2-40ad-af5e-ab863cf57e14 tempest-VolumesActionsTest-566797683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-53cd6d61-1db3-4f8b-971f-a591975de167 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:41:56 devstack sudo[98018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-53cd6d61-1db3-4f8b-971f-a591975de167 Aug 28 09:41:56 devstack sudo[98018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:41:56 devstack sudo[98017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_p004mgb9 Aug 28 09:41:56 devstack sudo[98017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:41:56 devstack sudo[98018]: pam_unix(sudo:session): session closed for user root Aug 28 09:41:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-21c00c17-2ae2-40ad-af5e-ab863cf57e14 tempest-VolumesActionsTest-566797683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-53cd6d61-1db3-4f8b-971f-a591975de167" returned: 0 in 0.434s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:41:56 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-21c00c17-2ae2-40ad-af5e-ab863cf57e14 tempest-VolumesActionsTest-566797683 None] <== create_volume: return (1481ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:41:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-21c00c17-2ae2-40ad-af5e-ab863cf57e14 tempest-VolumesActionsTest-566797683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:41:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-21c00c17-2ae2-40ad-af5e-ab863cf57e14 tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (021596e5-a4f2-4394-806a-ef6b8a1047a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53cd6d61-1db3-4f8b-971f-a591975de167', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:41:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-21c00c17-2ae2-40ad-af5e-ab863cf57e14 tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6925cd68-8639-4d9b-8607-f442526efa6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:41:57 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-21c00c17-2ae2-40ad-af5e-ab863cf57e14 tempest-VolumesActionsTest-566797683 None] Volume volume-53cd6d61-1db3-4f8b-971f-a591975de167 (53cd6d61-1db3-4f8b-971f-a591975de167): created successfully Aug 28 09:41:57 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-21c00c17-2ae2-40ad-af5e-ab863cf57e14 tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6925cd68-8639-4d9b-8607-f442526efa6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:41:57 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-21c00c17-2ae2-40ad-af5e-ab863cf57e14 tempest-VolumesActionsTest-566797683 None] Flow 'volume_create_manager' (b4333e39-c29e-40b0-aca5-bafb431b4e99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:41:57 devstack sudo[98017]: pam_unix(sudo:session): session closed for user root Aug 28 09:41:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_p004mgb9" returned: 1 in 0.714s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:41:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_p004mgb9' failed. Not Retrying. {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 09:41:57 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10c1458-0ef5-4426-9228-e56917e86cf0]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:41:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_v3i3lc8ndevstack@QuobyteHD {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:41:57 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-21c00c17-2ae2-40ad-af5e-ab863cf57e14 tempest-VolumesActionsTest-566797683 None] Created volume successfully. Aug 28 09:41:57 devstack sudo[98024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_v3i3lc8ndevstack@QuobyteHD Aug 28 09:41:57 devstack sudo[98024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:41:57 devstack sudo[98024]: pam_unix(sudo:session): session closed for user root Aug 28 09:41:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_v3i3lc8ndevstack@QuobyteHD" returned: 0 in 0.788s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:41:57 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] 4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0 was qcow2, converting to qcow2 {{(pid=86081) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 28 09:41:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_v3i3lc8ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-5e222a76-8228-4415-bc2a-4ae174c92e03 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:41:57 devstack sudo[98052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_v3i3lc8ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-5e222a76-8228-4415-bc2a-4ae174c92e03 Aug 28 09:41:57 devstack sudo[98052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:41:58 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-0a60bd6d-7610-441e-9df0-688f71d4c20f tempest-VolumesActionsTest-566797683 None] Acquiring lock "cinder-53cd6d61-1db3-4f8b-971f-a591975de167" by "attach_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:41:58 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-0a60bd6d-7610-441e-9df0-688f71d4c20f tempest-VolumesActionsTest-566797683 None] Lock "cinder-53cd6d61-1db3-4f8b-971f-a591975de167" acquired by "attach_volume" :: waited 0.033s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:41:58 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-0a60bd6d-7610-441e-9df0-688f71d4c20f tempest-VolumesActionsTest-566797683 None] Attaching volume 53cd6d61-1db3-4f8b-971f-a591975de167 to instance c9235535-5c8a-42ba-9918-873e88373f76 at mountpoint /dev/vdb on host None. Aug 28 09:41:58 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-0a60bd6d-7610-441e-9df0-688f71d4c20f tempest-VolumesActionsTest-566797683 None] Attach volume completed successfully. Aug 28 09:41:58 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-0a60bd6d-7610-441e-9df0-688f71d4c20f tempest-VolumesActionsTest-566797683 None] Lock "cinder-53cd6d61-1db3-4f8b-971f-a591975de167" released by "attach_volume" :: held 0.306s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:42:00 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-5ac686a3-9ff7-43d8-a3ef-1c85637859c9 tempest-VolumesActionsTest-1615469397 None] Terminate volume connection completed successfully. Aug 28 09:42:00 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-5ac686a3-9ff7-43d8-a3ef-1c85637859c9 tempest-VolumesActionsTest-1615469397 None] Acquiring lock "cinder-53cd6d61-1db3-4f8b-971f-a591975de167-detach_volume" by "detach_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:42:00 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-5ac686a3-9ff7-43d8-a3ef-1c85637859c9 tempest-VolumesActionsTest-1615469397 None] Lock "cinder-53cd6d61-1db3-4f8b-971f-a591975de167-detach_volume" acquired by "detach_volume" :: waited 0.045s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:42:00 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-5ac686a3-9ff7-43d8-a3ef-1c85637859c9 tempest-VolumesActionsTest-1615469397 None] Detaching volume 53cd6d61-1db3-4f8b-971f-a591975de167 from instance c9235535-5c8a-42ba-9918-873e88373f76. Aug 28 09:42:00 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-5ac686a3-9ff7-43d8-a3ef-1c85637859c9 tempest-VolumesActionsTest-1615469397 None] Detach volume completed successfully. Aug 28 09:42:00 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-5ac686a3-9ff7-43d8-a3ef-1c85637859c9 tempest-VolumesActionsTest-1615469397 None] Lock "cinder-53cd6d61-1db3-4f8b-971f-a591975de167-detach_volume" released by "detach_volume" :: held 0.177s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:42:01 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-9b4e3b75-4039-4c83-92f1-04aaa397f25f tempest-VolumesActionsTest-566797683 None] Acquiring lock "cinder-53cd6d61-1db3-4f8b-971f-a591975de167-detach_volume" by "detach_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:42:01 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-9b4e3b75-4039-4c83-92f1-04aaa397f25f tempest-VolumesActionsTest-566797683 None] Lock "cinder-53cd6d61-1db3-4f8b-971f-a591975de167-detach_volume" acquired by "detach_volume" :: waited 0.037s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:42:01 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-9b4e3b75-4039-4c83-92f1-04aaa397f25f tempest-VolumesActionsTest-566797683 None] Volume detach called, but volume not attached. Aug 28 09:42:01 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-9b4e3b75-4039-4c83-92f1-04aaa397f25f tempest-VolumesActionsTest-566797683 None] Lock "cinder-53cd6d61-1db3-4f8b-971f-a591975de167-detach_volume" released by "detach_volume" :: held 0.034s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:42:01 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ab5bbe3a-2c15-4c0e-830b-f186ff30e3c4 tempest-VolumesActionsTest-566797683 None] Acquiring lock "cinder-53cd6d61-1db3-4f8b-971f-a591975de167-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:42:01 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ab5bbe3a-2c15-4c0e-830b-f186ff30e3c4 tempest-VolumesActionsTest-566797683 None] Lock "cinder-53cd6d61-1db3-4f8b-971f-a591975de167-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:42:02 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ab5bbe3a-2c15-4c0e-830b-f186ff30e3c4 tempest-VolumesActionsTest-566797683 None] Acquiring lock "cinder-quobyte-53cd6d61-1db3-4f8b-971f-a591975de167" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:42:02 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ab5bbe3a-2c15-4c0e-830b-f186ff30e3c4 tempest-VolumesActionsTest-566797683 None] Lock "cinder-quobyte-53cd6d61-1db3-4f8b-971f-a591975de167" acquired by "delete_volume" :: waited 0.059s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:42:02 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c48411-bfa0-42f0-99e6-aec852a87806]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:42:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ab5bbe3a-2c15-4c0e-830b-f186ff30e3c4 tempest-VolumesActionsTest-566797683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-53cd6d61-1db3-4f8b-971f-a591975de167 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:42:02 devstack sudo[98124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-53cd6d61-1db3-4f8b-971f-a591975de167 Aug 28 09:42:02 devstack sudo[98124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:42:02 devstack sudo[98052]: pam_unix(sudo:session): session closed for user root Aug 28 09:42:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_v3i3lc8ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-5e222a76-8228-4415-bc2a-4ae174c92e03" returned: 0 in 4.923s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:42:02 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_v3i3lc8ndevstack@QuobyteHD, size 112.00 MB, duration 4.93 sec, destination /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-5e222a76-8228-4415-bc2a-4ae174c92e03 {{(pid=86081) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 09:42:02 devstack cinder-volume[86081]: INFO cinder.image.image_utils [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] Converted 112.00 MB image at 22.74 MB/s Aug 28 09:42:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-5e222a76-8228-4415-bc2a-4ae174c92e03 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:42:02 devstack sudo[98160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-5e222a76-8228-4415-bc2a-4ae174c92e03 1G Aug 28 09:42:02 devstack sudo[98160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:42:03 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-cc141d34-4d73-4068-82f4-5a5ee437e0bb tempest-VolumesActionsTest-1474506135 None] Acquiring lock "cinder-a89d2e10-4915-4762-a79a-3859da8b5a40" by "attach_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:42:03 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-cc141d34-4d73-4068-82f4-5a5ee437e0bb tempest-VolumesActionsTest-1474506135 None] Lock "cinder-a89d2e10-4915-4762-a79a-3859da8b5a40" acquired by "attach_volume" :: waited 0.082s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:42:03 devstack sudo[98124]: pam_unix(sudo:session): session closed for user root Aug 28 09:42:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ab5bbe3a-2c15-4c0e-830b-f186ff30e3c4 tempest-VolumesActionsTest-566797683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-53cd6d61-1db3-4f8b-971f-a591975de167" returned: 0 in 1.135s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:42:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ab5bbe3a-2c15-4c0e-830b-f186ff30e3c4 tempest-VolumesActionsTest-566797683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-53cd6d61-1db3-4f8b-971f-a591975de167 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:42:03 devstack sudo[98175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-53cd6d61-1db3-4f8b-971f-a591975de167 Aug 28 09:42:03 devstack sudo[98175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:42:03 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-cc141d34-4d73-4068-82f4-5a5ee437e0bb tempest-VolumesActionsTest-1474506135 None] Attaching volume a89d2e10-4915-4762-a79a-3859da8b5a40 to instance fc930c60-5f29-4854-b785-09d48f12c48b at mountpoint /dev/vdb on host None. Aug 28 09:42:03 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-cc141d34-4d73-4068-82f4-5a5ee437e0bb tempest-VolumesActionsTest-1474506135 None] Attach volume completed successfully. Aug 28 09:42:03 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-cc141d34-4d73-4068-82f4-5a5ee437e0bb tempest-VolumesActionsTest-1474506135 None] Lock "cinder-a89d2e10-4915-4762-a79a-3859da8b5a40" released by "attach_volume" :: held 0.640s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:42:04 devstack sudo[98160]: pam_unix(sudo:session): session closed for user root Aug 28 09:42:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-5e222a76-8228-4415-bc2a-4ae174c92e03 1G" returned: 0 in 1.280s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:42:04 devstack cinder-volume[86081]: DEBUG cinder.volume.volume_utils [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] Downloaded image 4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0 ((None, [{'url': 'file:///opt/stack/data/glance/images/4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'metadata': {}}])) to volume 5e222a76-8228-4415-bc2a-4ae174c92e03 successfully. {{(pid=86081) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 28 09:42:04 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] Temporary image 4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0 for user c4ae24a8d88a4bc2aaa35085c97a17f1 is deleted. {{(pid=86081) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 28 09:42:04 devstack cinder-volume[86081]: DEBUG cinder.volume.volume_utils [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] Marking volume 5e222a76-8228-4415-bc2a-4ae174c92e03 as bootable. {{(pid=86081) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 28 09:42:04 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] Copying metadata from image 4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0 to 5e222a76-8228-4415-bc2a-4ae174c92e03. {{(pid=86081) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 28 09:42:04 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] Creating volume glance metadata for volume 5e222a76-8228-4415-bc2a-4ae174c92e03 backed by image 4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86081) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 28 09:42:04 devstack sudo[98175]: pam_unix(sudo:session): session closed for user root Aug 28 09:42:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ab5bbe3a-2c15-4c0e-830b-f186ff30e3c4 tempest-VolumesActionsTest-566797683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-53cd6d61-1db3-4f8b-971f-a591975de167" returned: 0 in 1.008s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:42:04 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ab5bbe3a-2c15-4c0e-830b-f186ff30e3c4 tempest-VolumesActionsTest-566797683 None] Lock "cinder-quobyte-53cd6d61-1db3-4f8b-971f-a591975de167" released by "delete_volume" :: held 2.281s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:42:04 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-9268b89a-58a6-40d9-a6c6-9a6761da256a tempest-VolumesActionsTest-1474506135 None] Acquiring lock "cinder-a89d2e10-4915-4762-a79a-3859da8b5a40-detach_volume" by "detach_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:42:04 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-9268b89a-58a6-40d9-a6c6-9a6761da256a tempest-VolumesActionsTest-1474506135 None] Lock "cinder-a89d2e10-4915-4762-a79a-3859da8b5a40-detach_volume" acquired by "detach_volume" :: waited 0.053s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:42:04 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-9268b89a-58a6-40d9-a6c6-9a6761da256a tempest-VolumesActionsTest-1474506135 None] Detaching volume a89d2e10-4915-4762-a79a-3859da8b5a40 from instance fc930c60-5f29-4854-b785-09d48f12c48b. Aug 28 09:42:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (220d9b0d-198d-42d0-b6de-eb421652a878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e222a76-8228-4415-bc2a-4ae174c92e03', 'volume_size': 1, 'image_id': '4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b980c3c37cfa4760ad4846d0fd4baffc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'created_at': datetime.datetime(2026, 8, 28, 7, 25, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 7, 25, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:42:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf13520b-a587-4bce-adf7-a3a7a712bff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:42:04 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] Volume volume-5e222a76-8228-4415-bc2a-4ae174c92e03 (5e222a76-8228-4415-bc2a-4ae174c92e03): created successfully Aug 28 09:42:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf13520b-a587-4bce-adf7-a3a7a712bff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:42:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] Flow 'volume_create_manager' (67b6c007-0c1c-4736-a113-a0b6cd8930c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:42:04 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-ab5bbe3a-2c15-4c0e-830b-f186ff30e3c4 tempest-VolumesActionsTest-566797683 None] Created reservations ['31cdc439-9dd3-4a82-8b97-e7f01cca87b7', '0073bec2-6ab2-4c49-a8fb-0a65ca7e3079', '57f46733-b3d6-46c2-be63-ae7564987ed1', 'afdd00c1-8bde-42ba-bde9-11e405386fb3'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:42:04 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-15ec4e71-f853-4cd0-a9c5-1b9da5b150af tempest-TestShelveInstance-1148579193 None] Created volume successfully. Aug 28 09:42:04 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-9268b89a-58a6-40d9-a6c6-9a6761da256a tempest-VolumesActionsTest-1474506135 None] Detach volume completed successfully. Aug 28 09:42:04 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-9268b89a-58a6-40d9-a6c6-9a6761da256a tempest-VolumesActionsTest-1474506135 None] Lock "cinder-a89d2e10-4915-4762-a79a-3859da8b5a40-detach_volume" released by "detach_volume" :: held 0.240s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:42:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ab5bbe3a-2c15-4c0e-830b-f186ff30e3c4 tempest-VolumesActionsTest-566797683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:42:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ab5bbe3a-2c15-4c0e-830b-f186ff30e3c4 tempest-VolumesActionsTest-566797683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:42:04 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ab5bbe3a-2c15-4c0e-830b-f186ff30e3c4 tempest-VolumesActionsTest-566797683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:42:04 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ab5bbe3a-2c15-4c0e-830b-f186ff30e3c4 tempest-VolumesActionsTest-566797683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:42:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ab5bbe3a-2c15-4c0e-830b-f186ff30e3c4 tempest-VolumesActionsTest-566797683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:42:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ab5bbe3a-2c15-4c0e-830b-f186ff30e3c4 tempest-VolumesActionsTest-566797683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:42:05 devstack sudo[98223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:42:05 devstack sudo[98223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:42:05 devstack sudo[98223]: pam_unix(sudo:session): session closed for user root Aug 28 09:42:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ab5bbe3a-2c15-4c0e-830b-f186ff30e3c4 tempest-VolumesActionsTest-566797683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.666s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:42:05 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-ab5bbe3a-2c15-4c0e-830b-f186ff30e3c4 tempest-VolumesActionsTest-566797683 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:42:05 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-ab5bbe3a-2c15-4c0e-830b-f186ff30e3c4 tempest-VolumesActionsTest-566797683 None] Deleted volume successfully. Aug 28 09:42:05 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ab5bbe3a-2c15-4c0e-830b-f186ff30e3c4 tempest-VolumesActionsTest-566797683 None] Lock "cinder-53cd6d61-1db3-4f8b-971f-a591975de167-delete_volume" released by "delete_volume" :: held 3.828s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:42:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-272f5cc1-00c0-453e-bc7e-3214e231493b req-fcc8530d-3bf3-4b03-88dc-1a625c4e01a9 tempest-TestShelveInstance-1148579193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:42:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-272f5cc1-00c0-453e-bc7e-3214e231493b req-fcc8530d-3bf3-4b03-88dc-1a625c4e01a9 tempest-TestShelveInstance-1148579193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:42:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-272f5cc1-00c0-453e-bc7e-3214e231493b req-fcc8530d-3bf3-4b03-88dc-1a625c4e01a9 tempest-TestShelveInstance-1148579193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.051s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:42:11 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-272f5cc1-00c0-453e-bc7e-3214e231493b req-fcc8530d-3bf3-4b03-88dc-1a625c4e01a9 tempest-TestShelveInstance-1148579193 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b', 'name': 'volume-5e222a76-8228-4415-bc2a-4ae174c92e03', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '16966093-e3ae-44c4-8e08-2b9e995dd618', 'enforce_multipath': True} {{(pid=86081) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 09:42:11 devstack cinder-volume[86081]: INFO cinder.volume.manager [req-272f5cc1-00c0-453e-bc7e-3214e231493b req-fcc8530d-3bf3-4b03-88dc-1a625c4e01a9 tempest-TestShelveInstance-1148579193 None] attachment_update completed successfully. Aug 28 09:42:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-1fe88070-be0a-4247-a6b0-47a4eca67c18 tempest-VolumesActionsTest-1474506135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:42:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-1fe88070-be0a-4247-a6b0-47a4eca67c18 tempest-VolumesActionsTest-1474506135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.004s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:42:13 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb9efe0-b39a-4313-b36e-1f0d67779b1e]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:42:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1fe88070-be0a-4247-a6b0-47a4eca67c18 tempest-VolumesActionsTest-1474506135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a89d2e10-4915-4762-a79a-3859da8b5a40 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:42:13 devstack sudo[98320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a89d2e10-4915-4762-a79a-3859da8b5a40 Aug 28 09:42:13 devstack sudo[98320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:42:14 devstack sudo[98320]: pam_unix(sudo:session): session closed for user root Aug 28 09:42:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1fe88070-be0a-4247-a6b0-47a4eca67c18 tempest-VolumesActionsTest-1474506135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a89d2e10-4915-4762-a79a-3859da8b5a40" returned: 0 in 0.630s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:42:14 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1dedbb-2973-4061-9320-73f01dd4475c]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:42:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1fe88070-be0a-4247-a6b0-47a4eca67c18 tempest-VolumesActionsTest-1474506135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a89d2e10-4915-4762-a79a-3859da8b5a40 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:42:14 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dde48f1-848f-4347-b34e-d43433eea7be tempest-VolumesActionsTest-566797683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:42:14 devstack sudo[98326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a89d2e10-4915-4762-a79a-3859da8b5a40 Aug 28 09:42:14 devstack sudo[98326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:42:14 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6dde48f1-848f-4347-b34e-d43433eea7be tempest-VolumesActionsTest-566797683 None] Flow 'volume_create_manager' (78d85b84-9dc7-4148-acb1-81df340994aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:42:14 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6dde48f1-848f-4347-b34e-d43433eea7be tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1201134e-6edf-4d79-9844-a681ea5b7c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:42:14 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6dde48f1-848f-4347-b34e-d43433eea7be tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1201134e-6edf-4d79-9844-a681ea5b7c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:42:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1348005651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25c78d57-0734-425d-9fde-6ea561a7f7dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44365d73418f4b7d88bd4e0c8ae6a9ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:42:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:42:14Z,use_quota=True,user_id='f001ff07c17749efba791cfdf0507b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:42:14 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6dde48f1-848f-4347-b34e-d43433eea7be tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62f97663-de8f-44e1-a94b-48cd007b7b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:42:14 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6dde48f1-848f-4347-b34e-d43433eea7be tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62f97663-de8f-44e1-a94b-48cd007b7b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:42:14 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6dde48f1-848f-4347-b34e-d43433eea7be tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd6e3ed0-16a0-409f-a376-2ebb9ccb5d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:42:14 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6dde48f1-848f-4347-b34e-d43433eea7be tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd6e3ed0-16a0-409f-a376-2ebb9ccb5d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25c78d57-0734-425d-9fde-6ea561a7f7dc', 'volume_name': 'volume-25c78d57-0734-425d-9fde-6ea561a7f7dc', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:42:14 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6dde48f1-848f-4347-b34e-d43433eea7be tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a1de3df-2588-4103-82f1-e02feb4949c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:42:14 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6dde48f1-848f-4347-b34e-d43433eea7be tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a1de3df-2588-4103-82f1-e02feb4949c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:42:14 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6dde48f1-848f-4347-b34e-d43433eea7be tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c29174e7-ff72-4424-aa88-e7d4dec674cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:42:14 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-6dde48f1-848f-4347-b34e-d43433eea7be tempest-VolumesActionsTest-566797683 None] Volume 25c78d57-0734-425d-9fde-6ea561a7f7dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25c78d57-0734-425d-9fde-6ea561a7f7dc', 'volume_size': 1} Aug 28 09:42:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-6dde48f1-848f-4347-b34e-d43433eea7be tempest-VolumesActionsTest-566797683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:42:14 devstack sudo[98326]: pam_unix(sudo:session): session closed for user root Aug 28 09:42:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1fe88070-be0a-4247-a6b0-47a4eca67c18 tempest-VolumesActionsTest-1474506135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a89d2e10-4915-4762-a79a-3859da8b5a40" returned: 0 in 0.501s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:42:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1fe88070-be0a-4247-a6b0-47a4eca67c18 tempest-VolumesActionsTest-1474506135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a89d2e10-4915-4762-a79a-3859da8b5a40 /opt/stack/data/cinder/conversion/a89d2e10-4915-4762-a79a-3859da8b5a40.temp_image.a3b64e87-67aa-420b-b2d0-39890baaa86754g_qiw7.img {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:42:14 devstack sudo[98332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a89d2e10-4915-4762-a79a-3859da8b5a40 /opt/stack/data/cinder/conversion/a89d2e10-4915-4762-a79a-3859da8b5a40.temp_image.a3b64e87-67aa-420b-b2d0-39890baaa86754g_qiw7.img Aug 28 09:42:14 devstack sudo[98332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:42:22 devstack sudo[98332]: pam_unix(sudo:session): session closed for user root Aug 28 09:42:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1fe88070-be0a-4247-a6b0-47a4eca67c18 tempest-VolumesActionsTest-1474506135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a89d2e10-4915-4762-a79a-3859da8b5a40 /opt/stack/data/cinder/conversion/a89d2e10-4915-4762-a79a-3859da8b5a40.temp_image.a3b64e87-67aa-420b-b2d0-39890baaa86754g_qiw7.img" returned: 0 in 7.545s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:42:22 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[926f2501-35b4-4c1a-b332-9acf6e1e7110]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:42:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1fe88070-be0a-4247-a6b0-47a4eca67c18 tempest-VolumesActionsTest-1474506135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a89d2e10-4915-4762-a79a-3859da8b5a40 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:42:22 devstack sudo[98829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a89d2e10-4915-4762-a79a-3859da8b5a40 Aug 28 09:42:22 devstack sudo[98829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:42:22 devstack sudo[98829]: pam_unix(sudo:session): session closed for user root Aug 28 09:42:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1fe88070-be0a-4247-a6b0-47a4eca67c18 tempest-VolumesActionsTest-1474506135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a89d2e10-4915-4762-a79a-3859da8b5a40" returned: 0 in 0.589s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:42:22 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-1fe88070-be0a-4247-a6b0-47a4eca67c18 tempest-VolumesActionsTest-1474506135 None] Image conversion details: src /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a89d2e10-4915-4762-a79a-3859da8b5a40, size 1024.00 MB, duration 7.55 sec, destination /opt/stack/data/cinder/conversion/a89d2e10-4915-4762-a79a-3859da8b5a40.temp_image.a3b64e87-67aa-420b-b2d0-39890baaa86754g_qiw7.img {{(pid=86081) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 09:42:22 devstack cinder-volume[86081]: INFO cinder.image.image_utils [None req-1fe88070-be0a-4247-a6b0-47a4eca67c18 tempest-VolumesActionsTest-1474506135 None] Converted 1024.00 MB image at 135.70 MB/s Aug 28 09:42:22 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-1fe88070-be0a-4247-a6b0-47a4eca67c18 tempest-VolumesActionsTest-1474506135 None] a3b64e87-67aa-420b-b2d0-39890baaa867 was raw, no need to convert to raw {{(pid=86081) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 28 09:42:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-57495293-9e9d-4a00-8819-268d65c9eaa0 req-a3022b6a-ec8c-42a8-b569-b3ec768c57dc tempest-TestStampPattern-672193429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:42:38 devstack cinder-volume[86081]: DEBUG oslo_service.periodic_task [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86081) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:42:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:42:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:42:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:42:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:42:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:42:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:42:38 devstack sudo[98897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:42:38 devstack sudo[98897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:42:38 devstack sudo[98897]: pam_unix(sudo:session): session closed for user root Aug 28 09:42:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.255s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:42:38 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:42:38 devstack cinder-volume[86081]: DEBUG oslo_service.periodic_task [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running periodic task VolumeManager._thread_info {{(pid=86081) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:42:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] thread count: 28 {{(pid=86081) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 09:42:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] thread info: [<_MainThread(MainThread, started 129914189705344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86081) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 09:42:38 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writing DB stats cinder:INSERT=13,cinder:SELECT=44,cinder:UPDATE=33,cinder:DELETE=3 {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:42:38 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writing DB stats cinder:SELECT=55,cinder:UPDATE=28,cinder:INSERT=13,cinder:DELETE=1 {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:42:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-1fe88070-be0a-4247-a6b0-47a4eca67c18 tempest-VolumesActionsTest-1474506135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.406s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:42:43 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1fe88070-be0a-4247-a6b0-47a4eca67c18 tempest-VolumesActionsTest-1474506135 None] Uploaded volume to glance image-id: a3b64e87-67aa-420b-b2d0-39890baaa867. {{(pid=86081) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 28 09:42:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-6dde48f1-848f-4347-b34e-d43433eea7be tempest-VolumesActionsTest-566797683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 29.408s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:42:43 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-6dde48f1-848f-4347-b34e-d43433eea7be tempest-VolumesActionsTest-566797683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:42:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1348005651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25c78d57-0734-425d-9fde-6ea561a7f7dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44365d73418f4b7d88bd4e0c8ae6a9ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:42:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:42:14Z,use_quota=True,user_id='f001ff07c17749efba791cfdf0507b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:42:43 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-6dde48f1-848f-4347-b34e-d43433eea7be tempest-VolumesActionsTest-566797683 None] Creating volume 25c78d57-0734-425d-9fde-6ea561a7f7dc {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:42:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-6dde48f1-848f-4347-b34e-d43433eea7be tempest-VolumesActionsTest-566797683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:42:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-6dde48f1-848f-4347-b34e-d43433eea7be tempest-VolumesActionsTest-566797683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:42:43 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-6dde48f1-848f-4347-b34e-d43433eea7be tempest-VolumesActionsTest-566797683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:42:43 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-6dde48f1-848f-4347-b34e-d43433eea7be tempest-VolumesActionsTest-566797683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:42:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-6dde48f1-848f-4347-b34e-d43433eea7be tempest-VolumesActionsTest-566797683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:42:43 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-6dde48f1-848f-4347-b34e-d43433eea7be tempest-VolumesActionsTest-566797683 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:42:43 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-6dde48f1-848f-4347-b34e-d43433eea7be tempest-VolumesActionsTest-566797683 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:42:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6dde48f1-848f-4347-b34e-d43433eea7be tempest-VolumesActionsTest-566797683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-25c78d57-0734-425d-9fde-6ea561a7f7dc 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:42:43 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-1fe88070-be0a-4247-a6b0-47a4eca67c18 tempest-VolumesActionsTest-1474506135 None] Copy volume to image completed successfully. Aug 28 09:42:43 devstack sudo[98902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-25c78d57-0734-425d-9fde-6ea561a7f7dc 1073741824 Aug 28 09:42:43 devstack sudo[98902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:42:44 devstack sudo[98902]: pam_unix(sudo:session): session closed for user root Aug 28 09:42:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6dde48f1-848f-4347-b34e-d43433eea7be tempest-VolumesActionsTest-566797683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-25c78d57-0734-425d-9fde-6ea561a7f7dc 1073741824" returned: 0 in 0.495s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:42:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6dde48f1-848f-4347-b34e-d43433eea7be tempest-VolumesActionsTest-566797683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-25c78d57-0734-425d-9fde-6ea561a7f7dc {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:42:44 devstack sudo[98907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-25c78d57-0734-425d-9fde-6ea561a7f7dc Aug 28 09:42:44 devstack sudo[98907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:42:44 devstack sudo[98907]: pam_unix(sudo:session): session closed for user root Aug 28 09:42:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6dde48f1-848f-4347-b34e-d43433eea7be tempest-VolumesActionsTest-566797683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-25c78d57-0734-425d-9fde-6ea561a7f7dc" returned: 0 in 0.269s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:42:44 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-6dde48f1-848f-4347-b34e-d43433eea7be tempest-VolumesActionsTest-566797683 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:42:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-6dde48f1-848f-4347-b34e-d43433eea7be tempest-VolumesActionsTest-566797683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:42:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-57495293-9e9d-4a00-8819-268d65c9eaa0 req-a3022b6a-ec8c-42a8-b569-b3ec768c57dc tempest-TestStampPattern-672193429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 16.286s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:42:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-57495293-9e9d-4a00-8819-268d65c9eaa0 req-a3022b6a-ec8c-42a8-b569-b3ec768c57dc tempest-TestStampPattern-672193429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:42:44 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6dde48f1-848f-4347-b34e-d43433eea7be tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c29174e7-ff72-4424-aa88-e7d4dec674cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25c78d57-0734-425d-9fde-6ea561a7f7dc', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:42:44 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6dde48f1-848f-4347-b34e-d43433eea7be tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af41ea16-c8ed-4334-8aab-0be7be912221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:42:44 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-6dde48f1-848f-4347-b34e-d43433eea7be tempest-VolumesActionsTest-566797683 None] Volume volume-25c78d57-0734-425d-9fde-6ea561a7f7dc (25c78d57-0734-425d-9fde-6ea561a7f7dc): created successfully Aug 28 09:42:44 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6dde48f1-848f-4347-b34e-d43433eea7be tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af41ea16-c8ed-4334-8aab-0be7be912221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:42:44 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6dde48f1-848f-4347-b34e-d43433eea7be tempest-VolumesActionsTest-566797683 None] Flow 'volume_create_manager' (78d85b84-9dc7-4148-acb1-81df340994aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:42:44 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-6dde48f1-848f-4347-b34e-d43433eea7be tempest-VolumesActionsTest-566797683 None] Created volume successfully. Aug 28 09:42:44 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-57495293-9e9d-4a00-8819-268d65c9eaa0 req-a3022b6a-ec8c-42a8-b569-b3ec768c57dc tempest-TestStampPattern-672193429 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b', 'name': 'volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '412a1ec7-e7c8-4ed2-a287-f5bcb47e752c', 'enforce_multipath': True} {{(pid=86081) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 09:42:44 devstack cinder-volume[86081]: INFO cinder.volume.manager [req-57495293-9e9d-4a00-8819-268d65c9eaa0 req-a3022b6a-ec8c-42a8-b569-b3ec768c57dc tempest-TestStampPattern-672193429 None] attachment_update completed successfully. Aug 28 09:42:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f6847879-fe6a-4c6c-afaf-70dba13e6883 tempest-VolumesActionsTest-1474506135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:42:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f6847879-fe6a-4c6c-afaf-70dba13e6883 tempest-VolumesActionsTest-1474506135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:42:45 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[02cbe590-5318-4a54-b84e-e4f6f37e6eae]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:42:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f6847879-fe6a-4c6c-afaf-70dba13e6883 tempest-VolumesActionsTest-1474506135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a89d2e10-4915-4762-a79a-3859da8b5a40 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:42:45 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-5df837df-d90b-4660-96cf-67c7feabc2af tempest-VolumesActionsTest-1615469397 None] Acquiring lock "cinder-25c78d57-0734-425d-9fde-6ea561a7f7dc-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:42:45 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-5df837df-d90b-4660-96cf-67c7feabc2af tempest-VolumesActionsTest-1615469397 None] Lock "cinder-25c78d57-0734-425d-9fde-6ea561a7f7dc-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:42:45 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-5df837df-d90b-4660-96cf-67c7feabc2af tempest-VolumesActionsTest-1615469397 None] Acquiring lock "cinder-quobyte-25c78d57-0734-425d-9fde-6ea561a7f7dc" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:42:45 devstack sudo[98912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a89d2e10-4915-4762-a79a-3859da8b5a40 Aug 28 09:42:45 devstack sudo[98912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:42:45 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-5df837df-d90b-4660-96cf-67c7feabc2af tempest-VolumesActionsTest-1615469397 None] Lock "cinder-quobyte-25c78d57-0734-425d-9fde-6ea561a7f7dc" acquired by "delete_volume" :: waited 0.019s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:42:45 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d99d59-4030-49e0-b657-88e4fca6bbc8]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:42:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5df837df-d90b-4660-96cf-67c7feabc2af tempest-VolumesActionsTest-1615469397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-25c78d57-0734-425d-9fde-6ea561a7f7dc {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:42:45 devstack sudo[98914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-25c78d57-0734-425d-9fde-6ea561a7f7dc Aug 28 09:42:45 devstack sudo[98914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:42:45 devstack sudo[98912]: pam_unix(sudo:session): session closed for user root Aug 28 09:42:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f6847879-fe6a-4c6c-afaf-70dba13e6883 tempest-VolumesActionsTest-1474506135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a89d2e10-4915-4762-a79a-3859da8b5a40" returned: 0 in 0.525s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:42:45 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[50fd6b3f-c3ca-4699-a53a-a8e4e3df6acb]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:42:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f6847879-fe6a-4c6c-afaf-70dba13e6883 tempest-VolumesActionsTest-1474506135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a89d2e10-4915-4762-a79a-3859da8b5a40 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:42:45 devstack sudo[98914]: pam_unix(sudo:session): session closed for user root Aug 28 09:42:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5df837df-d90b-4660-96cf-67c7feabc2af tempest-VolumesActionsTest-1615469397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-25c78d57-0734-425d-9fde-6ea561a7f7dc" returned: 0 in 0.414s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:42:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5df837df-d90b-4660-96cf-67c7feabc2af tempest-VolumesActionsTest-1615469397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-25c78d57-0734-425d-9fde-6ea561a7f7dc {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:42:45 devstack sudo[98927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a89d2e10-4915-4762-a79a-3859da8b5a40 Aug 28 09:42:45 devstack sudo[98927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:42:45 devstack sudo[98931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-25c78d57-0734-425d-9fde-6ea561a7f7dc Aug 28 09:42:45 devstack sudo[98931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:42:46 devstack sudo[98931]: pam_unix(sudo:session): session closed for user root Aug 28 09:42:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5df837df-d90b-4660-96cf-67c7feabc2af tempest-VolumesActionsTest-1615469397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-25c78d57-0734-425d-9fde-6ea561a7f7dc" returned: 0 in 0.295s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:42:46 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-5df837df-d90b-4660-96cf-67c7feabc2af tempest-VolumesActionsTest-1615469397 None] Lock "cinder-quobyte-25c78d57-0734-425d-9fde-6ea561a7f7dc" released by "delete_volume" :: held 0.762s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:42:46 devstack sudo[98927]: pam_unix(sudo:session): session closed for user root Aug 28 09:42:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f6847879-fe6a-4c6c-afaf-70dba13e6883 tempest-VolumesActionsTest-1474506135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a89d2e10-4915-4762-a79a-3859da8b5a40" returned: 0 in 0.423s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:42:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f6847879-fe6a-4c6c-afaf-70dba13e6883 tempest-VolumesActionsTest-1474506135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a89d2e10-4915-4762-a79a-3859da8b5a40 /opt/stack/data/cinder/conversion/a89d2e10-4915-4762-a79a-3859da8b5a40.temp_image.3b899fcf-503b-4179-b22e-3ba645cd08bbkvc7q0da.img {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:42:46 devstack sudo[98940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a89d2e10-4915-4762-a79a-3859da8b5a40 /opt/stack/data/cinder/conversion/a89d2e10-4915-4762-a79a-3859da8b5a40.temp_image.3b899fcf-503b-4179-b22e-3ba645cd08bbkvc7q0da.img Aug 28 09:42:46 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:42:46 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-5df837df-d90b-4660-96cf-67c7feabc2af tempest-VolumesActionsTest-1615469397 None] Created reservations ['a3df787a-a0ab-44f0-ac9f-99f4b3a80c9c', '82e0587a-f779-45c5-930a-4bb02ed836ba', '83b6b1a9-6978-4899-8f1e-2435e0a8754e', 'd7645500-c535-437a-91e2-d7fbd65f7130'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:42:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-5df837df-d90b-4660-96cf-67c7feabc2af tempest-VolumesActionsTest-1615469397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:42:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-5df837df-d90b-4660-96cf-67c7feabc2af tempest-VolumesActionsTest-1615469397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:42:46 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-5df837df-d90b-4660-96cf-67c7feabc2af tempest-VolumesActionsTest-1615469397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:42:46 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-5df837df-d90b-4660-96cf-67c7feabc2af tempest-VolumesActionsTest-1615469397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:42:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-5df837df-d90b-4660-96cf-67c7feabc2af tempest-VolumesActionsTest-1615469397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:42:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5df837df-d90b-4660-96cf-67c7feabc2af tempest-VolumesActionsTest-1615469397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:42:46 devstack sudo[98944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:42:46 devstack sudo[98944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:42:46 devstack sudo[98944]: pam_unix(sudo:session): session closed for user root Aug 28 09:42:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5df837df-d90b-4660-96cf-67c7feabc2af tempest-VolumesActionsTest-1615469397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.405s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:42:46 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-5df837df-d90b-4660-96cf-67c7feabc2af tempest-VolumesActionsTest-1615469397 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:42:46 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-5df837df-d90b-4660-96cf-67c7feabc2af tempest-VolumesActionsTest-1615469397 None] Deleted volume successfully. Aug 28 09:42:46 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-5df837df-d90b-4660-96cf-67c7feabc2af tempest-VolumesActionsTest-1615469397 None] Lock "cinder-25c78d57-0734-425d-9fde-6ea561a7f7dc-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:42:47 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-73cb22af-6fc6-4afd-ba09-bfda772431a9 tempest-VolumesActionsTest-566797683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:42:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-73cb22af-6fc6-4afd-ba09-bfda772431a9 tempest-VolumesActionsTest-566797683 None] Flow 'volume_create_manager' (6e51871f-f1d8-4cb9-8636-3c0577f0f2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:42:48 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-73cb22af-6fc6-4afd-ba09-bfda772431a9 tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0ca7a01-3e70-45a9-af99-5a1244f49cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:42:48 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-73cb22af-6fc6-4afd-ba09-bfda772431a9 tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0ca7a01-3e70-45a9-af99-5a1244f49cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-230525188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f65039c-e7aa-460e-bd22-f51c5a6965f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44365d73418f4b7d88bd4e0c8ae6a9ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:42:48Z,use_quota=True,user_id='f001ff07c17749efba791cfdf0507b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:42:48 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-73cb22af-6fc6-4afd-ba09-bfda772431a9 tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3608b2c4-4677-47c3-a505-b2414dcb61b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:42:48 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-73cb22af-6fc6-4afd-ba09-bfda772431a9 tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3608b2c4-4677-47c3-a505-b2414dcb61b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:42:48 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-73cb22af-6fc6-4afd-ba09-bfda772431a9 tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6ec3380-4407-42e6-b4ab-7691e9481926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:42:48 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-73cb22af-6fc6-4afd-ba09-bfda772431a9 tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6ec3380-4407-42e6-b4ab-7691e9481926) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f65039c-e7aa-460e-bd22-f51c5a6965f9', 'volume_name': 'volume-5f65039c-e7aa-460e-bd22-f51c5a6965f9', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:42:48 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-73cb22af-6fc6-4afd-ba09-bfda772431a9 tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c59b51f-fda5-4348-9725-9da688c8315e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:42:48 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-73cb22af-6fc6-4afd-ba09-bfda772431a9 tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c59b51f-fda5-4348-9725-9da688c8315e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:42:48 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-73cb22af-6fc6-4afd-ba09-bfda772431a9 tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c874f05-8118-414b-b9b5-11272e8aaf0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:42:48 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-73cb22af-6fc6-4afd-ba09-bfda772431a9 tempest-VolumesActionsTest-566797683 None] Volume 5f65039c-e7aa-460e-bd22-f51c5a6965f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f65039c-e7aa-460e-bd22-f51c5a6965f9', 'volume_size': 1} Aug 28 09:42:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-73cb22af-6fc6-4afd-ba09-bfda772431a9 tempest-VolumesActionsTest-566797683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:42:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f6847879-fe6a-4c6c-afaf-70dba13e6883 tempest-VolumesActionsTest-1474506135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a89d2e10-4915-4762-a79a-3859da8b5a40 /opt/stack/data/cinder/conversion/a89d2e10-4915-4762-a79a-3859da8b5a40.temp_image.3b899fcf-503b-4179-b22e-3ba645cd08bbkvc7q0da.img" returned: 0 in 5.568s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:42:51 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50af35a-d934-4a00-87e7-58005338f298]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:42:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f6847879-fe6a-4c6c-afaf-70dba13e6883 tempest-VolumesActionsTest-1474506135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a89d2e10-4915-4762-a79a-3859da8b5a40 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:42:51 devstack sudo[98986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a89d2e10-4915-4762-a79a-3859da8b5a40 Aug 28 09:42:51 devstack sudo[98986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:42:52 devstack sudo[98986]: pam_unix(sudo:session): session closed for user root Aug 28 09:42:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f6847879-fe6a-4c6c-afaf-70dba13e6883 tempest-VolumesActionsTest-1474506135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a89d2e10-4915-4762-a79a-3859da8b5a40" returned: 0 in 0.599s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:42:52 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-f6847879-fe6a-4c6c-afaf-70dba13e6883 tempest-VolumesActionsTest-1474506135 None] Image conversion details: src /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a89d2e10-4915-4762-a79a-3859da8b5a40, size 1024.00 MB, duration 5.57 sec, destination /opt/stack/data/cinder/conversion/a89d2e10-4915-4762-a79a-3859da8b5a40.temp_image.3b899fcf-503b-4179-b22e-3ba645cd08bbkvc7q0da.img {{(pid=86081) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 09:42:52 devstack cinder-volume[86081]: INFO cinder.image.image_utils [None req-f6847879-fe6a-4c6c-afaf-70dba13e6883 tempest-VolumesActionsTest-1474506135 None] Converted 1024.00 MB image at 183.76 MB/s Aug 28 09:42:52 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-f6847879-fe6a-4c6c-afaf-70dba13e6883 tempest-VolumesActionsTest-1474506135 None] 3b899fcf-503b-4179-b22e-3ba645cd08bb was raw, converting to qcow2 {{(pid=86081) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Aug 28 09:42:52 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67955ab-e3b9-42af-9cde-c8013998b372]: (4, 'raw') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:42:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f6847879-fe6a-4c6c-afaf-70dba13e6883 tempest-VolumesActionsTest-1474506135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a89d2e10-4915-4762-a79a-3859da8b5a40.temp_image.3b899fcf-503b-4179-b22e-3ba645cd08bbkvc7q0da.img {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:42:52 devstack cinder-volume[86081]: INFO cinder.volume.manager [req-5a31eee3-b021-4e07-bfad-2375d49fb9b2 req-a80125bf-c973-4234-a3d7-646dd4558fe6 tempest-TestStampPattern-672193429 None] Terminate volume connection completed successfully. Aug 28 09:42:52 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-5a31eee3-b021-4e07-bfad-2375d49fb9b2 req-a80125bf-c973-4234-a3d7-646dd4558fe6 tempest-TestStampPattern-672193429 None] Deleting attachment 412a1ec7-e7c8-4ed2-a287-f5bcb47e752c. {{(pid=86081) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 09:42:52 devstack sudo[98995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a89d2e10-4915-4762-a79a-3859da8b5a40.temp_image.3b899fcf-503b-4179-b22e-3ba645cd08bbkvc7q0da.img Aug 28 09:42:52 devstack sudo[98995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:42:53 devstack sudo[98995]: pam_unix(sudo:session): session closed for user root Aug 28 09:42:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f6847879-fe6a-4c6c-afaf-70dba13e6883 tempest-VolumesActionsTest-1474506135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a89d2e10-4915-4762-a79a-3859da8b5a40.temp_image.3b899fcf-503b-4179-b22e-3ba645cd08bbkvc7q0da.img" returned: 0 in 0.494s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:42:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f6847879-fe6a-4c6c-afaf-70dba13e6883 tempest-VolumesActionsTest-1474506135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a89d2e10-4915-4762-a79a-3859da8b5a40.temp_image.3b899fcf-503b-4179-b22e-3ba645cd08bbkvc7q0da.img {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:42:53 devstack cinder-volume[86081]: INFO cinder.volume.manager [req-1a152d2b-0fd2-4f3e-9658-27ef11bcb26a req-66cf6d64-20ac-47fe-a915-a9bd0464ca09 tempest-TestShelveInstance-1148579193 None] Terminate volume connection completed successfully. Aug 28 09:42:53 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-1a152d2b-0fd2-4f3e-9658-27ef11bcb26a req-66cf6d64-20ac-47fe-a915-a9bd0464ca09 tempest-TestShelveInstance-1148579193 None] Deleting attachment 16966093-e3ae-44c4-8e08-2b9e995dd618. {{(pid=86081) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 09:42:53 devstack sudo[99016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a89d2e10-4915-4762-a79a-3859da8b5a40.temp_image.3b899fcf-503b-4179-b22e-3ba645cd08bbkvc7q0da.img Aug 28 09:42:53 devstack sudo[99016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:42:53 devstack sudo[99016]: pam_unix(sudo:session): session closed for user root Aug 28 09:42:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f6847879-fe6a-4c6c-afaf-70dba13e6883 tempest-VolumesActionsTest-1474506135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a89d2e10-4915-4762-a79a-3859da8b5a40.temp_image.3b899fcf-503b-4179-b22e-3ba645cd08bbkvc7q0da.img" returned: 1 in 0.365s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:42:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f6847879-fe6a-4c6c-afaf-70dba13e6883 tempest-VolumesActionsTest-1474506135 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a89d2e10-4915-4762-a79a-3859da8b5a40.temp_image.3b899fcf-503b-4179-b22e-3ba645cd08bbkvc7q0da.img' failed. Not Retrying. {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 09:42:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f6847879-fe6a-4c6c-afaf-70dba13e6883 tempest-VolumesActionsTest-1474506135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a89d2e10-4915-4762-a79a-3859da8b5a40.temp_image.3b899fcf-503b-4179-b22e-3ba645cd08bbkvc7q0da.img /opt/stack/data/cinder/conversion/vol_upload_hzo4nflx {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:42:53 devstack sudo[99021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a89d2e10-4915-4762-a79a-3859da8b5a40.temp_image.3b899fcf-503b-4179-b22e-3ba645cd08bbkvc7q0da.img /opt/stack/data/cinder/conversion/vol_upload_hzo4nflx Aug 28 09:42:53 devstack sudo[99021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:42:53 devstack sudo[99021]: pam_unix(sudo:session): session closed for user root Aug 28 09:42:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f6847879-fe6a-4c6c-afaf-70dba13e6883 tempest-VolumesActionsTest-1474506135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a89d2e10-4915-4762-a79a-3859da8b5a40.temp_image.3b899fcf-503b-4179-b22e-3ba645cd08bbkvc7q0da.img /opt/stack/data/cinder/conversion/vol_upload_hzo4nflx" returned: 0 in 0.316s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:42:53 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-f6847879-fe6a-4c6c-afaf-70dba13e6883 tempest-VolumesActionsTest-1474506135 None] Image conversion details: src /opt/stack/data/cinder/conversion/a89d2e10-4915-4762-a79a-3859da8b5a40.temp_image.3b899fcf-503b-4179-b22e-3ba645cd08bbkvc7q0da.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_hzo4nflx {{(pid=86081) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 09:42:53 devstack cinder-volume[86081]: INFO cinder.image.image_utils [None req-f6847879-fe6a-4c6c-afaf-70dba13e6883 tempest-VolumesActionsTest-1474506135 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 28 09:42:53 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d2f5f9-f3c6-42ec-916c-4e1c1915e6df]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:42:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f6847879-fe6a-4c6c-afaf-70dba13e6883 tempest-VolumesActionsTest-1474506135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_hzo4nflx {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:42:53 devstack sudo[99026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_hzo4nflx Aug 28 09:42:53 devstack sudo[99026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:42:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-77e79066-af29-4a52-ad39-14b0e46a2c72 tempest-TestStampPattern-672193429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:42:54 devstack sudo[99026]: pam_unix(sudo:session): session closed for user root Aug 28 09:42:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f6847879-fe6a-4c6c-afaf-70dba13e6883 tempest-VolumesActionsTest-1474506135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_hzo4nflx" returned: 0 in 0.436s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:42:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-ece90902-ca5b-4a0c-8912-4bb4c1dd7d34 req-67c3d7e7-1d6c-4c64-8deb-cd0c560e5233 tempest-TestShelveInstance-1148579193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:42:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f6847879-fe6a-4c6c-afaf-70dba13e6883 tempest-VolumesActionsTest-1474506135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.274s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:42:55 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f6847879-fe6a-4c6c-afaf-70dba13e6883 tempest-VolumesActionsTest-1474506135 None] Uploaded volume to glance image-id: 3b899fcf-503b-4179-b22e-3ba645cd08bb. {{(pid=86081) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 28 09:42:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-73cb22af-6fc6-4afd-ba09-bfda772431a9 tempest-VolumesActionsTest-566797683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.247s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:42:55 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-73cb22af-6fc6-4afd-ba09-bfda772431a9 tempest-VolumesActionsTest-566797683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-230525188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f65039c-e7aa-460e-bd22-f51c5a6965f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44365d73418f4b7d88bd4e0c8ae6a9ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:42:48Z,use_quota=True,user_id='f001ff07c17749efba791cfdf0507b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:42:55 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-73cb22af-6fc6-4afd-ba09-bfda772431a9 tempest-VolumesActionsTest-566797683 None] Creating volume 5f65039c-e7aa-460e-bd22-f51c5a6965f9 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:42:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-73cb22af-6fc6-4afd-ba09-bfda772431a9 tempest-VolumesActionsTest-566797683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:42:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-73cb22af-6fc6-4afd-ba09-bfda772431a9 tempest-VolumesActionsTest-566797683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:42:55 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-73cb22af-6fc6-4afd-ba09-bfda772431a9 tempest-VolumesActionsTest-566797683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:42:55 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-73cb22af-6fc6-4afd-ba09-bfda772431a9 tempest-VolumesActionsTest-566797683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:42:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-73cb22af-6fc6-4afd-ba09-bfda772431a9 tempest-VolumesActionsTest-566797683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:42:55 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-73cb22af-6fc6-4afd-ba09-bfda772431a9 tempest-VolumesActionsTest-566797683 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:42:55 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-73cb22af-6fc6-4afd-ba09-bfda772431a9 tempest-VolumesActionsTest-566797683 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:42:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-73cb22af-6fc6-4afd-ba09-bfda772431a9 tempest-VolumesActionsTest-566797683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-5f65039c-e7aa-460e-bd22-f51c5a6965f9 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:42:55 devstack sudo[99042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-5f65039c-e7aa-460e-bd22-f51c5a6965f9 1073741824 Aug 28 09:42:55 devstack sudo[99042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:42:55 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-f6847879-fe6a-4c6c-afaf-70dba13e6883 tempest-VolumesActionsTest-1474506135 None] Copy volume to image completed successfully. Aug 28 09:42:55 devstack sudo[99042]: pam_unix(sudo:session): session closed for user root Aug 28 09:42:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-73cb22af-6fc6-4afd-ba09-bfda772431a9 tempest-VolumesActionsTest-566797683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-5f65039c-e7aa-460e-bd22-f51c5a6965f9 1073741824" returned: 0 in 0.408s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:42:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-73cb22af-6fc6-4afd-ba09-bfda772431a9 tempest-VolumesActionsTest-566797683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-5f65039c-e7aa-460e-bd22-f51c5a6965f9 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:42:55 devstack sudo[99047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-5f65039c-e7aa-460e-bd22-f51c5a6965f9 Aug 28 09:42:55 devstack sudo[99047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:42:56 devstack sudo[99047]: pam_unix(sudo:session): session closed for user root Aug 28 09:42:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-73cb22af-6fc6-4afd-ba09-bfda772431a9 tempest-VolumesActionsTest-566797683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-5f65039c-e7aa-460e-bd22-f51c5a6965f9" returned: 0 in 0.254s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:42:56 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-73cb22af-6fc6-4afd-ba09-bfda772431a9 tempest-VolumesActionsTest-566797683 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:42:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-73cb22af-6fc6-4afd-ba09-bfda772431a9 tempest-VolumesActionsTest-566797683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:42:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-77e79066-af29-4a52-ad39-14b0e46a2c72 tempest-TestStampPattern-672193429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.215s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:42:56 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-77e79066-af29-4a52-ad39-14b0e46a2c72 tempest-TestStampPattern-672193429 None] Creating offline snapshot e9114a22-4c32-4a2d-bb1b-0f2e6f577c1a of volume fdaebbe4-a086-4d5a-b030-ad882ad73b9f {{(pid=86081) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:42:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-73cb22af-6fc6-4afd-ba09-bfda772431a9 tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c874f05-8118-414b-b9b5-11272e8aaf0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f65039c-e7aa-460e-bd22-f51c5a6965f9', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:42:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-73cb22af-6fc6-4afd-ba09-bfda772431a9 tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da510151-d120-4e9c-953e-beacc75a41ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:42:56 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e73959-fb9b-4f81-ad7a-267647f89390]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:42:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-77e79066-af29-4a52-ad39-14b0e46a2c72 tempest-TestStampPattern-672193429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:42:56 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-73cb22af-6fc6-4afd-ba09-bfda772431a9 tempest-VolumesActionsTest-566797683 None] Volume volume-5f65039c-e7aa-460e-bd22-f51c5a6965f9 (5f65039c-e7aa-460e-bd22-f51c5a6965f9): created successfully Aug 28 09:42:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-73cb22af-6fc6-4afd-ba09-bfda772431a9 tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da510151-d120-4e9c-953e-beacc75a41ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:42:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-73cb22af-6fc6-4afd-ba09-bfda772431a9 tempest-VolumesActionsTest-566797683 None] Flow 'volume_create_manager' (6e51871f-f1d8-4cb9-8636-3c0577f0f2f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:42:56 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-73cb22af-6fc6-4afd-ba09-bfda772431a9 tempest-VolumesActionsTest-566797683 None] Created volume successfully. Aug 28 09:42:56 devstack sudo[99050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f Aug 28 09:42:56 devstack sudo[99050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:42:56 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c9036ef0-8311-4382-ab57-449b7198d585 tempest-VolumesActionsTest-1615469397 None] Acquiring lock "cinder-5f65039c-e7aa-460e-bd22-f51c5a6965f9-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:42:56 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c9036ef0-8311-4382-ab57-449b7198d585 tempest-VolumesActionsTest-1615469397 None] Lock "cinder-5f65039c-e7aa-460e-bd22-f51c5a6965f9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:42:56 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c9036ef0-8311-4382-ab57-449b7198d585 tempest-VolumesActionsTest-1615469397 None] Acquiring lock "cinder-quobyte-5f65039c-e7aa-460e-bd22-f51c5a6965f9" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:42:56 devstack sudo[99050]: pam_unix(sudo:session): session closed for user root Aug 28 09:42:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-77e79066-af29-4a52-ad39-14b0e46a2c72 tempest-TestStampPattern-672193429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f" returned: 0 in 0.476s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:42:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-77e79066-af29-4a52-ad39-14b0e46a2c72 tempest-TestStampPattern-672193429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f.e9114a22-4c32-4a2d-bb1b-0f2e6f577c1a 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:42:56 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c9036ef0-8311-4382-ab57-449b7198d585 tempest-VolumesActionsTest-1615469397 None] Lock "cinder-quobyte-5f65039c-e7aa-460e-bd22-f51c5a6965f9" acquired by "delete_volume" :: waited 0.037s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:42:56 devstack sudo[99055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f.e9114a22-4c32-4a2d-bb1b-0f2e6f577c1a 1G Aug 28 09:42:56 devstack sudo[99055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:42:56 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-0c279365-12d7-4118-b870-ff99036b77bf tempest-VolumesActionsTest-1474506135 None] Acquiring lock "cinder-a89d2e10-4915-4762-a79a-3859da8b5a40-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:42:56 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[57dcd297-0ba5-4d89-a2fd-35885ff3206e]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:42:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c9036ef0-8311-4382-ab57-449b7198d585 tempest-VolumesActionsTest-1615469397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-5f65039c-e7aa-460e-bd22-f51c5a6965f9 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:42:56 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-0c279365-12d7-4118-b870-ff99036b77bf tempest-VolumesActionsTest-1474506135 None] Lock "cinder-a89d2e10-4915-4762-a79a-3859da8b5a40-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:42:56 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-0c279365-12d7-4118-b870-ff99036b77bf tempest-VolumesActionsTest-1474506135 None] Acquiring lock "cinder-quobyte-a89d2e10-4915-4762-a79a-3859da8b5a40" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:42:56 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-0c279365-12d7-4118-b870-ff99036b77bf tempest-VolumesActionsTest-1474506135 None] Lock "cinder-quobyte-a89d2e10-4915-4762-a79a-3859da8b5a40" acquired by "delete_volume" :: waited 0.016s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:42:56 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7692f0-9954-4066-b708-9c5985e1128e]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:42:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0c279365-12d7-4118-b870-ff99036b77bf tempest-VolumesActionsTest-1474506135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a89d2e10-4915-4762-a79a-3859da8b5a40 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:42:56 devstack sudo[99057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-5f65039c-e7aa-460e-bd22-f51c5a6965f9 Aug 28 09:42:56 devstack sudo[99057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:42:57 devstack sudo[99058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a89d2e10-4915-4762-a79a-3859da8b5a40 Aug 28 09:42:57 devstack sudo[99058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:42:57 devstack sudo[99057]: pam_unix(sudo:session): session closed for user root Aug 28 09:42:57 devstack sudo[99055]: pam_unix(sudo:session): session closed for user root Aug 28 09:42:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c9036ef0-8311-4382-ab57-449b7198d585 tempest-VolumesActionsTest-1615469397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-5f65039c-e7aa-460e-bd22-f51c5a6965f9" returned: 0 in 0.379s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:42:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c9036ef0-8311-4382-ab57-449b7198d585 tempest-VolumesActionsTest-1615469397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-5f65039c-e7aa-460e-bd22-f51c5a6965f9 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:42:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-77e79066-af29-4a52-ad39-14b0e46a2c72 tempest-TestStampPattern-672193429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f.e9114a22-4c32-4a2d-bb1b-0f2e6f577c1a 1G" returned: 0 in 0.471s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:42:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-77e79066-af29-4a52-ad39-14b0e46a2c72 tempest-TestStampPattern-672193429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f.e9114a22-4c32-4a2d-bb1b-0f2e6f577c1a {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:42:57 devstack sudo[99067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-5f65039c-e7aa-460e-bd22-f51c5a6965f9 Aug 28 09:42:57 devstack sudo[99067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:42:57 devstack sudo[99068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f.e9114a22-4c32-4a2d-bb1b-0f2e6f577c1a Aug 28 09:42:57 devstack sudo[99068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:42:57 devstack sudo[99058]: pam_unix(sudo:session): session closed for user root Aug 28 09:42:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0c279365-12d7-4118-b870-ff99036b77bf tempest-VolumesActionsTest-1474506135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a89d2e10-4915-4762-a79a-3859da8b5a40" returned: 0 in 0.392s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:42:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0c279365-12d7-4118-b870-ff99036b77bf tempest-VolumesActionsTest-1474506135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a89d2e10-4915-4762-a79a-3859da8b5a40 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:42:57 devstack sudo[99074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a89d2e10-4915-4762-a79a-3859da8b5a40 Aug 28 09:42:57 devstack sudo[99074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:42:57 devstack sudo[99067]: pam_unix(sudo:session): session closed for user root Aug 28 09:42:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c9036ef0-8311-4382-ab57-449b7198d585 tempest-VolumesActionsTest-1615469397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-5f65039c-e7aa-460e-bd22-f51c5a6965f9" returned: 0 in 0.277s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:42:57 devstack sudo[99068]: pam_unix(sudo:session): session closed for user root Aug 28 09:42:57 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c9036ef0-8311-4382-ab57-449b7198d585 tempest-VolumesActionsTest-1615469397 None] Lock "cinder-quobyte-5f65039c-e7aa-460e-bd22-f51c5a6965f9" released by "delete_volume" :: held 0.731s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:42:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-77e79066-af29-4a52-ad39-14b0e46a2c72 tempest-TestStampPattern-672193429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f.e9114a22-4c32-4a2d-bb1b-0f2e6f577c1a" returned: 0 in 0.286s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:42:57 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-77e79066-af29-4a52-ad39-14b0e46a2c72 tempest-TestStampPattern-672193429 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f.e9114a22-4c32-4a2d-bb1b-0f2e6f577c1a is being set with open permissions: ugo+rw Aug 28 09:42:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-77e79066-af29-4a52-ad39-14b0e46a2c72 tempest-TestStampPattern-672193429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f.e9114a22-4c32-4a2d-bb1b-0f2e6f577c1a {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:42:57 devstack sudo[99080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f.e9114a22-4c32-4a2d-bb1b-0f2e6f577c1a Aug 28 09:42:57 devstack sudo[99080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:42:57 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-c9036ef0-8311-4382-ab57-449b7198d585 tempest-VolumesActionsTest-1615469397 None] Created reservations ['c5fd1b63-6190-4e48-b8df-49058b95031d', '8b8d2b90-7e7f-4aea-a367-0700f16de2bf', '547e6b0c-0ffd-4726-8b8f-dd400cc2e0ee', '752fe346-0e5e-41cb-82dc-e467facdbc55'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:42:57 devstack sudo[99074]: pam_unix(sudo:session): session closed for user root Aug 28 09:42:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0c279365-12d7-4118-b870-ff99036b77bf tempest-VolumesActionsTest-1474506135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a89d2e10-4915-4762-a79a-3859da8b5a40" returned: 0 in 0.265s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:42:57 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-0c279365-12d7-4118-b870-ff99036b77bf tempest-VolumesActionsTest-1474506135 None] Lock "cinder-quobyte-a89d2e10-4915-4762-a79a-3859da8b5a40" released by "delete_volume" :: held 0.699s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:42:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-c9036ef0-8311-4382-ab57-449b7198d585 tempest-VolumesActionsTest-1615469397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:42:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-c9036ef0-8311-4382-ab57-449b7198d585 tempest-VolumesActionsTest-1615469397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:42:57 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-c9036ef0-8311-4382-ab57-449b7198d585 tempest-VolumesActionsTest-1615469397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:42:57 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-c9036ef0-8311-4382-ab57-449b7198d585 tempest-VolumesActionsTest-1615469397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:42:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-c9036ef0-8311-4382-ab57-449b7198d585 tempest-VolumesActionsTest-1615469397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:42:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c9036ef0-8311-4382-ab57-449b7198d585 tempest-VolumesActionsTest-1615469397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:42:57 devstack sudo[99083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:42:57 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-0c279365-12d7-4118-b870-ff99036b77bf tempest-VolumesActionsTest-1474506135 None] Created reservations ['1299dcc7-3c4d-42a3-bf09-1e851a818fd7', '544f556f-5e39-4e88-8d36-5b5c19c5989c', '73b607e2-e0e2-4a83-b07a-93c8524d8c67', '13fbdda6-1bab-433b-b31d-23828f3c9067'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:42:57 devstack sudo[99083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:42:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0c279365-12d7-4118-b870-ff99036b77bf tempest-VolumesActionsTest-1474506135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:42:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0c279365-12d7-4118-b870-ff99036b77bf tempest-VolumesActionsTest-1474506135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:42:57 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0c279365-12d7-4118-b870-ff99036b77bf tempest-VolumesActionsTest-1474506135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:42:57 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0c279365-12d7-4118-b870-ff99036b77bf tempest-VolumesActionsTest-1474506135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:42:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0c279365-12d7-4118-b870-ff99036b77bf tempest-VolumesActionsTest-1474506135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:42:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0c279365-12d7-4118-b870-ff99036b77bf tempest-VolumesActionsTest-1474506135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:42:57 devstack sudo[99080]: pam_unix(sudo:session): session closed for user root Aug 28 09:42:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-77e79066-af29-4a52-ad39-14b0e46a2c72 tempest-TestStampPattern-672193429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f.e9114a22-4c32-4a2d-bb1b-0f2e6f577c1a" returned: 0 in 0.308s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:42:57 devstack sudo[99086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:42:57 devstack sudo[99086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:42:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-77e79066-af29-4a52-ad39-14b0e46a2c72 tempest-TestStampPattern-672193429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:42:57 devstack sudo[99088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f.info Aug 28 09:42:57 devstack sudo[99088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:42:58 devstack sudo[99083]: pam_unix(sudo:session): session closed for user root Aug 28 09:42:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c9036ef0-8311-4382-ab57-449b7198d585 tempest-VolumesActionsTest-1615469397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.365s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:42:58 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-c9036ef0-8311-4382-ab57-449b7198d585 tempest-VolumesActionsTest-1615469397 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:42:58 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-c9036ef0-8311-4382-ab57-449b7198d585 tempest-VolumesActionsTest-1615469397 None] Deleted volume successfully. Aug 28 09:42:58 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c9036ef0-8311-4382-ab57-449b7198d585 tempest-VolumesActionsTest-1615469397 None] Lock "cinder-5f65039c-e7aa-460e-bd22-f51c5a6965f9-delete_volume" released by "delete_volume" :: held 1.412s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:42:58 devstack sudo[99086]: pam_unix(sudo:session): session closed for user root Aug 28 09:42:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0c279365-12d7-4118-b870-ff99036b77bf tempest-VolumesActionsTest-1474506135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.319s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:42:58 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-0c279365-12d7-4118-b870-ff99036b77bf tempest-VolumesActionsTest-1474506135 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:42:58 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-0c279365-12d7-4118-b870-ff99036b77bf tempest-VolumesActionsTest-1474506135 None] Deleted volume successfully. Aug 28 09:42:58 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-0c279365-12d7-4118-b870-ff99036b77bf tempest-VolumesActionsTest-1474506135 None] Lock "cinder-a89d2e10-4915-4762-a79a-3859da8b5a40-delete_volume" released by "delete_volume" :: held 1.304s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:42:58 devstack sudo[99088]: pam_unix(sudo:session): session closed for user root Aug 28 09:42:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-77e79066-af29-4a52-ad39-14b0e46a2c72 tempest-TestStampPattern-672193429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f.info" returned: 0 in 0.322s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:42:58 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-77e79066-af29-4a52-ad39-14b0e46a2c72 tempest-TestStampPattern-672193429 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f.info is being set with open permissions: ugo+rw Aug 28 09:42:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-77e79066-af29-4a52-ad39-14b0e46a2c72 tempest-TestStampPattern-672193429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:42:58 devstack sudo[99093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f.info Aug 28 09:42:58 devstack sudo[99093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:42:58 devstack sudo[99093]: pam_unix(sudo:session): session closed for user root Aug 28 09:42:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-77e79066-af29-4a52-ad39-14b0e46a2c72 tempest-TestStampPattern-672193429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f.info" returned: 0 in 0.313s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:42:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-77e79066-af29-4a52-ad39-14b0e46a2c72 tempest-TestStampPattern-672193429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.291s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:42:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-ece90902-ca5b-4a0c-8912-4bb4c1dd7d34 req-67c3d7e7-1d6c-4c64-8deb-cd0c560e5233 tempest-TestShelveInstance-1148579193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.524s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:42:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-ece90902-ca5b-4a0c-8912-4bb4c1dd7d34 req-67c3d7e7-1d6c-4c64-8deb-cd0c560e5233 tempest-TestShelveInstance-1148579193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:42:58 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-77e79066-af29-4a52-ad39-14b0e46a2c72 tempest-TestStampPattern-672193429 None] Create snapshot completed successfully Aug 28 09:42:58 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-31d8bfcc-fef9-4b1e-b036-5f1f29d6ac98 tempest-VolumesActionsTest-566797683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:42:58 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-31d8bfcc-fef9-4b1e-b036-5f1f29d6ac98 tempest-VolumesActionsTest-566797683 None] Flow 'volume_create_manager' (31586d44-8955-43ac-8f4f-1b3b6c5c2057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:42:58 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-31d8bfcc-fef9-4b1e-b036-5f1f29d6ac98 tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0e66d8e-f02d-43f5-8b68-8a03a0699b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:42:58 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-31d8bfcc-fef9-4b1e-b036-5f1f29d6ac98 tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0e66d8e-f02d-43f5-8b68-8a03a0699b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1671359976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09ab3cda-f7d8-4adf-a912-8c1ba420041d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44365d73418f4b7d88bd4e0c8ae6a9ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:42:58Z,use_quota=True,user_id='f001ff07c17749efba791cfdf0507b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:42:58 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-31d8bfcc-fef9-4b1e-b036-5f1f29d6ac98 tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (539f12d3-a600-400d-bdb3-de10b1e9d93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:42:58 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-31d8bfcc-fef9-4b1e-b036-5f1f29d6ac98 tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (539f12d3-a600-400d-bdb3-de10b1e9d93c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:42:58 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-31d8bfcc-fef9-4b1e-b036-5f1f29d6ac98 tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae27319e-4862-4af6-8500-0a1735eded78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:42:58 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-31d8bfcc-fef9-4b1e-b036-5f1f29d6ac98 tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae27319e-4862-4af6-8500-0a1735eded78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09ab3cda-f7d8-4adf-a912-8c1ba420041d', 'volume_name': 'volume-09ab3cda-f7d8-4adf-a912-8c1ba420041d', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:42:58 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-31d8bfcc-fef9-4b1e-b036-5f1f29d6ac98 tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06b6cd70-eb0a-4ea5-8121-073cbba4cc91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:42:58 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-31d8bfcc-fef9-4b1e-b036-5f1f29d6ac98 tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06b6cd70-eb0a-4ea5-8121-073cbba4cc91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:42:58 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-31d8bfcc-fef9-4b1e-b036-5f1f29d6ac98 tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4903604-a259-486c-93cc-c90eb2ec0463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:42:58 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-31d8bfcc-fef9-4b1e-b036-5f1f29d6ac98 tempest-VolumesActionsTest-566797683 None] Volume 09ab3cda-f7d8-4adf-a912-8c1ba420041d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09ab3cda-f7d8-4adf-a912-8c1ba420041d', 'volume_size': 1} Aug 28 09:42:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-31d8bfcc-fef9-4b1e-b036-5f1f29d6ac98 tempest-VolumesActionsTest-566797683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:42:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-31d8bfcc-fef9-4b1e-b036-5f1f29d6ac98 tempest-VolumesActionsTest-566797683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:42:58 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-31d8bfcc-fef9-4b1e-b036-5f1f29d6ac98 tempest-VolumesActionsTest-566797683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1671359976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09ab3cda-f7d8-4adf-a912-8c1ba420041d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44365d73418f4b7d88bd4e0c8ae6a9ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:42:58Z,use_quota=True,user_id='f001ff07c17749efba791cfdf0507b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:42:58 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-31d8bfcc-fef9-4b1e-b036-5f1f29d6ac98 tempest-VolumesActionsTest-566797683 None] Creating volume 09ab3cda-f7d8-4adf-a912-8c1ba420041d {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:42:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-31d8bfcc-fef9-4b1e-b036-5f1f29d6ac98 tempest-VolumesActionsTest-566797683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:42:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-31d8bfcc-fef9-4b1e-b036-5f1f29d6ac98 tempest-VolumesActionsTest-566797683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:42:58 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-31d8bfcc-fef9-4b1e-b036-5f1f29d6ac98 tempest-VolumesActionsTest-566797683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:42:58 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-31d8bfcc-fef9-4b1e-b036-5f1f29d6ac98 tempest-VolumesActionsTest-566797683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:42:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-31d8bfcc-fef9-4b1e-b036-5f1f29d6ac98 tempest-VolumesActionsTest-566797683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:42:58 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-31d8bfcc-fef9-4b1e-b036-5f1f29d6ac98 tempest-VolumesActionsTest-566797683 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:42:58 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-31d8bfcc-fef9-4b1e-b036-5f1f29d6ac98 tempest-VolumesActionsTest-566797683 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:42:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-31d8bfcc-fef9-4b1e-b036-5f1f29d6ac98 tempest-VolumesActionsTest-566797683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-09ab3cda-f7d8-4adf-a912-8c1ba420041d 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:42:58 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-ece90902-ca5b-4a0c-8912-4bb4c1dd7d34 req-67c3d7e7-1d6c-4c64-8deb-cd0c560e5233 tempest-TestShelveInstance-1148579193 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b', 'name': 'volume-5e222a76-8228-4415-bc2a-4ae174c92e03', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b3bed022-48e1-4731-819c-ed953d04d931', 'enforce_multipath': True} {{(pid=86081) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 09:42:58 devstack sudo[99096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-09ab3cda-f7d8-4adf-a912-8c1ba420041d 1073741824 Aug 28 09:42:58 devstack sudo[99096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:42:58 devstack cinder-volume[86081]: INFO cinder.volume.manager [req-ece90902-ca5b-4a0c-8912-4bb4c1dd7d34 req-67c3d7e7-1d6c-4c64-8deb-cd0c560e5233 tempest-TestShelveInstance-1148579193 None] attachment_update completed successfully. Aug 28 09:42:59 devstack sudo[99096]: pam_unix(sudo:session): session closed for user root Aug 28 09:42:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-31d8bfcc-fef9-4b1e-b036-5f1f29d6ac98 tempest-VolumesActionsTest-566797683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-09ab3cda-f7d8-4adf-a912-8c1ba420041d 1073741824" returned: 0 in 0.622s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:42:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-31d8bfcc-fef9-4b1e-b036-5f1f29d6ac98 tempest-VolumesActionsTest-566797683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-09ab3cda-f7d8-4adf-a912-8c1ba420041d {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:42:59 devstack sudo[99104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-09ab3cda-f7d8-4adf-a912-8c1ba420041d Aug 28 09:42:59 devstack sudo[99104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:42:59 devstack sudo[99104]: pam_unix(sudo:session): session closed for user root Aug 28 09:42:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-31d8bfcc-fef9-4b1e-b036-5f1f29d6ac98 tempest-VolumesActionsTest-566797683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-09ab3cda-f7d8-4adf-a912-8c1ba420041d" returned: 0 in 0.339s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:42:59 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-31d8bfcc-fef9-4b1e-b036-5f1f29d6ac98 tempest-VolumesActionsTest-566797683 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:42:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-31d8bfcc-fef9-4b1e-b036-5f1f29d6ac98 tempest-VolumesActionsTest-566797683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:42:59 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-31d8bfcc-fef9-4b1e-b036-5f1f29d6ac98 tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4903604-a259-486c-93cc-c90eb2ec0463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09ab3cda-f7d8-4adf-a912-8c1ba420041d', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:42:59 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-31d8bfcc-fef9-4b1e-b036-5f1f29d6ac98 tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19c8ce6e-43f3-43bc-9f6c-32319b0fd55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:42:59 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-31d8bfcc-fef9-4b1e-b036-5f1f29d6ac98 tempest-VolumesActionsTest-566797683 None] Volume volume-09ab3cda-f7d8-4adf-a912-8c1ba420041d (09ab3cda-f7d8-4adf-a912-8c1ba420041d): created successfully Aug 28 09:42:59 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-31d8bfcc-fef9-4b1e-b036-5f1f29d6ac98 tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19c8ce6e-43f3-43bc-9f6c-32319b0fd55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:42:59 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-31d8bfcc-fef9-4b1e-b036-5f1f29d6ac98 tempest-VolumesActionsTest-566797683 None] Flow 'volume_create_manager' (31586d44-8955-43ac-8f4f-1b3b6c5c2057) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:42:59 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-31d8bfcc-fef9-4b1e-b036-5f1f29d6ac98 tempest-VolumesActionsTest-566797683 None] Created volume successfully. Aug 28 09:43:00 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-39009596-3059-4f59-8326-73312e153711 tempest-VolumesActionsTest-1615469397 None] Acquiring lock "cinder-09ab3cda-f7d8-4adf-a912-8c1ba420041d-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:43:01 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-39009596-3059-4f59-8326-73312e153711 tempest-VolumesActionsTest-1615469397 None] Lock "cinder-09ab3cda-f7d8-4adf-a912-8c1ba420041d-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:43:01 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-39009596-3059-4f59-8326-73312e153711 tempest-VolumesActionsTest-1615469397 None] Acquiring lock "cinder-quobyte-09ab3cda-f7d8-4adf-a912-8c1ba420041d" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:43:01 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-39009596-3059-4f59-8326-73312e153711 tempest-VolumesActionsTest-1615469397 None] Lock "cinder-quobyte-09ab3cda-f7d8-4adf-a912-8c1ba420041d" acquired by "delete_volume" :: waited 0.026s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:43:01 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[6359efca-bbeb-425a-b357-8dffb635a81d]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:43:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-39009596-3059-4f59-8326-73312e153711 tempest-VolumesActionsTest-1615469397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-09ab3cda-f7d8-4adf-a912-8c1ba420041d {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:01 devstack sudo[99109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-09ab3cda-f7d8-4adf-a912-8c1ba420041d Aug 28 09:43:01 devstack sudo[99109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:01 devstack sudo[99109]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-39009596-3059-4f59-8326-73312e153711 tempest-VolumesActionsTest-1615469397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-09ab3cda-f7d8-4adf-a912-8c1ba420041d" returned: 0 in 0.408s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-39009596-3059-4f59-8326-73312e153711 tempest-VolumesActionsTest-1615469397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-09ab3cda-f7d8-4adf-a912-8c1ba420041d {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:01 devstack sudo[99118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-09ab3cda-f7d8-4adf-a912-8c1ba420041d Aug 28 09:43:01 devstack sudo[99118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:01 devstack sudo[99118]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-39009596-3059-4f59-8326-73312e153711 tempest-VolumesActionsTest-1615469397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-09ab3cda-f7d8-4adf-a912-8c1ba420041d" returned: 0 in 0.349s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:01 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-39009596-3059-4f59-8326-73312e153711 tempest-VolumesActionsTest-1615469397 None] Lock "cinder-quobyte-09ab3cda-f7d8-4adf-a912-8c1ba420041d" released by "delete_volume" :: held 0.812s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:43:02 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-39009596-3059-4f59-8326-73312e153711 tempest-VolumesActionsTest-1615469397 None] Created reservations ['93b87e03-52b5-4f88-8daa-8dfdabd5d121', 'fa30b19e-87ab-424f-b5ba-0c0227be57d6', '85cfb6a4-61d0-4958-a7e4-cf4c9346af26', 'c5b2bd29-74d3-4fee-8d1e-797711757358'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:43:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-39009596-3059-4f59-8326-73312e153711 tempest-VolumesActionsTest-1615469397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:43:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-39009596-3059-4f59-8326-73312e153711 tempest-VolumesActionsTest-1615469397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:43:02 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-39009596-3059-4f59-8326-73312e153711 tempest-VolumesActionsTest-1615469397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:43:02 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-39009596-3059-4f59-8326-73312e153711 tempest-VolumesActionsTest-1615469397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:43:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-39009596-3059-4f59-8326-73312e153711 tempest-VolumesActionsTest-1615469397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:43:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-39009596-3059-4f59-8326-73312e153711 tempest-VolumesActionsTest-1615469397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:02 devstack sudo[99214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:43:02 devstack sudo[99214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:02 devstack sudo[99214]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-39009596-3059-4f59-8326-73312e153711 tempest-VolumesActionsTest-1615469397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.626s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:02 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-39009596-3059-4f59-8326-73312e153711 tempest-VolumesActionsTest-1615469397 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:43:02 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-39009596-3059-4f59-8326-73312e153711 tempest-VolumesActionsTest-1615469397 None] Deleted volume successfully. Aug 28 09:43:02 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-39009596-3059-4f59-8326-73312e153711 tempest-VolumesActionsTest-1615469397 None] Lock "cinder-09ab3cda-f7d8-4adf-a912-8c1ba420041d-delete_volume" released by "delete_volume" :: held 1.943s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:43:03 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-da2e0382-5550-48b0-b018-3aea4d3152d2 tempest-VolumesActionsTest-566797683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:43:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-da2e0382-5550-48b0-b018-3aea4d3152d2 tempest-VolumesActionsTest-566797683 None] Flow 'volume_create_manager' (85ef093a-3950-4b61-b6dd-2c595e85e4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:43:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-da2e0382-5550-48b0-b018-3aea4d3152d2 tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00ffaae3-2309-442d-9715-c166f603f1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-da2e0382-5550-48b0-b018-3aea4d3152d2 tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00ffaae3-2309-442d-9715-c166f603f1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1951099035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88e812c0-3e96-4760-a2c5-bbaa81c74840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44365d73418f4b7d88bd4e0c8ae6a9ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:43:04Z,use_quota=True,user_id='f001ff07c17749efba791cfdf0507b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-da2e0382-5550-48b0-b018-3aea4d3152d2 tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (847358d2-7246-445d-a358-08ccc5cb0165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-da2e0382-5550-48b0-b018-3aea4d3152d2 tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (847358d2-7246-445d-a358-08ccc5cb0165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-da2e0382-5550-48b0-b018-3aea4d3152d2 tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (302a9db4-677e-4b97-9dbb-b0e7a30304d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-da2e0382-5550-48b0-b018-3aea4d3152d2 tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (302a9db4-677e-4b97-9dbb-b0e7a30304d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88e812c0-3e96-4760-a2c5-bbaa81c74840', 'volume_name': 'volume-88e812c0-3e96-4760-a2c5-bbaa81c74840', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-da2e0382-5550-48b0-b018-3aea4d3152d2 tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3847f506-d1c5-4cfe-90fc-e54b6ef1e9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-da2e0382-5550-48b0-b018-3aea4d3152d2 tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3847f506-d1c5-4cfe-90fc-e54b6ef1e9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-da2e0382-5550-48b0-b018-3aea4d3152d2 tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdbc3eb4-f254-4313-aefd-792a2ca1d44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:03 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-da2e0382-5550-48b0-b018-3aea4d3152d2 tempest-VolumesActionsTest-566797683 None] Volume 88e812c0-3e96-4760-a2c5-bbaa81c74840: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88e812c0-3e96-4760-a2c5-bbaa81c74840', 'volume_size': 1} Aug 28 09:43:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-da2e0382-5550-48b0-b018-3aea4d3152d2 tempest-VolumesActionsTest-566797683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:43:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-da2e0382-5550-48b0-b018-3aea4d3152d2 tempest-VolumesActionsTest-566797683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:43:03 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-da2e0382-5550-48b0-b018-3aea4d3152d2 tempest-VolumesActionsTest-566797683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1951099035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88e812c0-3e96-4760-a2c5-bbaa81c74840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44365d73418f4b7d88bd4e0c8ae6a9ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:43:04Z,use_quota=True,user_id='f001ff07c17749efba791cfdf0507b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:43:03 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-da2e0382-5550-48b0-b018-3aea4d3152d2 tempest-VolumesActionsTest-566797683 None] Creating volume 88e812c0-3e96-4760-a2c5-bbaa81c74840 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:43:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-da2e0382-5550-48b0-b018-3aea4d3152d2 tempest-VolumesActionsTest-566797683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:43:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-da2e0382-5550-48b0-b018-3aea4d3152d2 tempest-VolumesActionsTest-566797683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:43:03 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-da2e0382-5550-48b0-b018-3aea4d3152d2 tempest-VolumesActionsTest-566797683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:43:03 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-da2e0382-5550-48b0-b018-3aea4d3152d2 tempest-VolumesActionsTest-566797683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:43:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-da2e0382-5550-48b0-b018-3aea4d3152d2 tempest-VolumesActionsTest-566797683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:43:03 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-da2e0382-5550-48b0-b018-3aea4d3152d2 tempest-VolumesActionsTest-566797683 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:43:03 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-da2e0382-5550-48b0-b018-3aea4d3152d2 tempest-VolumesActionsTest-566797683 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:43:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-da2e0382-5550-48b0-b018-3aea4d3152d2 tempest-VolumesActionsTest-566797683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-88e812c0-3e96-4760-a2c5-bbaa81c74840 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:03 devstack sudo[99603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-88e812c0-3e96-4760-a2c5-bbaa81c74840 1073741824 Aug 28 09:43:03 devstack sudo[99603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:04 devstack sudo[99603]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-da2e0382-5550-48b0-b018-3aea4d3152d2 tempest-VolumesActionsTest-566797683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-88e812c0-3e96-4760-a2c5-bbaa81c74840 1073741824" returned: 0 in 0.726s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-da2e0382-5550-48b0-b018-3aea4d3152d2 tempest-VolumesActionsTest-566797683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-88e812c0-3e96-4760-a2c5-bbaa81c74840 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:04 devstack sudo[99615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-88e812c0-3e96-4760-a2c5-bbaa81c74840 Aug 28 09:43:04 devstack sudo[99615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:05 devstack sudo[99615]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-da2e0382-5550-48b0-b018-3aea4d3152d2 tempest-VolumesActionsTest-566797683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-88e812c0-3e96-4760-a2c5-bbaa81c74840" returned: 0 in 0.474s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:05 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-da2e0382-5550-48b0-b018-3aea4d3152d2 tempest-VolumesActionsTest-566797683 None] <== create_volume: return (1288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:43:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-da2e0382-5550-48b0-b018-3aea4d3152d2 tempest-VolumesActionsTest-566797683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.292s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:43:05 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-da2e0382-5550-48b0-b018-3aea4d3152d2 tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdbc3eb4-f254-4313-aefd-792a2ca1d44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88e812c0-3e96-4760-a2c5-bbaa81c74840', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:05 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-da2e0382-5550-48b0-b018-3aea4d3152d2 tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (114c458d-0da6-4089-91a4-dc1f22d91011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:05 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-da2e0382-5550-48b0-b018-3aea4d3152d2 tempest-VolumesActionsTest-566797683 None] Volume volume-88e812c0-3e96-4760-a2c5-bbaa81c74840 (88e812c0-3e96-4760-a2c5-bbaa81c74840): created successfully Aug 28 09:43:05 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-da2e0382-5550-48b0-b018-3aea4d3152d2 tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (114c458d-0da6-4089-91a4-dc1f22d91011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:05 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-da2e0382-5550-48b0-b018-3aea4d3152d2 tempest-VolumesActionsTest-566797683 None] Flow 'volume_create_manager' (85ef093a-3950-4b61-b6dd-2c595e85e4ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:43:05 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-da2e0382-5550-48b0-b018-3aea4d3152d2 tempest-VolumesActionsTest-566797683 None] Created volume successfully. Aug 28 09:43:06 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e4c57c8e-1d62-41ec-a649-d1bff8b9b57c tempest-VolumesActionsTest-1615469397 None] Acquiring lock "cinder-88e812c0-3e96-4760-a2c5-bbaa81c74840-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:43:06 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e4c57c8e-1d62-41ec-a649-d1bff8b9b57c tempest-VolumesActionsTest-1615469397 None] Lock "cinder-88e812c0-3e96-4760-a2c5-bbaa81c74840-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:43:06 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e4c57c8e-1d62-41ec-a649-d1bff8b9b57c tempest-VolumesActionsTest-1615469397 None] Acquiring lock "cinder-quobyte-88e812c0-3e96-4760-a2c5-bbaa81c74840" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:43:06 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e4c57c8e-1d62-41ec-a649-d1bff8b9b57c tempest-VolumesActionsTest-1615469397 None] Lock "cinder-quobyte-88e812c0-3e96-4760-a2c5-bbaa81c74840" acquired by "delete_volume" :: waited 0.021s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:43:06 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf025f2-813b-488e-b3c2-d3f9016bd93d]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:43:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e4c57c8e-1d62-41ec-a649-d1bff8b9b57c tempest-VolumesActionsTest-1615469397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-88e812c0-3e96-4760-a2c5-bbaa81c74840 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:06 devstack sudo[99619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-88e812c0-3e96-4760-a2c5-bbaa81c74840 Aug 28 09:43:06 devstack sudo[99619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:06 devstack sudo[99619]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e4c57c8e-1d62-41ec-a649-d1bff8b9b57c tempest-VolumesActionsTest-1615469397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-88e812c0-3e96-4760-a2c5-bbaa81c74840" returned: 0 in 0.509s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e4c57c8e-1d62-41ec-a649-d1bff8b9b57c tempest-VolumesActionsTest-1615469397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-88e812c0-3e96-4760-a2c5-bbaa81c74840 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:06 devstack sudo[99624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-88e812c0-3e96-4760-a2c5-bbaa81c74840 Aug 28 09:43:06 devstack sudo[99624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:07 devstack sudo[99624]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e4c57c8e-1d62-41ec-a649-d1bff8b9b57c tempest-VolumesActionsTest-1615469397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-88e812c0-3e96-4760-a2c5-bbaa81c74840" returned: 0 in 0.354s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:07 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e4c57c8e-1d62-41ec-a649-d1bff8b9b57c tempest-VolumesActionsTest-1615469397 None] Lock "cinder-quobyte-88e812c0-3e96-4760-a2c5-bbaa81c74840" released by "delete_volume" :: held 0.936s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:43:07 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-e4c57c8e-1d62-41ec-a649-d1bff8b9b57c tempest-VolumesActionsTest-1615469397 None] Created reservations ['947ac791-691d-4cf7-8de3-475d7c91ff29', '096a9aa7-9f1a-48a9-87f7-b9a64a79ce11', 'db0d2c69-f0a3-4ef2-badb-4b4209c0f7ea', 'a6db5be9-5b51-4dc8-876b-7ac7dd7dafb4'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:43:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e4c57c8e-1d62-41ec-a649-d1bff8b9b57c tempest-VolumesActionsTest-1615469397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:43:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e4c57c8e-1d62-41ec-a649-d1bff8b9b57c tempest-VolumesActionsTest-1615469397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:43:07 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e4c57c8e-1d62-41ec-a649-d1bff8b9b57c tempest-VolumesActionsTest-1615469397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:43:07 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e4c57c8e-1d62-41ec-a649-d1bff8b9b57c tempest-VolumesActionsTest-1615469397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:43:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e4c57c8e-1d62-41ec-a649-d1bff8b9b57c tempest-VolumesActionsTest-1615469397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:43:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e4c57c8e-1d62-41ec-a649-d1bff8b9b57c tempest-VolumesActionsTest-1615469397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:07 devstack sudo[99627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:43:07 devstack sudo[99627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:07 devstack sudo[99627]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e4c57c8e-1d62-41ec-a649-d1bff8b9b57c tempest-VolumesActionsTest-1615469397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.383s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:07 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-e4c57c8e-1d62-41ec-a649-d1bff8b9b57c tempest-VolumesActionsTest-1615469397 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:43:07 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-e4c57c8e-1d62-41ec-a649-d1bff8b9b57c tempest-VolumesActionsTest-1615469397 None] Deleted volume successfully. Aug 28 09:43:07 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e4c57c8e-1d62-41ec-a649-d1bff8b9b57c tempest-VolumesActionsTest-1615469397 None] Lock "cinder-88e812c0-3e96-4760-a2c5-bbaa81c74840-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:43:09 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-63e77ff1-e160-4bb6-9ca1-bb73acd350fc tempest-VolumesGetTest-692007684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:43:09 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-63e77ff1-e160-4bb6-9ca1-bb73acd350fc tempest-VolumesGetTest-692007684 None] Flow 'volume_create_manager' (170a3c58-dbc8-4ad0-9862-0094946a1288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:43:09 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-63e77ff1-e160-4bb6-9ca1-bb73acd350fc tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44befbae-8010-4166-9f1d-48f24173c378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:09 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-63e77ff1-e160-4bb6-9ca1-bb73acd350fc tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44befbae-8010-4166-9f1d-48f24173c378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-410263716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d66c9be8-3c81-4936-a067-17f63f856170,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='83205def167d4a9db6262cd882759ac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:43:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:43:09Z,use_quota=True,user_id='a75cc7859236419b9b52cb4e732324cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:09 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-63e77ff1-e160-4bb6-9ca1-bb73acd350fc tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dddda653-5a2b-4e2e-a13c-39100bdec6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:09 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-63e77ff1-e160-4bb6-9ca1-bb73acd350fc tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dddda653-5a2b-4e2e-a13c-39100bdec6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:09 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-63e77ff1-e160-4bb6-9ca1-bb73acd350fc tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7ae795f-815b-4e84-aee8-8c14ebc3fa0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:09 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-63e77ff1-e160-4bb6-9ca1-bb73acd350fc tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7ae795f-815b-4e84-aee8-8c14ebc3fa0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd66c9be8-3c81-4936-a067-17f63f856170', 'volume_name': 'volume-d66c9be8-3c81-4936-a067-17f63f856170', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:09 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-63e77ff1-e160-4bb6-9ca1-bb73acd350fc tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60450513-f9bb-47ca-a3c0-065015d9214b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:09 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-63e77ff1-e160-4bb6-9ca1-bb73acd350fc tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60450513-f9bb-47ca-a3c0-065015d9214b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:09 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-63e77ff1-e160-4bb6-9ca1-bb73acd350fc tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3435ad08-d46e-45c5-b1da-b79e2c7fa228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:09 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-63e77ff1-e160-4bb6-9ca1-bb73acd350fc tempest-VolumesGetTest-692007684 None] Volume d66c9be8-3c81-4936-a067-17f63f856170: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d66c9be8-3c81-4936-a067-17f63f856170', 'volume_size': 1} Aug 28 09:43:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-63e77ff1-e160-4bb6-9ca1-bb73acd350fc tempest-VolumesGetTest-692007684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:43:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-63e77ff1-e160-4bb6-9ca1-bb73acd350fc tempest-VolumesGetTest-692007684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:43:09 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-63e77ff1-e160-4bb6-9ca1-bb73acd350fc tempest-VolumesGetTest-692007684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-410263716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d66c9be8-3c81-4936-a067-17f63f856170,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='83205def167d4a9db6262cd882759ac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:43:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:43:09Z,use_quota=True,user_id='a75cc7859236419b9b52cb4e732324cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:43:09 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-63e77ff1-e160-4bb6-9ca1-bb73acd350fc tempest-VolumesGetTest-692007684 None] Creating volume d66c9be8-3c81-4936-a067-17f63f856170 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:43:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-63e77ff1-e160-4bb6-9ca1-bb73acd350fc tempest-VolumesGetTest-692007684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:43:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-63e77ff1-e160-4bb6-9ca1-bb73acd350fc tempest-VolumesGetTest-692007684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:43:09 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-63e77ff1-e160-4bb6-9ca1-bb73acd350fc tempest-VolumesGetTest-692007684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:43:09 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-63e77ff1-e160-4bb6-9ca1-bb73acd350fc tempest-VolumesGetTest-692007684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:43:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-63e77ff1-e160-4bb6-9ca1-bb73acd350fc tempest-VolumesGetTest-692007684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:43:09 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-63e77ff1-e160-4bb6-9ca1-bb73acd350fc tempest-VolumesGetTest-692007684 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:43:09 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-63e77ff1-e160-4bb6-9ca1-bb73acd350fc tempest-VolumesGetTest-692007684 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:43:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-63e77ff1-e160-4bb6-9ca1-bb73acd350fc tempest-VolumesGetTest-692007684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d66c9be8-3c81-4936-a067-17f63f856170 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:09 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e15dbce-ae4f-4eb4-a777-18d3f1597362 tempest-TestStampPattern-672193429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:43:09 devstack sudo[99632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d66c9be8-3c81-4936-a067-17f63f856170 1073741824 Aug 28 09:43:09 devstack sudo[99632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:09 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6e15dbce-ae4f-4eb4-a777-18d3f1597362 tempest-TestStampPattern-672193429 None] Flow 'volume_create_manager' (c35460d5-a6a1-4c9c-8ba5-900d70e5565b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:43:09 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6e15dbce-ae4f-4eb4-a777-18d3f1597362 tempest-TestStampPattern-672193429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f1723f0-1fa7-4520-85fd-0310e0072cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:09 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6e15dbce-ae4f-4eb4-a777-18d3f1597362 tempest-TestStampPattern-672193429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f1723f0-1fa7-4520-85fd-0310e0072cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1770666117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e59a5996-e55d-4891-8de0-1ba8309f0f2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31cef57d393c4059a3ee0daa6439cc36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:43:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e9114a22-4c32-4a2d-bb1b-0f2e6f577c1a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:43:09Z,use_quota=True,user_id='7f41fc2801a24bbd848aa7b3e6500d30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:09 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6e15dbce-ae4f-4eb4-a777-18d3f1597362 tempest-TestStampPattern-672193429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (246f5c6f-96bc-44f8-99ea-e985a4892b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:09 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6e15dbce-ae4f-4eb4-a777-18d3f1597362 tempest-TestStampPattern-672193429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (246f5c6f-96bc-44f8-99ea-e985a4892b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:09 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6e15dbce-ae4f-4eb4-a777-18d3f1597362 tempest-TestStampPattern-672193429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc8a9836-1c0f-4b94-a194-708f6d699a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:09 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6e15dbce-ae4f-4eb4-a777-18d3f1597362 tempest-TestStampPattern-672193429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc8a9836-1c0f-4b94-a194-708f6d699a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e59a5996-e55d-4891-8de0-1ba8309f0f2f', 'volume_name': 'volume-e59a5996-e55d-4891-8de0-1ba8309f0f2f', 'volume_size': 1, 'snapshot_id': 'e9114a22-4c32-4a2d-bb1b-0f2e6f577c1a'}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:09 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6e15dbce-ae4f-4eb4-a777-18d3f1597362 tempest-TestStampPattern-672193429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e7e5b25-3ba7-4eab-8a79-e75ec1ff60cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:09 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6e15dbce-ae4f-4eb4-a777-18d3f1597362 tempest-TestStampPattern-672193429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e7e5b25-3ba7-4eab-8a79-e75ec1ff60cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:09 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6e15dbce-ae4f-4eb4-a777-18d3f1597362 tempest-TestStampPattern-672193429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c3d6f97-83f0-4376-b9c2-bb0b603ffdee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:09 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-6e15dbce-ae4f-4eb4-a777-18d3f1597362 tempest-TestStampPattern-672193429 None] Volume e59a5996-e55d-4891-8de0-1ba8309f0f2f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e59a5996-e55d-4891-8de0-1ba8309f0f2f', 'volume_size': 1, 'snapshot_id': 'e9114a22-4c32-4a2d-bb1b-0f2e6f577c1a'} Aug 28 09:43:09 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-a17ff01b-f0cd-4b1e-b7b6-00c35e3a1dde tempest-VolumesActionsTest-566797683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:43:09 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a17ff01b-f0cd-4b1e-b7b6-00c35e3a1dde tempest-VolumesActionsTest-566797683 None] Flow 'volume_create_manager' (7db4a6b8-6a7f-44e4-b163-3d66225e75ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:43:09 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a17ff01b-f0cd-4b1e-b7b6-00c35e3a1dde tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc0346a3-fd70-43fb-bf16-0920fdc1e0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-6e15dbce-ae4f-4eb4-a777-18d3f1597362 tempest-TestStampPattern-672193429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:43:09 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a17ff01b-f0cd-4b1e-b7b6-00c35e3a1dde tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc0346a3-fd70-43fb-bf16-0920fdc1e0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:43:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-233277151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44000eba-2020-4938-8d26-e33609c09bae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44365d73418f4b7d88bd4e0c8ae6a9ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:43:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:43:09Z,use_quota=True,user_id='f001ff07c17749efba791cfdf0507b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:09 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a17ff01b-f0cd-4b1e-b7b6-00c35e3a1dde tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90fa6c06-6660-4b32-a2e7-54be2ae3d328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:09 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a17ff01b-f0cd-4b1e-b7b6-00c35e3a1dde tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90fa6c06-6660-4b32-a2e7-54be2ae3d328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:09 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a17ff01b-f0cd-4b1e-b7b6-00c35e3a1dde tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f4daf55-f1ee-45b8-960f-0bb73228b895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:09 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a17ff01b-f0cd-4b1e-b7b6-00c35e3a1dde tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f4daf55-f1ee-45b8-960f-0bb73228b895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44000eba-2020-4938-8d26-e33609c09bae', 'volume_name': 'volume-44000eba-2020-4938-8d26-e33609c09bae', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:09 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a17ff01b-f0cd-4b1e-b7b6-00c35e3a1dde tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f5484a2-9c8a-4b0e-b34d-50dfaf1032db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:09 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a17ff01b-f0cd-4b1e-b7b6-00c35e3a1dde tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f5484a2-9c8a-4b0e-b34d-50dfaf1032db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:09 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a17ff01b-f0cd-4b1e-b7b6-00c35e3a1dde tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cd12eb4-50b2-4170-ba34-8e0dc2dbd552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:09 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-a17ff01b-f0cd-4b1e-b7b6-00c35e3a1dde tempest-VolumesActionsTest-566797683 None] Volume 44000eba-2020-4938-8d26-e33609c09bae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44000eba-2020-4938-8d26-e33609c09bae', 'volume_size': 1} Aug 28 09:43:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a17ff01b-f0cd-4b1e-b7b6-00c35e3a1dde tempest-VolumesActionsTest-566797683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:43:09 devstack sudo[99632]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-63e77ff1-e160-4bb6-9ca1-bb73acd350fc tempest-VolumesGetTest-692007684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d66c9be8-3c81-4936-a067-17f63f856170 1073741824" returned: 0 in 0.606s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-63e77ff1-e160-4bb6-9ca1-bb73acd350fc tempest-VolumesGetTest-692007684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d66c9be8-3c81-4936-a067-17f63f856170 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:10 devstack sudo[99638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d66c9be8-3c81-4936-a067-17f63f856170 Aug 28 09:43:10 devstack sudo[99638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:10 devstack sudo[99638]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-63e77ff1-e160-4bb6-9ca1-bb73acd350fc tempest-VolumesGetTest-692007684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d66c9be8-3c81-4936-a067-17f63f856170" returned: 0 in 0.278s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:10 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-63e77ff1-e160-4bb6-9ca1-bb73acd350fc tempest-VolumesGetTest-692007684 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:43:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-63e77ff1-e160-4bb6-9ca1-bb73acd350fc tempest-VolumesGetTest-692007684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:43:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-6e15dbce-ae4f-4eb4-a777-18d3f1597362 tempest-TestStampPattern-672193429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.698s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:43:10 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6e15dbce-ae4f-4eb4-a777-18d3f1597362 tempest-TestStampPattern-672193429 None] Acquiring lock "cinder-quobyte-e9114a22-4c32-4a2d-bb1b-0f2e6f577c1a-e59a5996-e55d-4891-8de0-1ba8309f0f2f" by "_create_volume_from_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:43:10 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-63e77ff1-e160-4bb6-9ca1-bb73acd350fc tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3435ad08-d46e-45c5-b1da-b79e2c7fa228) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d66c9be8-3c81-4936-a067-17f63f856170', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:10 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-63e77ff1-e160-4bb6-9ca1-bb73acd350fc tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acf24ced-d1cc-451f-9bc5-c1652ab1aa53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:10 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6e15dbce-ae4f-4eb4-a777-18d3f1597362 tempest-TestStampPattern-672193429 None] Lock "cinder-quobyte-e9114a22-4c32-4a2d-bb1b-0f2e6f577c1a-e59a5996-e55d-4891-8de0-1ba8309f0f2f" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:43:10 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-6e15dbce-ae4f-4eb4-a777-18d3f1597362 tempest-TestStampPattern-672193429 None] Creating volume e59a5996-e55d-4891-8de0-1ba8309f0f2f from snapshot e9114a22-4c32-4a2d-bb1b-0f2e6f577c1a {{(pid=86081) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 28 09:43:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-6e15dbce-ae4f-4eb4-a777-18d3f1597362 tempest-TestStampPattern-672193429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:43:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-6e15dbce-ae4f-4eb4-a777-18d3f1597362 tempest-TestStampPattern-672193429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:43:10 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-6e15dbce-ae4f-4eb4-a777-18d3f1597362 tempest-TestStampPattern-672193429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:43:10 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-6e15dbce-ae4f-4eb4-a777-18d3f1597362 tempest-TestStampPattern-672193429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:43:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-6e15dbce-ae4f-4eb4-a777-18d3f1597362 tempest-TestStampPattern-672193429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:43:10 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-6e15dbce-ae4f-4eb4-a777-18d3f1597362 tempest-TestStampPattern-672193429 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:43:10 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6e15dbce-ae4f-4eb4-a777-18d3f1597362 tempest-TestStampPattern-672193429 None] Acquiring lock "cinder-quobyte-e59a5996-e55d-4891-8de0-1ba8309f0f2f" by "_copy_volume_from_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:43:10 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-63e77ff1-e160-4bb6-9ca1-bb73acd350fc tempest-VolumesGetTest-692007684 None] Volume volume-d66c9be8-3c81-4936-a067-17f63f856170 (d66c9be8-3c81-4936-a067-17f63f856170): created successfully Aug 28 09:43:10 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-63e77ff1-e160-4bb6-9ca1-bb73acd350fc tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acf24ced-d1cc-451f-9bc5-c1652ab1aa53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:10 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-63e77ff1-e160-4bb6-9ca1-bb73acd350fc tempest-VolumesGetTest-692007684 None] Flow 'volume_create_manager' (170a3c58-dbc8-4ad0-9862-0094946a1288) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:43:10 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6e15dbce-ae4f-4eb4-a777-18d3f1597362 tempest-TestStampPattern-672193429 None] Lock "cinder-quobyte-e59a5996-e55d-4891-8de0-1ba8309f0f2f" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:43:10 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-6e15dbce-ae4f-4eb4-a777-18d3f1597362 tempest-TestStampPattern-672193429 None] snapshot: e9114a22-4c32-4a2d-bb1b-0f2e6f577c1a, volume: e59a5996-e55d-4891-8de0-1ba8309f0f2f, {{(pid=86081) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 28 09:43:10 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-63e77ff1-e160-4bb6-9ca1-bb73acd350fc tempest-VolumesGetTest-692007684 None] Created volume successfully. Aug 28 09:43:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-6e15dbce-ae4f-4eb4-a777-18d3f1597362 tempest-TestStampPattern-672193429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:43:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-6e15dbce-ae4f-4eb4-a777-18d3f1597362 tempest-TestStampPattern-672193429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:43:10 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-6e15dbce-ae4f-4eb4-a777-18d3f1597362 tempest-TestStampPattern-672193429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:43:10 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-6e15dbce-ae4f-4eb4-a777-18d3f1597362 tempest-TestStampPattern-672193429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:43:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-6e15dbce-ae4f-4eb4-a777-18d3f1597362 tempest-TestStampPattern-672193429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:43:10 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b185da0-9c8a-405f-9044-658e01fef98f]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:43:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6e15dbce-ae4f-4eb4-a777-18d3f1597362 tempest-TestStampPattern-672193429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f.e9114a22-4c32-4a2d-bb1b-0f2e6f577c1a {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:10 devstack sudo[99658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f.e9114a22-4c32-4a2d-bb1b-0f2e6f577c1a Aug 28 09:43:10 devstack sudo[99658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:11 devstack sudo[99658]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6e15dbce-ae4f-4eb4-a777-18d3f1597362 tempest-TestStampPattern-672193429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f.e9114a22-4c32-4a2d-bb1b-0f2e6f577c1a" returned: 0 in 0.632s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:11 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-6e15dbce-ae4f-4eb4-a777-18d3f1597362 tempest-TestStampPattern-672193429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:43:11 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[04718c4c-8df2-4799-972e-3ead90a694a0]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:43:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6e15dbce-ae4f-4eb4-a777-18d3f1597362 tempest-TestStampPattern-672193429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:11 devstack sudo[99685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f Aug 28 09:43:11 devstack sudo[99685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:11 devstack sudo[99685]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6e15dbce-ae4f-4eb4-a777-18d3f1597362 tempest-TestStampPattern-672193429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f" returned: 0 in 0.698s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:11 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-6e15dbce-ae4f-4eb4-a777-18d3f1597362 tempest-TestStampPattern-672193429 None] will copy from snapshot at /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f {{(pid=86081) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 28 09:43:11 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-6e15dbce-ae4f-4eb4-a777-18d3f1597362 tempest-TestStampPattern-672193429 None] Creating direct copy from snapshot {{(pid=86081) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 28 09:43:11 devstack cinder-volume[86081]: DEBUG cinder.utils [None req-6e15dbce-ae4f-4eb4-a777-18d3f1597362 tempest-TestStampPattern-672193429 None] Path /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e59a5996-e55d-4891-8de0-1ba8309f0f2f not found in is_blk_device check {{(pid=86081) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 28 09:43:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6e15dbce-ae4f-4eb4-a777-18d3f1597362 tempest-TestStampPattern-672193429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e59a5996-e55d-4891-8de0-1ba8309f0f2f {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:11 devstack sudo[99690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e59a5996-e55d-4891-8de0-1ba8309f0f2f Aug 28 09:43:11 devstack sudo[99690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:12 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-94214da1-f7f5-446e-bcbd-8fc313b98b82 tempest-VolumesGetTest-692007684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:43:12 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-94214da1-f7f5-446e-bcbd-8fc313b98b82 tempest-VolumesGetTest-692007684 None] Flow 'volume_create_manager' (205a5af6-8bf0-4349-8aed-b4b311a98e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:43:12 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-94214da1-f7f5-446e-bcbd-8fc313b98b82 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8b38189-6317-45cc-9588-d6a13ee9f9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:12 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-94214da1-f7f5-446e-bcbd-8fc313b98b82 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8b38189-6317-45cc-9588-d6a13ee9f9a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:43:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-271390061',display_name='tempest-VolumesGetTest-Volume-965979318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e92907f-25d8-40c7-8a54-f320be8bdcb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83205def167d4a9db6262cd882759ac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:43:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:43:12Z,use_quota=True,user_id='a75cc7859236419b9b52cb4e732324cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:12 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-94214da1-f7f5-446e-bcbd-8fc313b98b82 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adf2deec-ec6e-4319-93b2-f0c419799808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:12 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-94214da1-f7f5-446e-bcbd-8fc313b98b82 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adf2deec-ec6e-4319-93b2-f0c419799808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:12 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-94214da1-f7f5-446e-bcbd-8fc313b98b82 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8d314d5-f218-44dd-a369-a76404cd01c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:12 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-94214da1-f7f5-446e-bcbd-8fc313b98b82 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8d314d5-f218-44dd-a369-a76404cd01c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e92907f-25d8-40c7-8a54-f320be8bdcb0', 'volume_name': 'volume-1e92907f-25d8-40c7-8a54-f320be8bdcb0', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:12 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-94214da1-f7f5-446e-bcbd-8fc313b98b82 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (318c912e-fdbb-4072-90de-0d0bcae5e80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:12 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-94214da1-f7f5-446e-bcbd-8fc313b98b82 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (318c912e-fdbb-4072-90de-0d0bcae5e80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:12 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-94214da1-f7f5-446e-bcbd-8fc313b98b82 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37bbad6d-f288-4664-b4b2-9f031e097955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:12 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-94214da1-f7f5-446e-bcbd-8fc313b98b82 tempest-VolumesGetTest-692007684 None] Volume 1e92907f-25d8-40c7-8a54-f320be8bdcb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e92907f-25d8-40c7-8a54-f320be8bdcb0', 'volume_size': 1} Aug 28 09:43:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-94214da1-f7f5-446e-bcbd-8fc313b98b82 tempest-VolumesGetTest-692007684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:43:20 devstack sudo[99690]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6e15dbce-ae4f-4eb4-a777-18d3f1597362 tempest-TestStampPattern-672193429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e59a5996-e55d-4891-8de0-1ba8309f0f2f" returned: 0 in 8.121s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:20 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-6e15dbce-ae4f-4eb4-a777-18d3f1597362 tempest-TestStampPattern-672193429 None] Image conversion details: src /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f, size 1024.00 MB, duration 8.12 sec, destination /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e59a5996-e55d-4891-8de0-1ba8309f0f2f {{(pid=86081) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 09:43:20 devstack cinder-volume[86081]: INFO cinder.image.image_utils [None req-6e15dbce-ae4f-4eb4-a777-18d3f1597362 tempest-TestStampPattern-672193429 None] Converted 1024.00 MB image at 126.08 MB/s Aug 28 09:43:20 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-6e15dbce-ae4f-4eb4-a777-18d3f1597362 tempest-TestStampPattern-672193429 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e59a5996-e55d-4891-8de0-1ba8309f0f2f is being set with open permissions: ugo+rw Aug 28 09:43:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6e15dbce-ae4f-4eb4-a777-18d3f1597362 tempest-TestStampPattern-672193429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e59a5996-e55d-4891-8de0-1ba8309f0f2f {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:20 devstack sudo[99744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e59a5996-e55d-4891-8de0-1ba8309f0f2f Aug 28 09:43:20 devstack sudo[99744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:20 devstack sudo[99744]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6e15dbce-ae4f-4eb4-a777-18d3f1597362 tempest-TestStampPattern-672193429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e59a5996-e55d-4891-8de0-1ba8309f0f2f" returned: 0 in 0.301s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:20 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6e15dbce-ae4f-4eb4-a777-18d3f1597362 tempest-TestStampPattern-672193429 None] Lock "cinder-quobyte-e59a5996-e55d-4891-8de0-1ba8309f0f2f" released by "_copy_volume_from_snapshot" :: held 9.932s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:43:20 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6e15dbce-ae4f-4eb4-a777-18d3f1597362 tempest-TestStampPattern-672193429 None] Lock "cinder-quobyte-e9114a22-4c32-4a2d-bb1b-0f2e6f577c1a-e59a5996-e55d-4891-8de0-1ba8309f0f2f" released by "_create_volume_from_snapshot" :: held 10.044s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:43:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-6e15dbce-ae4f-4eb4-a777-18d3f1597362 tempest-TestStampPattern-672193429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.083s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:43:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a17ff01b-f0cd-4b1e-b7b6-00c35e3a1dde tempest-VolumesActionsTest-566797683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.745s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:43:20 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-a17ff01b-f0cd-4b1e-b7b6-00c35e3a1dde tempest-VolumesActionsTest-566797683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:43:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-233277151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44000eba-2020-4938-8d26-e33609c09bae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44365d73418f4b7d88bd4e0c8ae6a9ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:43:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:43:09Z,use_quota=True,user_id='f001ff07c17749efba791cfdf0507b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:43:20 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-a17ff01b-f0cd-4b1e-b7b6-00c35e3a1dde tempest-VolumesActionsTest-566797683 None] Creating volume 44000eba-2020-4938-8d26-e33609c09bae {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:43:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a17ff01b-f0cd-4b1e-b7b6-00c35e3a1dde tempest-VolumesActionsTest-566797683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:43:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a17ff01b-f0cd-4b1e-b7b6-00c35e3a1dde tempest-VolumesActionsTest-566797683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:43:20 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-a17ff01b-f0cd-4b1e-b7b6-00c35e3a1dde tempest-VolumesActionsTest-566797683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:43:20 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-a17ff01b-f0cd-4b1e-b7b6-00c35e3a1dde tempest-VolumesActionsTest-566797683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:43:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a17ff01b-f0cd-4b1e-b7b6-00c35e3a1dde tempest-VolumesActionsTest-566797683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:43:20 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-a17ff01b-f0cd-4b1e-b7b6-00c35e3a1dde tempest-VolumesActionsTest-566797683 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:43:20 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-a17ff01b-f0cd-4b1e-b7b6-00c35e3a1dde tempest-VolumesActionsTest-566797683 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:43:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a17ff01b-f0cd-4b1e-b7b6-00c35e3a1dde tempest-VolumesActionsTest-566797683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44000eba-2020-4938-8d26-e33609c09bae 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:20 devstack sudo[99749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44000eba-2020-4938-8d26-e33609c09bae 1073741824 Aug 28 09:43:20 devstack sudo[99749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:20 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6e15dbce-ae4f-4eb4-a777-18d3f1597362 tempest-TestStampPattern-672193429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c3d6f97-83f0-4376-b9c2-bb0b603ffdee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e59a5996-e55d-4891-8de0-1ba8309f0f2f', 'volume_size': 1, 'snapshot_id': 'e9114a22-4c32-4a2d-bb1b-0f2e6f577c1a'}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:20 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6e15dbce-ae4f-4eb4-a777-18d3f1597362 tempest-TestStampPattern-672193429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f30a119e-64db-4143-a6c1-91d9c12e6ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:20 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-6e15dbce-ae4f-4eb4-a777-18d3f1597362 tempest-TestStampPattern-672193429 None] Volume volume-e59a5996-e55d-4891-8de0-1ba8309f0f2f (e59a5996-e55d-4891-8de0-1ba8309f0f2f): created successfully Aug 28 09:43:20 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6e15dbce-ae4f-4eb4-a777-18d3f1597362 tempest-TestStampPattern-672193429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f30a119e-64db-4143-a6c1-91d9c12e6ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:20 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6e15dbce-ae4f-4eb4-a777-18d3f1597362 tempest-TestStampPattern-672193429 None] Flow 'volume_create_manager' (c35460d5-a6a1-4c9c-8ba5-900d70e5565b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:43:20 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-6e15dbce-ae4f-4eb4-a777-18d3f1597362 tempest-TestStampPattern-672193429 None] Created volume successfully. Aug 28 09:43:21 devstack sudo[99749]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a17ff01b-f0cd-4b1e-b7b6-00c35e3a1dde tempest-VolumesActionsTest-566797683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44000eba-2020-4938-8d26-e33609c09bae 1073741824" returned: 0 in 0.714s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a17ff01b-f0cd-4b1e-b7b6-00c35e3a1dde tempest-VolumesActionsTest-566797683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44000eba-2020-4938-8d26-e33609c09bae {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:21 devstack sudo[99783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44000eba-2020-4938-8d26-e33609c09bae Aug 28 09:43:21 devstack sudo[99783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:21 devstack sudo[99783]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a17ff01b-f0cd-4b1e-b7b6-00c35e3a1dde tempest-VolumesActionsTest-566797683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44000eba-2020-4938-8d26-e33609c09bae" returned: 0 in 0.375s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:21 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-a17ff01b-f0cd-4b1e-b7b6-00c35e3a1dde tempest-VolumesActionsTest-566797683 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:43:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a17ff01b-f0cd-4b1e-b7b6-00c35e3a1dde tempest-VolumesActionsTest-566797683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:43:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-94214da1-f7f5-446e-bcbd-8fc313b98b82 tempest-VolumesGetTest-692007684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.441s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:43:21 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-94214da1-f7f5-446e-bcbd-8fc313b98b82 tempest-VolumesGetTest-692007684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:43:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-271390061',display_name='tempest-VolumesGetTest-Volume-965979318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e92907f-25d8-40c7-8a54-f320be8bdcb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83205def167d4a9db6262cd882759ac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:43:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:43:12Z,use_quota=True,user_id='a75cc7859236419b9b52cb4e732324cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:43:21 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-94214da1-f7f5-446e-bcbd-8fc313b98b82 tempest-VolumesGetTest-692007684 None] Creating volume 1e92907f-25d8-40c7-8a54-f320be8bdcb0 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:43:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-94214da1-f7f5-446e-bcbd-8fc313b98b82 tempest-VolumesGetTest-692007684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:43:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-94214da1-f7f5-446e-bcbd-8fc313b98b82 tempest-VolumesGetTest-692007684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:43:21 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-94214da1-f7f5-446e-bcbd-8fc313b98b82 tempest-VolumesGetTest-692007684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:43:21 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-94214da1-f7f5-446e-bcbd-8fc313b98b82 tempest-VolumesGetTest-692007684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:43:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-94214da1-f7f5-446e-bcbd-8fc313b98b82 tempest-VolumesGetTest-692007684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:43:21 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-94214da1-f7f5-446e-bcbd-8fc313b98b82 tempest-VolumesGetTest-692007684 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:43:21 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-94214da1-f7f5-446e-bcbd-8fc313b98b82 tempest-VolumesGetTest-692007684 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:43:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-94214da1-f7f5-446e-bcbd-8fc313b98b82 tempest-VolumesGetTest-692007684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1e92907f-25d8-40c7-8a54-f320be8bdcb0 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:21 devstack sudo[99798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1e92907f-25d8-40c7-8a54-f320be8bdcb0 1073741824 Aug 28 09:43:21 devstack sudo[99798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:21 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a17ff01b-f0cd-4b1e-b7b6-00c35e3a1dde tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cd12eb4-50b2-4170-ba34-8e0dc2dbd552) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44000eba-2020-4938-8d26-e33609c09bae', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:21 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a17ff01b-f0cd-4b1e-b7b6-00c35e3a1dde tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b3b6bde-144c-4e02-87b9-3202d425b419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:21 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-a17ff01b-f0cd-4b1e-b7b6-00c35e3a1dde tempest-VolumesActionsTest-566797683 None] Volume volume-44000eba-2020-4938-8d26-e33609c09bae (44000eba-2020-4938-8d26-e33609c09bae): created successfully Aug 28 09:43:21 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a17ff01b-f0cd-4b1e-b7b6-00c35e3a1dde tempest-VolumesActionsTest-566797683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b3b6bde-144c-4e02-87b9-3202d425b419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:21 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a17ff01b-f0cd-4b1e-b7b6-00c35e3a1dde tempest-VolumesActionsTest-566797683 None] Flow 'volume_create_manager' (7db4a6b8-6a7f-44e4-b163-3d66225e75ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:43:21 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-a17ff01b-f0cd-4b1e-b7b6-00c35e3a1dde tempest-VolumesActionsTest-566797683 None] Created volume successfully. Aug 28 09:43:22 devstack sudo[99798]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-94214da1-f7f5-446e-bcbd-8fc313b98b82 tempest-VolumesGetTest-692007684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1e92907f-25d8-40c7-8a54-f320be8bdcb0 1073741824" returned: 0 in 0.481s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-94214da1-f7f5-446e-bcbd-8fc313b98b82 tempest-VolumesGetTest-692007684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1e92907f-25d8-40c7-8a54-f320be8bdcb0 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:22 devstack sudo[99829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1e92907f-25d8-40c7-8a54-f320be8bdcb0 Aug 28 09:43:22 devstack sudo[99829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:22 devstack sudo[99829]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-94214da1-f7f5-446e-bcbd-8fc313b98b82 tempest-VolumesGetTest-692007684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1e92907f-25d8-40c7-8a54-f320be8bdcb0" returned: 0 in 0.464s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:22 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-94214da1-f7f5-446e-bcbd-8fc313b98b82 tempest-VolumesGetTest-692007684 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:43:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-94214da1-f7f5-446e-bcbd-8fc313b98b82 tempest-VolumesGetTest-692007684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:43:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-94214da1-f7f5-446e-bcbd-8fc313b98b82 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37bbad6d-f288-4664-b4b2-9f031e097955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e92907f-25d8-40c7-8a54-f320be8bdcb0', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-94214da1-f7f5-446e-bcbd-8fc313b98b82 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa234d55-fd01-4360-bbdb-9b8d2a6c9973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:22 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-94214da1-f7f5-446e-bcbd-8fc313b98b82 tempest-VolumesGetTest-692007684 None] Volume volume-1e92907f-25d8-40c7-8a54-f320be8bdcb0 (1e92907f-25d8-40c7-8a54-f320be8bdcb0): created successfully Aug 28 09:43:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-94214da1-f7f5-446e-bcbd-8fc313b98b82 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa234d55-fd01-4360-bbdb-9b8d2a6c9973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-94214da1-f7f5-446e-bcbd-8fc313b98b82 tempest-VolumesGetTest-692007684 None] Flow 'volume_create_manager' (205a5af6-8bf0-4349-8aed-b4b311a98e19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:43:22 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-94214da1-f7f5-446e-bcbd-8fc313b98b82 tempest-VolumesGetTest-692007684 None] Created volume successfully. Aug 28 09:43:23 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-916567e8-0342-45f6-8bc6-74ed3b53c090 tempest-VolumesActionsTest-566797683 None] Acquiring lock "cinder-44000eba-2020-4938-8d26-e33609c09bae-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:43:23 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-916567e8-0342-45f6-8bc6-74ed3b53c090 tempest-VolumesActionsTest-566797683 None] Lock "cinder-44000eba-2020-4938-8d26-e33609c09bae-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:43:23 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-916567e8-0342-45f6-8bc6-74ed3b53c090 tempest-VolumesActionsTest-566797683 None] Acquiring lock "cinder-quobyte-44000eba-2020-4938-8d26-e33609c09bae" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:43:23 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-916567e8-0342-45f6-8bc6-74ed3b53c090 tempest-VolumesActionsTest-566797683 None] Lock "cinder-quobyte-44000eba-2020-4938-8d26-e33609c09bae" acquired by "delete_volume" :: waited 0.016s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:43:23 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a015450-a22b-4069-a181-b5859437ddd7]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:43:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-916567e8-0342-45f6-8bc6-74ed3b53c090 tempest-VolumesActionsTest-566797683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44000eba-2020-4938-8d26-e33609c09bae {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:23 devstack sudo[99834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44000eba-2020-4938-8d26-e33609c09bae Aug 28 09:43:23 devstack sudo[99834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:23 devstack sudo[99834]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-916567e8-0342-45f6-8bc6-74ed3b53c090 tempest-VolumesActionsTest-566797683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44000eba-2020-4938-8d26-e33609c09bae" returned: 0 in 0.394s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-916567e8-0342-45f6-8bc6-74ed3b53c090 tempest-VolumesActionsTest-566797683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44000eba-2020-4938-8d26-e33609c09bae {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:23 devstack sudo[99839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44000eba-2020-4938-8d26-e33609c09bae Aug 28 09:43:23 devstack sudo[99839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:23 devstack sudo[99839]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-916567e8-0342-45f6-8bc6-74ed3b53c090 tempest-VolumesActionsTest-566797683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44000eba-2020-4938-8d26-e33609c09bae" returned: 0 in 0.274s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:23 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-916567e8-0342-45f6-8bc6-74ed3b53c090 tempest-VolumesActionsTest-566797683 None] Lock "cinder-quobyte-44000eba-2020-4938-8d26-e33609c09bae" released by "delete_volume" :: held 0.714s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:43:23 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-cdcb6c87-f24a-4967-bc35-bfd721766be9 tempest-VolumesGetTest-692007684 None] Acquiring lock "cinder-1e92907f-25d8-40c7-8a54-f320be8bdcb0-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:43:23 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-cdcb6c87-f24a-4967-bc35-bfd721766be9 tempest-VolumesGetTest-692007684 None] Lock "cinder-1e92907f-25d8-40c7-8a54-f320be8bdcb0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:43:24 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-916567e8-0342-45f6-8bc6-74ed3b53c090 tempest-VolumesActionsTest-566797683 None] Created reservations ['ebc7e496-fbd7-458f-9e9e-0fcd3f8646ec', 'bb1faec1-8bab-4021-ab8e-9bad83f8d453', 'e1f51cb9-5c03-4328-b901-6e463147b10c', '5aa54985-95a2-4b0e-b886-8e07569b7af0'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:43:24 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-cdcb6c87-f24a-4967-bc35-bfd721766be9 tempest-VolumesGetTest-692007684 None] Acquiring lock "cinder-quobyte-1e92907f-25d8-40c7-8a54-f320be8bdcb0" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:43:24 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-cdcb6c87-f24a-4967-bc35-bfd721766be9 tempest-VolumesGetTest-692007684 None] Lock "cinder-quobyte-1e92907f-25d8-40c7-8a54-f320be8bdcb0" acquired by "delete_volume" :: waited 0.035s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:43:24 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[dccebcef-d568-4c0c-8199-08f2d97b303c]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:43:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-cdcb6c87-f24a-4967-bc35-bfd721766be9 tempest-VolumesGetTest-692007684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1e92907f-25d8-40c7-8a54-f320be8bdcb0 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-916567e8-0342-45f6-8bc6-74ed3b53c090 tempest-VolumesActionsTest-566797683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:43:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-916567e8-0342-45f6-8bc6-74ed3b53c090 tempest-VolumesActionsTest-566797683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:43:24 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-916567e8-0342-45f6-8bc6-74ed3b53c090 tempest-VolumesActionsTest-566797683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:43:24 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-916567e8-0342-45f6-8bc6-74ed3b53c090 tempest-VolumesActionsTest-566797683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:43:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-916567e8-0342-45f6-8bc6-74ed3b53c090 tempest-VolumesActionsTest-566797683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:43:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-916567e8-0342-45f6-8bc6-74ed3b53c090 tempest-VolumesActionsTest-566797683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:24 devstack sudo[99842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1e92907f-25d8-40c7-8a54-f320be8bdcb0 Aug 28 09:43:24 devstack sudo[99842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:24 devstack sudo[99843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:43:24 devstack sudo[99843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:24 devstack sudo[99843]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-916567e8-0342-45f6-8bc6-74ed3b53c090 tempest-VolumesActionsTest-566797683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.440s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:24 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-916567e8-0342-45f6-8bc6-74ed3b53c090 tempest-VolumesActionsTest-566797683 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:43:24 devstack sudo[99842]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:24 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-916567e8-0342-45f6-8bc6-74ed3b53c090 tempest-VolumesActionsTest-566797683 None] Deleted volume successfully. Aug 28 09:43:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-cdcb6c87-f24a-4967-bc35-bfd721766be9 tempest-VolumesGetTest-692007684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1e92907f-25d8-40c7-8a54-f320be8bdcb0" returned: 0 in 0.520s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-cdcb6c87-f24a-4967-bc35-bfd721766be9 tempest-VolumesGetTest-692007684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1e92907f-25d8-40c7-8a54-f320be8bdcb0 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:24 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-916567e8-0342-45f6-8bc6-74ed3b53c090 tempest-VolumesActionsTest-566797683 None] Lock "cinder-44000eba-2020-4938-8d26-e33609c09bae-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:43:24 devstack sudo[99850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1e92907f-25d8-40c7-8a54-f320be8bdcb0 Aug 28 09:43:24 devstack sudo[99850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:25 devstack sudo[99850]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-cdcb6c87-f24a-4967-bc35-bfd721766be9 tempest-VolumesGetTest-692007684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1e92907f-25d8-40c7-8a54-f320be8bdcb0" returned: 0 in 0.366s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:25 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-cdcb6c87-f24a-4967-bc35-bfd721766be9 tempest-VolumesGetTest-692007684 None] Lock "cinder-quobyte-1e92907f-25d8-40c7-8a54-f320be8bdcb0" released by "delete_volume" :: held 0.952s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:43:25 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-cdcb6c87-f24a-4967-bc35-bfd721766be9 tempest-VolumesGetTest-692007684 None] Created reservations ['9a2bfaa9-393a-46ec-b393-f07068632a02', '1bdb4740-1e1f-4a1b-8325-fee2c718c34d', '546f6dec-0b19-403b-b0eb-f11978a4de7a', '469ffdd7-c9f5-4f31-9064-a37bcdc1c763'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:43:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-cdcb6c87-f24a-4967-bc35-bfd721766be9 tempest-VolumesGetTest-692007684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:43:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-cdcb6c87-f24a-4967-bc35-bfd721766be9 tempest-VolumesGetTest-692007684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:43:25 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-cdcb6c87-f24a-4967-bc35-bfd721766be9 tempest-VolumesGetTest-692007684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:43:25 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-cdcb6c87-f24a-4967-bc35-bfd721766be9 tempest-VolumesGetTest-692007684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:43:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-cdcb6c87-f24a-4967-bc35-bfd721766be9 tempest-VolumesGetTest-692007684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:43:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-cdcb6c87-f24a-4967-bc35-bfd721766be9 tempest-VolumesGetTest-692007684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:25 devstack sudo[99853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:43:25 devstack sudo[99853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:25 devstack sudo[99853]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-cdcb6c87-f24a-4967-bc35-bfd721766be9 tempest-VolumesGetTest-692007684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.417s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:25 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-cdcb6c87-f24a-4967-bc35-bfd721766be9 tempest-VolumesGetTest-692007684 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:43:25 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-cdcb6c87-f24a-4967-bc35-bfd721766be9 tempest-VolumesGetTest-692007684 None] Deleted volume successfully. Aug 28 09:43:25 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-cdcb6c87-f24a-4967-bc35-bfd721766be9 tempest-VolumesGetTest-692007684 None] Lock "cinder-1e92907f-25d8-40c7-8a54-f320be8bdcb0-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:43:26 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-b800ce7a-1dbb-4aa1-93e8-d330b652d265 tempest-VolumesGetTest-692007684 None] Acquiring lock "cinder-d66c9be8-3c81-4936-a067-17f63f856170-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:43:26 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-b800ce7a-1dbb-4aa1-93e8-d330b652d265 tempest-VolumesGetTest-692007684 None] Lock "cinder-d66c9be8-3c81-4936-a067-17f63f856170-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:43:26 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-b800ce7a-1dbb-4aa1-93e8-d330b652d265 tempest-VolumesGetTest-692007684 None] Acquiring lock "cinder-quobyte-d66c9be8-3c81-4936-a067-17f63f856170" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:43:26 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-b800ce7a-1dbb-4aa1-93e8-d330b652d265 tempest-VolumesGetTest-692007684 None] Lock "cinder-quobyte-d66c9be8-3c81-4936-a067-17f63f856170" acquired by "delete_volume" :: waited 0.019s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:43:26 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5dc50c1-e631-4867-a486-1e38788bda95]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:43:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b800ce7a-1dbb-4aa1-93e8-d330b652d265 tempest-VolumesGetTest-692007684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d66c9be8-3c81-4936-a067-17f63f856170 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:26 devstack sudo[99857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d66c9be8-3c81-4936-a067-17f63f856170 Aug 28 09:43:26 devstack sudo[99857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:26 devstack sudo[99857]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b800ce7a-1dbb-4aa1-93e8-d330b652d265 tempest-VolumesGetTest-692007684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d66c9be8-3c81-4936-a067-17f63f856170" returned: 0 in 0.407s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b800ce7a-1dbb-4aa1-93e8-d330b652d265 tempest-VolumesGetTest-692007684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d66c9be8-3c81-4936-a067-17f63f856170 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:26 devstack sudo[99862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d66c9be8-3c81-4936-a067-17f63f856170 Aug 28 09:43:26 devstack sudo[99862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:27 devstack sudo[99862]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b800ce7a-1dbb-4aa1-93e8-d330b652d265 tempest-VolumesGetTest-692007684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d66c9be8-3c81-4936-a067-17f63f856170" returned: 0 in 0.358s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:27 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-b800ce7a-1dbb-4aa1-93e8-d330b652d265 tempest-VolumesGetTest-692007684 None] Lock "cinder-quobyte-d66c9be8-3c81-4936-a067-17f63f856170" released by "delete_volume" :: held 0.827s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:43:27 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-b800ce7a-1dbb-4aa1-93e8-d330b652d265 tempest-VolumesGetTest-692007684 None] Created reservations ['93a5792e-1d6b-426c-accb-d7b5b5ffda3f', '20e9e178-de28-4a9f-b40b-1f9ef53667b5', '0de228ef-fd36-48a6-9f54-7d19d954bc3b', 'e704ab24-5ddb-417e-865f-b9850482019b'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:43:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b800ce7a-1dbb-4aa1-93e8-d330b652d265 tempest-VolumesGetTest-692007684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:43:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b800ce7a-1dbb-4aa1-93e8-d330b652d265 tempest-VolumesGetTest-692007684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:43:27 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-b800ce7a-1dbb-4aa1-93e8-d330b652d265 tempest-VolumesGetTest-692007684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:43:27 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-b800ce7a-1dbb-4aa1-93e8-d330b652d265 tempest-VolumesGetTest-692007684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:43:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b800ce7a-1dbb-4aa1-93e8-d330b652d265 tempest-VolumesGetTest-692007684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:43:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b800ce7a-1dbb-4aa1-93e8-d330b652d265 tempest-VolumesGetTest-692007684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:27 devstack sudo[99866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:43:27 devstack sudo[99866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:27 devstack sudo[99866]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b800ce7a-1dbb-4aa1-93e8-d330b652d265 tempest-VolumesGetTest-692007684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.345s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:27 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-b800ce7a-1dbb-4aa1-93e8-d330b652d265 tempest-VolumesGetTest-692007684 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:43:27 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-b800ce7a-1dbb-4aa1-93e8-d330b652d265 tempest-VolumesGetTest-692007684 None] Deleted volume successfully. Aug 28 09:43:27 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-b800ce7a-1dbb-4aa1-93e8-d330b652d265 tempest-VolumesGetTest-692007684 None] Lock "cinder-d66c9be8-3c81-4936-a067-17f63f856170-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:43:28 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-a444a51f-a889-4b71-ac51-f95ee76256f9 tempest-VolumesGetTest-692007684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:43:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a444a51f-a889-4b71-ac51-f95ee76256f9 tempest-VolumesGetTest-692007684 None] Flow 'volume_create_manager' (767f3e2e-dad5-49f0-9f62-89f3b1a8a361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:43:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a444a51f-a889-4b71-ac51-f95ee76256f9 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1523f88-dcda-4016-b318-4016205a8bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a444a51f-a889-4b71-ac51-f95ee76256f9 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1523f88-dcda-4016-b318-4016205a8bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:43:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1922062130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=991861cf-6baa-4c83-b41b-438669f22bd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83205def167d4a9db6262cd882759ac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:43:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:43:28Z,use_quota=True,user_id='a75cc7859236419b9b52cb4e732324cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a444a51f-a889-4b71-ac51-f95ee76256f9 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26980738-4013-4c3b-b049-936baee0b623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a444a51f-a889-4b71-ac51-f95ee76256f9 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26980738-4013-4c3b-b049-936baee0b623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a444a51f-a889-4b71-ac51-f95ee76256f9 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a4ad10e-b65b-4e3a-9147-03175d0a7ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a444a51f-a889-4b71-ac51-f95ee76256f9 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a4ad10e-b65b-4e3a-9147-03175d0a7ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '991861cf-6baa-4c83-b41b-438669f22bd8', 'volume_name': 'volume-991861cf-6baa-4c83-b41b-438669f22bd8', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a444a51f-a889-4b71-ac51-f95ee76256f9 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d48feee6-6fe6-48e0-bea5-282ae1daf1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a444a51f-a889-4b71-ac51-f95ee76256f9 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d48feee6-6fe6-48e0-bea5-282ae1daf1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a444a51f-a889-4b71-ac51-f95ee76256f9 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d17b721-a0e5-4246-a380-cf78fec17423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:28 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-a444a51f-a889-4b71-ac51-f95ee76256f9 tempest-VolumesGetTest-692007684 None] Volume 991861cf-6baa-4c83-b41b-438669f22bd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-991861cf-6baa-4c83-b41b-438669f22bd8', 'volume_size': 1} Aug 28 09:43:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a444a51f-a889-4b71-ac51-f95ee76256f9 tempest-VolumesGetTest-692007684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:43:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a444a51f-a889-4b71-ac51-f95ee76256f9 tempest-VolumesGetTest-692007684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:43:28 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-a444a51f-a889-4b71-ac51-f95ee76256f9 tempest-VolumesGetTest-692007684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:43:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1922062130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=991861cf-6baa-4c83-b41b-438669f22bd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83205def167d4a9db6262cd882759ac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:43:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:43:28Z,use_quota=True,user_id='a75cc7859236419b9b52cb4e732324cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:43:28 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-a444a51f-a889-4b71-ac51-f95ee76256f9 tempest-VolumesGetTest-692007684 None] Creating volume 991861cf-6baa-4c83-b41b-438669f22bd8 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:43:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a444a51f-a889-4b71-ac51-f95ee76256f9 tempest-VolumesGetTest-692007684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:43:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a444a51f-a889-4b71-ac51-f95ee76256f9 tempest-VolumesGetTest-692007684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:43:28 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-a444a51f-a889-4b71-ac51-f95ee76256f9 tempest-VolumesGetTest-692007684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:43:28 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-a444a51f-a889-4b71-ac51-f95ee76256f9 tempest-VolumesGetTest-692007684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:43:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a444a51f-a889-4b71-ac51-f95ee76256f9 tempest-VolumesGetTest-692007684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:43:28 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-a444a51f-a889-4b71-ac51-f95ee76256f9 tempest-VolumesGetTest-692007684 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:43:28 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-a444a51f-a889-4b71-ac51-f95ee76256f9 tempest-VolumesGetTest-692007684 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:43:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a444a51f-a889-4b71-ac51-f95ee76256f9 tempest-VolumesGetTest-692007684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:28 devstack sudo[99870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8 1073741824 Aug 28 09:43:28 devstack sudo[99870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:29 devstack sudo[99870]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a444a51f-a889-4b71-ac51-f95ee76256f9 tempest-VolumesGetTest-692007684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8 1073741824" returned: 0 in 0.770s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a444a51f-a889-4b71-ac51-f95ee76256f9 tempest-VolumesGetTest-692007684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:29 devstack sudo[99877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8 Aug 28 09:43:29 devstack sudo[99877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:29 devstack sudo[99877]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a444a51f-a889-4b71-ac51-f95ee76256f9 tempest-VolumesGetTest-692007684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8" returned: 0 in 0.459s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:29 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-a444a51f-a889-4b71-ac51-f95ee76256f9 tempest-VolumesGetTest-692007684 None] <== create_volume: return (1340ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:43:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a444a51f-a889-4b71-ac51-f95ee76256f9 tempest-VolumesGetTest-692007684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.343s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:43:29 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a444a51f-a889-4b71-ac51-f95ee76256f9 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d17b721-a0e5-4246-a380-cf78fec17423) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-991861cf-6baa-4c83-b41b-438669f22bd8', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:29 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a444a51f-a889-4b71-ac51-f95ee76256f9 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94032ea0-f0c8-47c3-a2df-ae8878c711be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:29 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-a444a51f-a889-4b71-ac51-f95ee76256f9 tempest-VolumesGetTest-692007684 None] Volume volume-991861cf-6baa-4c83-b41b-438669f22bd8 (991861cf-6baa-4c83-b41b-438669f22bd8): created successfully Aug 28 09:43:29 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a444a51f-a889-4b71-ac51-f95ee76256f9 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94032ea0-f0c8-47c3-a2df-ae8878c711be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:29 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a444a51f-a889-4b71-ac51-f95ee76256f9 tempest-VolumesGetTest-692007684 None] Flow 'volume_create_manager' (767f3e2e-dad5-49f0-9f62-89f3b1a8a361) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:43:30 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-a444a51f-a889-4b71-ac51-f95ee76256f9 tempest-VolumesGetTest-692007684 None] Created volume successfully. Aug 28 09:43:31 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:43:31 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] Flow 'volume_create_manager' (00fc4bc2-a477-4399-b3a6-065c60bfa187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:43:31 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c356d331-2474-47f6-862a-2e071d907f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:31 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c356d331-2474-47f6-862a-2e071d907f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1340757991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d56d0ff8-9fd0-474c-a2ff-735260c98b44,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='83205def167d4a9db6262cd882759ac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=991861cf-6baa-4c83-b41b-438669f22bd8,status='creating',terminated_at=None,updated_at=2026-08-28T07:43:31Z,use_quota=True,user_id='a75cc7859236419b9b52cb4e732324cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:31 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89fb8ac7-92bb-40d3-a065-43f66b58922a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:31 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89fb8ac7-92bb-40d3-a065-43f66b58922a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:31 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f80af65-1099-4b74-a8f9-3d73bdfad929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:31 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f80af65-1099-4b74-a8f9-3d73bdfad929) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd56d0ff8-9fd0-474c-a2ff-735260c98b44', 'volume_name': 'volume-d56d0ff8-9fd0-474c-a2ff-735260c98b44', 'volume_size': 1, 'source_volid': '991861cf-6baa-4c83-b41b-438669f22bd8', 'source_volstatus': 'available'}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:31 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d9020f9-e71d-40fb-bb9c-afab8b2b8d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:31 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d9020f9-e71d-40fb-bb9c-afab8b2b8d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:31 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3fdda52-7852-4f4c-8efa-c49aa71a7d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:31 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] Volume d56d0ff8-9fd0-474c-a2ff-735260c98b44: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d56d0ff8-9fd0-474c-a2ff-735260c98b44', 'volume_size': 1, 'source_volid': '991861cf-6baa-4c83-b41b-438669f22bd8', 'source_volstatus': 'available'} Aug 28 09:43:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:43:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:43:31 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] Cloning volume 991861cf-6baa-4c83-b41b-438669f22bd8 to volume d56d0ff8-9fd0-474c-a2ff-735260c98b44 Aug 28 09:43:31 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] Creating offline snapshot 62269896-2313-4b44-910d-9c5ace7af4f6 of volume 991861cf-6baa-4c83-b41b-438669f22bd8 {{(pid=86081) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:43:31 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[30cf3def-c9a6-4dec-8768-77f2ef153bf2]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:43:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:31 devstack sudo[99881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8 Aug 28 09:43:31 devstack sudo[99881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:31 devstack sudo[99881]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8" returned: 0 in 0.392s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8.62269896-2313-4b44-910d-9c5ace7af4f6 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:31 devstack sudo[99888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8.62269896-2313-4b44-910d-9c5ace7af4f6 1G Aug 28 09:43:31 devstack sudo[99888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:32 devstack sudo[99888]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8.62269896-2313-4b44-910d-9c5ace7af4f6 1G" returned: 0 in 0.604s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-991861cf-6baa-4c83-b41b-438669f22bd8 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8.62269896-2313-4b44-910d-9c5ace7af4f6 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:32 devstack sudo[99897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-991861cf-6baa-4c83-b41b-438669f22bd8 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8.62269896-2313-4b44-910d-9c5ace7af4f6 Aug 28 09:43:32 devstack sudo[99897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:33 devstack sudo[99897]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-991861cf-6baa-4c83-b41b-438669f22bd8 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8.62269896-2313-4b44-910d-9c5ace7af4f6" returned: 0 in 0.459s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:33 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8.62269896-2313-4b44-910d-9c5ace7af4f6 is being set with open permissions: ugo+rw Aug 28 09:43:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8.62269896-2313-4b44-910d-9c5ace7af4f6 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:33 devstack sudo[99905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8.62269896-2313-4b44-910d-9c5ace7af4f6 Aug 28 09:43:33 devstack sudo[99905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:33 devstack sudo[99905]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8.62269896-2313-4b44-910d-9c5ace7af4f6" returned: 0 in 0.586s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:33 devstack sudo[99921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8.info Aug 28 09:43:33 devstack sudo[99921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:34 devstack sudo[99921]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8.info" returned: 0 in 0.512s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:34 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8.info is being set with open permissions: ugo+rw Aug 28 09:43:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:34 devstack sudo[99930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8.info Aug 28 09:43:34 devstack sudo[99930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:35 devstack sudo[99930]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8.info" returned: 0 in 0.820s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:35 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] Acquiring lock "cinder-quobyte-d56d0ff8-9fd0-474c-a2ff-735260c98b44" by "_copy_volume_from_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:43:35 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] Lock "cinder-quobyte-d56d0ff8-9fd0-474c-a2ff-735260c98b44" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:43:35 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] snapshot: 62269896-2313-4b44-910d-9c5ace7af4f6, volume: d56d0ff8-9fd0-474c-a2ff-735260c98b44, {{(pid=86081) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 28 09:43:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:43:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:43:35 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:43:35 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:43:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:43:35 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b287b42-2b12-4e23-a5ca-2926a5dcf708]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:43:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8.62269896-2313-4b44-910d-9c5ace7af4f6 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:35 devstack sudo[99960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8.62269896-2313-4b44-910d-9c5ace7af4f6 Aug 28 09:43:35 devstack sudo[99960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:35 devstack sudo[99960]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8.62269896-2313-4b44-910d-9c5ace7af4f6" returned: 0 in 0.441s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:35 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-991861cf-6baa-4c83-b41b-438669f22bd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:43:35 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a117ebf-e3b8-4d66-8f1e-fcec79674d0d]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:43:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:35 devstack sudo[99967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8 Aug 28 09:43:35 devstack sudo[99967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:36 devstack sudo[99967]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8" returned: 0 in 0.466s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:36 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] will copy from snapshot at /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8 {{(pid=86081) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 28 09:43:36 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] Creating direct copy from snapshot {{(pid=86081) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 28 09:43:36 devstack cinder-volume[86081]: DEBUG cinder.utils [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] Path /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d56d0ff8-9fd0-474c-a2ff-735260c98b44 not found in is_blk_device check {{(pid=86081) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 28 09:43:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d56d0ff8-9fd0-474c-a2ff-735260c98b44 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:36 devstack sudo[99972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d56d0ff8-9fd0-474c-a2ff-735260c98b44 Aug 28 09:43:36 devstack sudo[99972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:36 devstack cinder-volume[86081]: INFO cinder.volume.manager [req-db34e31c-846e-457d-b43a-c0a5635b657e req-5342c26d-4c8e-4673-8fc3-5ee6748c830b tempest-TestShelveInstance-1148579193 None] Terminate volume connection completed successfully. Aug 28 09:43:36 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-db34e31c-846e-457d-b43a-c0a5635b657e req-5342c26d-4c8e-4673-8fc3-5ee6748c830b tempest-TestShelveInstance-1148579193 None] Deleting attachment b3bed022-48e1-4731-819c-ed953d04d931. {{(pid=86081) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 09:43:36 devstack cinder-volume[86081]: DEBUG cinder.coordination [req-db34e31c-846e-457d-b43a-c0a5635b657e req-53cd742b-680e-41e9-806f-7aedf45885fb tempest-TestShelveInstance-1148579193 None] Acquiring lock "cinder-5e222a76-8228-4415-bc2a-4ae174c92e03-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:43:36 devstack cinder-volume[86081]: DEBUG cinder.coordination [req-db34e31c-846e-457d-b43a-c0a5635b657e req-53cd742b-680e-41e9-806f-7aedf45885fb tempest-TestShelveInstance-1148579193 None] Lock "cinder-5e222a76-8228-4415-bc2a-4ae174c92e03-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:43:37 devstack cinder-volume[86081]: DEBUG cinder.coordination [req-db34e31c-846e-457d-b43a-c0a5635b657e req-53cd742b-680e-41e9-806f-7aedf45885fb tempest-TestShelveInstance-1148579193 None] Acquiring lock "cinder-quobyte-5e222a76-8228-4415-bc2a-4ae174c92e03" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:43:37 devstack cinder-volume[86081]: DEBUG cinder.coordination [req-db34e31c-846e-457d-b43a-c0a5635b657e req-53cd742b-680e-41e9-806f-7aedf45885fb tempest-TestShelveInstance-1148579193 None] Lock "cinder-quobyte-5e222a76-8228-4415-bc2a-4ae174c92e03" acquired by "delete_volume" :: waited 0.049s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:43:37 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[69726b7e-56aa-40b4-abe7-292c279df960]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:43:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [req-db34e31c-846e-457d-b43a-c0a5635b657e req-53cd742b-680e-41e9-806f-7aedf45885fb tempest-TestShelveInstance-1148579193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-5e222a76-8228-4415-bc2a-4ae174c92e03 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:37 devstack sudo[99985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-5e222a76-8228-4415-bc2a-4ae174c92e03 Aug 28 09:43:37 devstack sudo[99985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:38 devstack cinder-volume[86081]: DEBUG oslo_service.periodic_task [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86081) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:43:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:43:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:43:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:43:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:43:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:43:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:38 devstack sudo[99991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:43:38 devstack sudo[99991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:38 devstack sudo[99985]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [req-db34e31c-846e-457d-b43a-c0a5635b657e req-53cd742b-680e-41e9-806f-7aedf45885fb tempest-TestShelveInstance-1148579193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-5e222a76-8228-4415-bc2a-4ae174c92e03" returned: 0 in 1.192s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [req-db34e31c-846e-457d-b43a-c0a5635b657e req-53cd742b-680e-41e9-806f-7aedf45885fb tempest-TestShelveInstance-1148579193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-5e222a76-8228-4415-bc2a-4ae174c92e03 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:38 devstack sudo[99993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-5e222a76-8228-4415-bc2a-4ae174c92e03 Aug 28 09:43:38 devstack sudo[99993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:38 devstack sudo[99991]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.583s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:38 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:43:38 devstack cinder-volume[86081]: DEBUG oslo_service.periodic_task [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running periodic task VolumeManager._thread_info {{(pid=86081) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:43:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] thread count: 28 {{(pid=86081) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 09:43:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] thread info: [<_MainThread(MainThread, started 129914189705344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86081) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 09:43:39 devstack sudo[99993]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [req-db34e31c-846e-457d-b43a-c0a5635b657e req-53cd742b-680e-41e9-806f-7aedf45885fb tempest-TestShelveInstance-1148579193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-5e222a76-8228-4415-bc2a-4ae174c92e03" returned: 0 in 0.935s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:39 devstack cinder-volume[86081]: DEBUG cinder.coordination [req-db34e31c-846e-457d-b43a-c0a5635b657e req-53cd742b-680e-41e9-806f-7aedf45885fb tempest-TestShelveInstance-1148579193 None] Lock "cinder-quobyte-5e222a76-8228-4415-bc2a-4ae174c92e03" released by "delete_volume" :: held 2.241s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:43:39 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writing DB stats cinder:SELECT=84,cinder:UPDATE=109,cinder:INSERT=18,cinder:DELETE=10 {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:43:39 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writing DB stats cinder:UPDATE=86,cinder:SELECT=87,cinder:DELETE=8,cinder:INSERT=26 {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:43:39 devstack cinder-volume[86081]: DEBUG cinder.quota [req-db34e31c-846e-457d-b43a-c0a5635b657e req-53cd742b-680e-41e9-806f-7aedf45885fb tempest-TestShelveInstance-1148579193 None] Created reservations ['878faf03-557a-4c77-a59d-032f568356f5', '8cd4cc97-6a14-48f9-a863-06da625e4b1d', '8d4a1973-b2e4-4c5c-9fb5-e08632bc6070', 'a99294ca-5051-4c98-8e15-a328e036a905'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:43:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-db34e31c-846e-457d-b43a-c0a5635b657e req-53cd742b-680e-41e9-806f-7aedf45885fb tempest-TestShelveInstance-1148579193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:43:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-db34e31c-846e-457d-b43a-c0a5635b657e req-53cd742b-680e-41e9-806f-7aedf45885fb tempest-TestShelveInstance-1148579193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:43:39 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [req-db34e31c-846e-457d-b43a-c0a5635b657e req-53cd742b-680e-41e9-806f-7aedf45885fb tempest-TestShelveInstance-1148579193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:43:39 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [req-db34e31c-846e-457d-b43a-c0a5635b657e req-53cd742b-680e-41e9-806f-7aedf45885fb tempest-TestShelveInstance-1148579193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:43:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-db34e31c-846e-457d-b43a-c0a5635b657e req-53cd742b-680e-41e9-806f-7aedf45885fb tempest-TestShelveInstance-1148579193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:43:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [req-db34e31c-846e-457d-b43a-c0a5635b657e req-53cd742b-680e-41e9-806f-7aedf45885fb tempest-TestShelveInstance-1148579193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:39 devstack sudo[99998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:43:39 devstack sudo[99998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:40 devstack sudo[99998]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [req-db34e31c-846e-457d-b43a-c0a5635b657e req-53cd742b-680e-41e9-806f-7aedf45885fb tempest-TestShelveInstance-1148579193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.662s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:40 devstack cinder-volume[86081]: DEBUG cinder.manager [req-db34e31c-846e-457d-b43a-c0a5635b657e req-53cd742b-680e-41e9-806f-7aedf45885fb tempest-TestShelveInstance-1148579193 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:43:40 devstack cinder-volume[86081]: INFO cinder.volume.manager [req-db34e31c-846e-457d-b43a-c0a5635b657e req-53cd742b-680e-41e9-806f-7aedf45885fb tempest-TestShelveInstance-1148579193 None] Deleted volume successfully. Aug 28 09:43:40 devstack cinder-volume[86081]: DEBUG cinder.coordination [req-db34e31c-846e-457d-b43a-c0a5635b657e req-53cd742b-680e-41e9-806f-7aedf45885fb tempest-TestShelveInstance-1148579193 None] Lock "cinder-5e222a76-8228-4415-bc2a-4ae174c92e03-delete_volume" released by "delete_volume" :: held 3.623s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:43:42 devstack sudo[99972]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:42 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d56d0ff8-9fd0-474c-a2ff-735260c98b44" returned: 0 in 6.054s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:42 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] Image conversion details: src /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8, size 1024.00 MB, duration 6.06 sec, destination /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d56d0ff8-9fd0-474c-a2ff-735260c98b44 {{(pid=86081) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 09:43:42 devstack cinder-volume[86081]: INFO cinder.image.image_utils [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] Converted 1024.00 MB image at 169.11 MB/s Aug 28 09:43:42 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d56d0ff8-9fd0-474c-a2ff-735260c98b44 is being set with open permissions: ugo+rw Aug 28 09:43:42 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d56d0ff8-9fd0-474c-a2ff-735260c98b44 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:42 devstack sudo[100002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d56d0ff8-9fd0-474c-a2ff-735260c98b44 Aug 28 09:43:42 devstack sudo[100002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:42 devstack sudo[100002]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:42 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d56d0ff8-9fd0-474c-a2ff-735260c98b44" returned: 0 in 0.299s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:42 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] Lock "cinder-quobyte-d56d0ff8-9fd0-474c-a2ff-735260c98b44" released by "_copy_volume_from_snapshot" :: held 7.383s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:43:42 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] Acquiring lock "cinder-quobyte-62269896-2313-4b44-910d-9c5ace7af4f6" by "_delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:43:42 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] Lock "cinder-quobyte-62269896-2313-4b44-910d-9c5ace7af4f6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:43:42 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] Deleting offline snapshot 62269896-2313-4b44-910d-9c5ace7af4f6 of volume 991861cf-6baa-4c83-b41b-438669f22bd8 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:43:42 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] snapshot_file for this snap is: volume-991861cf-6baa-4c83-b41b-438669f22bd8.62269896-2313-4b44-910d-9c5ace7af4f6 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:43:42 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[380be0cd-d2ee-49ea-b44f-7cc76314cebd]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:43:42 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8.62269896-2313-4b44-910d-9c5ace7af4f6 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:42 devstack sudo[100005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8.62269896-2313-4b44-910d-9c5ace7af4f6 Aug 28 09:43:42 devstack sudo[100005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:42 devstack sudo[100005]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:42 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8.62269896-2313-4b44-910d-9c5ace7af4f6" returned: 0 in 0.440s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:42 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-991861cf-6baa-4c83-b41b-438669f22bd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:43:43 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[c535d526-e41d-4e15-affb-a57d3ae38372]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:43:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:43 devstack sudo[100011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8 Aug 28 09:43:43 devstack sudo[100011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:43 devstack sudo[100011]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8" returned: 0 in 0.628s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8.62269896-2313-4b44-910d-9c5ace7af4f6 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:43 devstack sudo[100017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8.62269896-2313-4b44-910d-9c5ace7af4f6 Aug 28 09:43:43 devstack sudo[100017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:44 devstack sudo[100017]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8.62269896-2313-4b44-910d-9c5ace7af4f6" returned: 0 in 0.379s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8.62269896-2313-4b44-910d-9c5ace7af4f6 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:44 devstack sudo[100022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8.62269896-2313-4b44-910d-9c5ace7af4f6 Aug 28 09:43:44 devstack sudo[100022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:44 devstack sudo[100022]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8.62269896-2313-4b44-910d-9c5ace7af4f6" returned: 0 in 0.313s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:44 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] Lock "cinder-quobyte-62269896-2313-4b44-910d-9c5ace7af4f6" released by "_delete_snapshot" :: held 1.884s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:43:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.935s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:43:44 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3fdda52-7852-4f4c-8efa-c49aa71a7d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d56d0ff8-9fd0-474c-a2ff-735260c98b44', 'volume_size': 1, 'source_volid': '991861cf-6baa-4c83-b41b-438669f22bd8', 'source_volstatus': 'available'}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:44 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53e659ed-2f3e-402e-a03e-d83cee9d9845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:44 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] Volume volume-d56d0ff8-9fd0-474c-a2ff-735260c98b44 (d56d0ff8-9fd0-474c-a2ff-735260c98b44): created successfully Aug 28 09:43:44 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53e659ed-2f3e-402e-a03e-d83cee9d9845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:44 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] Flow 'volume_create_manager' (00fc4bc2-a477-4399-b3a6-065c60bfa187) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:43:44 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-d4d078fc-31e3-47b5-b8e9-80364d52d7f0 tempest-VolumesGetTest-692007684 None] Created volume successfully. Aug 28 09:43:44 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:43:44 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] Flow 'volume_create_manager' (03c4746c-795b-400d-a8d5-9b9c783c3f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:43:44 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baa28493-a530-4eb7-9a2e-40db6d949028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:44 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baa28493-a530-4eb7-9a2e-40db6d949028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:43:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1214507681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a545939-4124-4aba-afa9-bfa87d8291e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96c884eb1980469ea8625b3e7d70de5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:43:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:43:44Z,use_quota=True,user_id='ca16645faedb4b52997cddb61066df84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:44 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a6fe395-8385-4be3-b51b-bc6bbaf4cfa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:44 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a6fe395-8385-4be3-b51b-bc6bbaf4cfa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:44 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b9ad8d9-0e4b-48ab-b48e-20c2b79ffc4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:44 devstack cinder-volume[86081]: DEBUG cinder.image.glance [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] Creating Keystone auth plugin from conf {{(pid=86081) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 28 09:43:44 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b9ad8d9-0e4b-48ab-b48e-20c2b79ffc4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4a545939-4124-4aba-afa9-bfa87d8291e2', 'volume_name': 'volume-4a545939-4124-4aba-afa9-bfa87d8291e2', 'volume_size': 1, 'image_id': '4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b980c3c37cfa4760ad4846d0fd4baffc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'created_at': datetime.datetime(2026, 8, 28, 7, 25, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 7, 25, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:44 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57d8e489-bf92-4db0-b97d-e82e18769451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:44 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57d8e489-bf92-4db0-b97d-e82e18769451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:44 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0607a169-c712-4c2f-a204-c7b446cab3f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:44 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] Volume 4a545939-4124-4aba-afa9-bfa87d8291e2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4a545939-4124-4aba-afa9-bfa87d8291e2', 'volume_size': 1, 'image_id': '4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b980c3c37cfa4760ad4846d0fd4baffc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'created_at': datetime.datetime(2026, 8, 28, 7, 25, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 7, 25, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 28 09:43:44 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] Trying to clone 4a545939-4124-4aba-afa9-bfa87d8291e2 from image 4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'metadata': {}}]). {{(pid=86081) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 28 09:43:45 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_kkc5sg3_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86081) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 28 09:43:45 devstack cinder-volume[86081]: INFO cinder.image.image_utils [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] Image download 20.69 MB at 20.69 MB/s Aug 28 09:43:45 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[7702137f-0b6f-47e2-b3b4-4911f77d4f6e]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:43:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_kkc5sg3_devstack@QuobyteHD {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:45 devstack sudo[100026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_kkc5sg3_devstack@QuobyteHD Aug 28 09:43:45 devstack sudo[100026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:45 devstack sudo[100026]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_kkc5sg3_devstack@QuobyteHD" returned: 0 in 0.432s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:45 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] Temporary image 4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0 is fetched for user ca16645faedb4b52997cddb61066df84. {{(pid=86081) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 28 09:43:45 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8c3829-4607-46d7-a92a-3ad15c557241]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:43:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_kkc5sg3_devstack@QuobyteHD {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:45 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-1116f081-4d6c-4377-a734-98545ceb708b tempest-VolumesGetTest-692007684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:43:45 devstack sudo[100032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_kkc5sg3_devstack@QuobyteHD Aug 28 09:43:45 devstack sudo[100032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:45 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1116f081-4d6c-4377-a734-98545ceb708b tempest-VolumesGetTest-692007684 None] Flow 'volume_create_manager' (425ae81c-aec3-4d81-86f9-aff4d014633f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:43:45 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1116f081-4d6c-4377-a734-98545ceb708b tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06a1f127-0adf-4c12-ac08-5b8776955adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:45 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1116f081-4d6c-4377-a734-98545ceb708b tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06a1f127-0adf-4c12-ac08-5b8776955adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:43:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-47848408',display_name='tempest-VolumesGetTest-Volume-685929635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3274f668-e53d-402d-a1e7-c5ad9482dd0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83205def167d4a9db6262cd882759ac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:43:46Z,use_quota=True,user_id='a75cc7859236419b9b52cb4e732324cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:45 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1116f081-4d6c-4377-a734-98545ceb708b tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cf6c5ea-6b6d-4184-9916-c5d23ecbcf0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:45 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1116f081-4d6c-4377-a734-98545ceb708b tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cf6c5ea-6b6d-4184-9916-c5d23ecbcf0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:45 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1116f081-4d6c-4377-a734-98545ceb708b tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89b665cb-d318-4311-9f68-8725f7cbb548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:45 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1116f081-4d6c-4377-a734-98545ceb708b tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89b665cb-d318-4311-9f68-8725f7cbb548) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3274f668-e53d-402d-a1e7-c5ad9482dd0b', 'volume_name': 'volume-3274f668-e53d-402d-a1e7-c5ad9482dd0b', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:45 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1116f081-4d6c-4377-a734-98545ceb708b tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5df1e7f3-eb1c-48d5-96e8-c6ab5dc8f1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:45 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1116f081-4d6c-4377-a734-98545ceb708b tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5df1e7f3-eb1c-48d5-96e8-c6ab5dc8f1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:45 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1116f081-4d6c-4377-a734-98545ceb708b tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcc3f499-92ed-44cc-825d-2de8e966afcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:45 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-1116f081-4d6c-4377-a734-98545ceb708b tempest-VolumesGetTest-692007684 None] Volume 3274f668-e53d-402d-a1e7-c5ad9482dd0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3274f668-e53d-402d-a1e7-c5ad9482dd0b', 'volume_size': 1} Aug 28 09:43:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-1116f081-4d6c-4377-a734-98545ceb708b tempest-VolumesGetTest-692007684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:43:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-1116f081-4d6c-4377-a734-98545ceb708b tempest-VolumesGetTest-692007684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:43:45 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-1116f081-4d6c-4377-a734-98545ceb708b tempest-VolumesGetTest-692007684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:43:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-47848408',display_name='tempest-VolumesGetTest-Volume-685929635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3274f668-e53d-402d-a1e7-c5ad9482dd0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83205def167d4a9db6262cd882759ac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:43:46Z,use_quota=True,user_id='a75cc7859236419b9b52cb4e732324cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:43:45 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-1116f081-4d6c-4377-a734-98545ceb708b tempest-VolumesGetTest-692007684 None] Creating volume 3274f668-e53d-402d-a1e7-c5ad9482dd0b {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:43:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-1116f081-4d6c-4377-a734-98545ceb708b tempest-VolumesGetTest-692007684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:43:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-1116f081-4d6c-4377-a734-98545ceb708b tempest-VolumesGetTest-692007684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:43:45 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-1116f081-4d6c-4377-a734-98545ceb708b tempest-VolumesGetTest-692007684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:43:45 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-1116f081-4d6c-4377-a734-98545ceb708b tempest-VolumesGetTest-692007684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:43:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-1116f081-4d6c-4377-a734-98545ceb708b tempest-VolumesGetTest-692007684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:43:45 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-1116f081-4d6c-4377-a734-98545ceb708b tempest-VolumesGetTest-692007684 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:43:45 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-1116f081-4d6c-4377-a734-98545ceb708b tempest-VolumesGetTest-692007684 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:43:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1116f081-4d6c-4377-a734-98545ceb708b tempest-VolumesGetTest-692007684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3274f668-e53d-402d-a1e7-c5ad9482dd0b 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:45 devstack sudo[100034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3274f668-e53d-402d-a1e7-c5ad9482dd0b 1073741824 Aug 28 09:43:46 devstack sudo[100034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:46 devstack sudo[100032]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_kkc5sg3_devstack@QuobyteHD" returned: 0 in 0.350s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:43:46 devstack sudo[100034]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1116f081-4d6c-4377-a734-98545ceb708b tempest-VolumesGetTest-692007684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3274f668-e53d-402d-a1e7-c5ad9482dd0b 1073741824" returned: 0 in 0.536s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1116f081-4d6c-4377-a734-98545ceb708b tempest-VolumesGetTest-692007684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3274f668-e53d-402d-a1e7-c5ad9482dd0b {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:46 devstack sudo[100043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3274f668-e53d-402d-a1e7-c5ad9482dd0b Aug 28 09:43:46 devstack sudo[100043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:46 devstack sudo[100043]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1116f081-4d6c-4377-a734-98545ceb708b tempest-VolumesGetTest-692007684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3274f668-e53d-402d-a1e7-c5ad9482dd0b" returned: 0 in 0.276s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:46 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-1116f081-4d6c-4377-a734-98545ceb708b tempest-VolumesGetTest-692007684 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:43:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-1116f081-4d6c-4377-a734-98545ceb708b tempest-VolumesGetTest-692007684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:43:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.729s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:43:46 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:43:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1214507681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a545939-4124-4aba-afa9-bfa87d8291e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96c884eb1980469ea8625b3e7d70de5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:43:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:43:44Z,use_quota=True,user_id='ca16645faedb4b52997cddb61066df84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:43:46 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] Creating volume 4a545939-4124-4aba-afa9-bfa87d8291e2 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:43:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:43:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:43:46 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:43:46 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:43:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:43:46 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:43:46 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:43:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4a545939-4124-4aba-afa9-bfa87d8291e2 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:46 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1116f081-4d6c-4377-a734-98545ceb708b tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcc3f499-92ed-44cc-825d-2de8e966afcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3274f668-e53d-402d-a1e7-c5ad9482dd0b', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:46 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1116f081-4d6c-4377-a734-98545ceb708b tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb04f31b-c49d-4124-8a0a-2906bc95baff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:46 devstack sudo[100046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4a545939-4124-4aba-afa9-bfa87d8291e2 1073741824 Aug 28 09:43:46 devstack sudo[100046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:46 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-1116f081-4d6c-4377-a734-98545ceb708b tempest-VolumesGetTest-692007684 None] Volume volume-3274f668-e53d-402d-a1e7-c5ad9482dd0b (3274f668-e53d-402d-a1e7-c5ad9482dd0b): created successfully Aug 28 09:43:46 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1116f081-4d6c-4377-a734-98545ceb708b tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb04f31b-c49d-4124-8a0a-2906bc95baff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:46 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1116f081-4d6c-4377-a734-98545ceb708b tempest-VolumesGetTest-692007684 None] Flow 'volume_create_manager' (425ae81c-aec3-4d81-86f9-aff4d014633f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:43:46 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-1116f081-4d6c-4377-a734-98545ceb708b tempest-VolumesGetTest-692007684 None] Created volume successfully. Aug 28 09:43:47 devstack sudo[100046]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4a545939-4124-4aba-afa9-bfa87d8291e2 1073741824" returned: 0 in 0.576s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4a545939-4124-4aba-afa9-bfa87d8291e2 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:47 devstack sudo[100052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4a545939-4124-4aba-afa9-bfa87d8291e2 Aug 28 09:43:47 devstack sudo[100052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:47 devstack sudo[100052]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4a545939-4124-4aba-afa9-bfa87d8291e2" returned: 0 in 0.303s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:47 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:43:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:43:47 devstack cinder-volume[86081]: DEBUG cinder.volume.volume_utils [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] Attempting download of 4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0 ((None, [{'url': 'file:///opt/stack/data/glance/images/4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'metadata': {}}])) to volume 4a545939-4124-4aba-afa9-bfa87d8291e2. {{(pid=86081) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 28 09:43:47 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[6593f5d7-9e7e-4051-8048-dbbf22267a59]: (4, 'raw') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:43:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_sz4k0bcl {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:48 devstack sudo[100055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_sz4k0bcl Aug 28 09:43:48 devstack sudo[100055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:48 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6f4c77e6-6bb2-4043-8ec7-442403f7e575 tempest-VolumesGetTest-692007684 None] Acquiring lock "cinder-3274f668-e53d-402d-a1e7-c5ad9482dd0b-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:43:48 devstack sudo[100055]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_sz4k0bcl" returned: 0 in 0.584s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_sz4k0bcl {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:48 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6f4c77e6-6bb2-4043-8ec7-442403f7e575 tempest-VolumesGetTest-692007684 None] Lock "cinder-3274f668-e53d-402d-a1e7-c5ad9482dd0b-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:43:48 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6f4c77e6-6bb2-4043-8ec7-442403f7e575 tempest-VolumesGetTest-692007684 None] Acquiring lock "cinder-quobyte-3274f668-e53d-402d-a1e7-c5ad9482dd0b" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:43:48 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6f4c77e6-6bb2-4043-8ec7-442403f7e575 tempest-VolumesGetTest-692007684 None] Lock "cinder-quobyte-3274f668-e53d-402d-a1e7-c5ad9482dd0b" acquired by "delete_volume" :: waited 0.023s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:43:48 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[757a7f7a-8f21-4ccd-a84c-e2b739503e33]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:43:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6f4c77e6-6bb2-4043-8ec7-442403f7e575 tempest-VolumesGetTest-692007684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3274f668-e53d-402d-a1e7-c5ad9482dd0b {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:48 devstack sudo[100064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_sz4k0bcl Aug 28 09:43:48 devstack sudo[100064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:48 devstack sudo[100068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3274f668-e53d-402d-a1e7-c5ad9482dd0b Aug 28 09:43:48 devstack sudo[100068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:48 devstack sudo[100064]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_sz4k0bcl" returned: 1 in 0.484s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_sz4k0bcl' failed. Not Retrying. {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 09:43:48 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[7364d060-0137-4952-8dca-c87e6a98849d]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:43:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_kkc5sg3_devstack@QuobyteHD {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:49 devstack sudo[100068]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6f4c77e6-6bb2-4043-8ec7-442403f7e575 tempest-VolumesGetTest-692007684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3274f668-e53d-402d-a1e7-c5ad9482dd0b" returned: 0 in 0.487s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6f4c77e6-6bb2-4043-8ec7-442403f7e575 tempest-VolumesGetTest-692007684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3274f668-e53d-402d-a1e7-c5ad9482dd0b {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:49 devstack sudo[100073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_kkc5sg3_devstack@QuobyteHD Aug 28 09:43:49 devstack sudo[100073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:49 devstack sudo[100079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3274f668-e53d-402d-a1e7-c5ad9482dd0b Aug 28 09:43:49 devstack sudo[100079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:49 devstack sudo[100073]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_kkc5sg3_devstack@QuobyteHD" returned: 0 in 0.462s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:49 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] 4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0 was qcow2, converting to qcow2 {{(pid=86081) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 28 09:43:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_kkc5sg3_devstack@QuobyteHD /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4a545939-4124-4aba-afa9-bfa87d8291e2 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:49 devstack sudo[100079]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6f4c77e6-6bb2-4043-8ec7-442403f7e575 tempest-VolumesGetTest-692007684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3274f668-e53d-402d-a1e7-c5ad9482dd0b" returned: 0 in 0.350s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:49 devstack sudo[100085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_kkc5sg3_devstack@QuobyteHD /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4a545939-4124-4aba-afa9-bfa87d8291e2 Aug 28 09:43:49 devstack sudo[100085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:49 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6f4c77e6-6bb2-4043-8ec7-442403f7e575 tempest-VolumesGetTest-692007684 None] Lock "cinder-quobyte-3274f668-e53d-402d-a1e7-c5ad9482dd0b" released by "delete_volume" :: held 0.901s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:43:49 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-6f4c77e6-6bb2-4043-8ec7-442403f7e575 tempest-VolumesGetTest-692007684 None] Created reservations ['c7b508ff-16c7-4a87-b88e-b38ee5355542', '04133da5-04a3-4df5-965b-70d58edc8ac4', '300894db-f162-49cc-a7f9-5b8a71a3ff52', '0873efd7-49cd-4c7a-9e2a-3032cc2378c9'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:43:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-6f4c77e6-6bb2-4043-8ec7-442403f7e575 tempest-VolumesGetTest-692007684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:43:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-6f4c77e6-6bb2-4043-8ec7-442403f7e575 tempest-VolumesGetTest-692007684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:43:49 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-6f4c77e6-6bb2-4043-8ec7-442403f7e575 tempest-VolumesGetTest-692007684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:43:49 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-6f4c77e6-6bb2-4043-8ec7-442403f7e575 tempest-VolumesGetTest-692007684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:43:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-6f4c77e6-6bb2-4043-8ec7-442403f7e575 tempest-VolumesGetTest-692007684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:43:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6f4c77e6-6bb2-4043-8ec7-442403f7e575 tempest-VolumesGetTest-692007684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:49 devstack sudo[100095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:43:49 devstack sudo[100095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-fa8a7434-01eb-4fb5-b9ac-e0dec3d3d6ca req-cdb2da05-cacb-4e99-bfd5-1a02357d55f6 tempest-TestStampPattern-672193429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:43:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-fa8a7434-01eb-4fb5-b9ac-e0dec3d3d6ca req-cdb2da05-cacb-4e99-bfd5-1a02357d55f6 tempest-TestStampPattern-672193429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:43:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-fa8a7434-01eb-4fb5-b9ac-e0dec3d3d6ca req-cdb2da05-cacb-4e99-bfd5-1a02357d55f6 tempest-TestStampPattern-672193429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:43:49 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-fa8a7434-01eb-4fb5-b9ac-e0dec3d3d6ca req-cdb2da05-cacb-4e99-bfd5-1a02357d55f6 tempest-TestStampPattern-672193429 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b', 'name': 'volume-e59a5996-e55d-4891-8de0-1ba8309f0f2f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fbc71979-1392-4b02-a27c-3bcbad3c06c0', 'enforce_multipath': True} {{(pid=86081) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 09:43:49 devstack cinder-volume[86081]: INFO cinder.volume.manager [req-fa8a7434-01eb-4fb5-b9ac-e0dec3d3d6ca req-cdb2da05-cacb-4e99-bfd5-1a02357d55f6 tempest-TestStampPattern-672193429 None] attachment_update completed successfully. Aug 28 09:43:49 devstack sudo[100095]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6f4c77e6-6bb2-4043-8ec7-442403f7e575 tempest-VolumesGetTest-692007684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.296s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:49 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-6f4c77e6-6bb2-4043-8ec7-442403f7e575 tempest-VolumesGetTest-692007684 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:43:50 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-6f4c77e6-6bb2-4043-8ec7-442403f7e575 tempest-VolumesGetTest-692007684 None] Deleted volume successfully. Aug 28 09:43:50 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6f4c77e6-6bb2-4043-8ec7-442403f7e575 tempest-VolumesGetTest-692007684 None] Lock "cinder-3274f668-e53d-402d-a1e7-c5ad9482dd0b-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:43:50 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-b4940c7e-3b03-4dad-bdd5-aac4a6d95ed7 tempest-VolumesGetTest-692007684 None] Acquiring lock "cinder-d56d0ff8-9fd0-474c-a2ff-735260c98b44-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:43:50 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-b4940c7e-3b03-4dad-bdd5-aac4a6d95ed7 tempest-VolumesGetTest-692007684 None] Lock "cinder-d56d0ff8-9fd0-474c-a2ff-735260c98b44-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:43:50 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-b4940c7e-3b03-4dad-bdd5-aac4a6d95ed7 tempest-VolumesGetTest-692007684 None] Acquiring lock "cinder-quobyte-d56d0ff8-9fd0-474c-a2ff-735260c98b44" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:43:50 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-b4940c7e-3b03-4dad-bdd5-aac4a6d95ed7 tempest-VolumesGetTest-692007684 None] Lock "cinder-quobyte-d56d0ff8-9fd0-474c-a2ff-735260c98b44" acquired by "delete_volume" :: waited 0.026s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:43:51 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdc44a9-e2d8-416b-ae2c-9fba34744642]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:43:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b4940c7e-3b03-4dad-bdd5-aac4a6d95ed7 tempest-VolumesGetTest-692007684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d56d0ff8-9fd0-474c-a2ff-735260c98b44 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:51 devstack sudo[100485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d56d0ff8-9fd0-474c-a2ff-735260c98b44 Aug 28 09:43:51 devstack sudo[100485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:51 devstack sudo[100485]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b4940c7e-3b03-4dad-bdd5-aac4a6d95ed7 tempest-VolumesGetTest-692007684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d56d0ff8-9fd0-474c-a2ff-735260c98b44" returned: 0 in 0.429s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b4940c7e-3b03-4dad-bdd5-aac4a6d95ed7 tempest-VolumesGetTest-692007684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d56d0ff8-9fd0-474c-a2ff-735260c98b44 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:51 devstack sudo[100491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d56d0ff8-9fd0-474c-a2ff-735260c98b44 Aug 28 09:43:51 devstack sudo[100491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:51 devstack sudo[100085]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_kkc5sg3_devstack@QuobyteHD /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4a545939-4124-4aba-afa9-bfa87d8291e2" returned: 0 in 2.183s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:51 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_kkc5sg3_devstack@QuobyteHD, size 112.00 MB, duration 2.18 sec, destination /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4a545939-4124-4aba-afa9-bfa87d8291e2 {{(pid=86081) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 09:43:51 devstack cinder-volume[86081]: INFO cinder.image.image_utils [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] Converted 112.00 MB image at 51.27 MB/s Aug 28 09:43:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4a545939-4124-4aba-afa9-bfa87d8291e2 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:51 devstack sudo[100493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4a545939-4124-4aba-afa9-bfa87d8291e2 1G Aug 28 09:43:51 devstack sudo[100493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:51 devstack sudo[100491]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b4940c7e-3b03-4dad-bdd5-aac4a6d95ed7 tempest-VolumesGetTest-692007684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d56d0ff8-9fd0-474c-a2ff-735260c98b44" returned: 0 in 0.326s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:51 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-b4940c7e-3b03-4dad-bdd5-aac4a6d95ed7 tempest-VolumesGetTest-692007684 None] Lock "cinder-quobyte-d56d0ff8-9fd0-474c-a2ff-735260c98b44" released by "delete_volume" :: held 0.825s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:43:51 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-b4940c7e-3b03-4dad-bdd5-aac4a6d95ed7 tempest-VolumesGetTest-692007684 None] Created reservations ['f9076582-f976-4b26-a4a2-f4310dfc90c4', 'b510381a-98aa-4dab-84d1-3d110e5263b6', 'fb6a8ac1-29ea-4de4-b4cb-f13f86413798', 'b5e13900-4565-4402-96cb-23a6151e1338'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:43:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b4940c7e-3b03-4dad-bdd5-aac4a6d95ed7 tempest-VolumesGetTest-692007684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:43:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b4940c7e-3b03-4dad-bdd5-aac4a6d95ed7 tempest-VolumesGetTest-692007684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:43:52 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-b4940c7e-3b03-4dad-bdd5-aac4a6d95ed7 tempest-VolumesGetTest-692007684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:43:52 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-b4940c7e-3b03-4dad-bdd5-aac4a6d95ed7 tempest-VolumesGetTest-692007684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:43:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b4940c7e-3b03-4dad-bdd5-aac4a6d95ed7 tempest-VolumesGetTest-692007684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:43:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b4940c7e-3b03-4dad-bdd5-aac4a6d95ed7 tempest-VolumesGetTest-692007684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:52 devstack sudo[100508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:43:52 devstack sudo[100508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:52 devstack sudo[100493]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4a545939-4124-4aba-afa9-bfa87d8291e2 1G" returned: 0 in 0.463s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:52 devstack cinder-volume[86081]: DEBUG cinder.volume.volume_utils [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] Downloaded image 4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0 ((None, [{'url': 'file:///opt/stack/data/glance/images/4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'metadata': {}}])) to volume 4a545939-4124-4aba-afa9-bfa87d8291e2 successfully. {{(pid=86081) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 28 09:43:52 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] Temporary image 4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0 for user ca16645faedb4b52997cddb61066df84 is deleted. {{(pid=86081) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 28 09:43:52 devstack cinder-volume[86081]: DEBUG cinder.volume.volume_utils [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] Marking volume 4a545939-4124-4aba-afa9-bfa87d8291e2 as bootable. {{(pid=86081) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 28 09:43:52 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] Copying metadata from image 4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0 to 4a545939-4124-4aba-afa9-bfa87d8291e2. {{(pid=86081) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 28 09:43:52 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] Creating volume glance metadata for volume 4a545939-4124-4aba-afa9-bfa87d8291e2 backed by image 4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86081) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 28 09:43:52 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-03e66a9b-681b-41c4-91d6-06bde9d14a83 tempest-VolumesGetTest-692007684 None] Acquiring lock "cinder-991861cf-6baa-4c83-b41b-438669f22bd8-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:43:52 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0607a169-c712-4c2f-a204-c7b446cab3f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a545939-4124-4aba-afa9-bfa87d8291e2', 'volume_size': 1, 'image_id': '4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b980c3c37cfa4760ad4846d0fd4baffc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'created_at': datetime.datetime(2026, 8, 28, 7, 25, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 7, 25, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:52 devstack sudo[100508]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:52 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c24c7f2-a6a2-4ef8-b798-e226686d3c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:52 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-03e66a9b-681b-41c4-91d6-06bde9d14a83 tempest-VolumesGetTest-692007684 None] Lock "cinder-991861cf-6baa-4c83-b41b-438669f22bd8-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:43:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b4940c7e-3b03-4dad-bdd5-aac4a6d95ed7 tempest-VolumesGetTest-692007684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.303s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:52 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-b4940c7e-3b03-4dad-bdd5-aac4a6d95ed7 tempest-VolumesGetTest-692007684 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:43:52 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] Volume volume-4a545939-4124-4aba-afa9-bfa87d8291e2 (4a545939-4124-4aba-afa9-bfa87d8291e2): created successfully Aug 28 09:43:52 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c24c7f2-a6a2-4ef8-b798-e226686d3c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:52 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] Flow 'volume_create_manager' (03c4746c-795b-400d-a8d5-9b9c783c3f82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:43:52 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-b4940c7e-3b03-4dad-bdd5-aac4a6d95ed7 tempest-VolumesGetTest-692007684 None] Deleted volume successfully. Aug 28 09:43:52 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-aec85157-1fdb-4cec-a8d9-278d9d1421a0 tempest-VolumesImageMetadata-798816539 None] Created volume successfully. Aug 28 09:43:52 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-b4940c7e-3b03-4dad-bdd5-aac4a6d95ed7 tempest-VolumesGetTest-692007684 None] Lock "cinder-d56d0ff8-9fd0-474c-a2ff-735260c98b44-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:43:52 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-03e66a9b-681b-41c4-91d6-06bde9d14a83 tempest-VolumesGetTest-692007684 None] Acquiring lock "cinder-quobyte-991861cf-6baa-4c83-b41b-438669f22bd8" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:43:52 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-03e66a9b-681b-41c4-91d6-06bde9d14a83 tempest-VolumesGetTest-692007684 None] Lock "cinder-quobyte-991861cf-6baa-4c83-b41b-438669f22bd8" acquired by "delete_volume" :: waited 0.017s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:43:52 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[58bb43ea-4bf2-4f90-8c1a-372a6dea414b]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:43:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-03e66a9b-681b-41c4-91d6-06bde9d14a83 tempest-VolumesGetTest-692007684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:52 devstack sudo[100517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8 Aug 28 09:43:52 devstack sudo[100517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:52 devstack sudo[100517]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-03e66a9b-681b-41c4-91d6-06bde9d14a83 tempest-VolumesGetTest-692007684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8" returned: 0 in 0.403s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-03e66a9b-681b-41c4-91d6-06bde9d14a83 tempest-VolumesGetTest-692007684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:52 devstack sudo[100524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8 Aug 28 09:43:52 devstack sudo[100524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:53 devstack sudo[100524]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-03e66a9b-681b-41c4-91d6-06bde9d14a83 tempest-VolumesGetTest-692007684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-991861cf-6baa-4c83-b41b-438669f22bd8" returned: 0 in 0.318s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:53 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-03e66a9b-681b-41c4-91d6-06bde9d14a83 tempest-VolumesGetTest-692007684 None] Lock "cinder-quobyte-991861cf-6baa-4c83-b41b-438669f22bd8" released by "delete_volume" :: held 0.790s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:43:53 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-03e66a9b-681b-41c4-91d6-06bde9d14a83 tempest-VolumesGetTest-692007684 None] Created reservations ['c494decb-5895-4902-aaca-03d887051d05', '732c85a5-0cf5-42c8-b3e2-a8774b5587db', '59e49efe-35d4-448b-9cff-6452f903e742', '1786d06b-e80b-4a66-a04f-f039df8cbffa'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:43:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-03e66a9b-681b-41c4-91d6-06bde9d14a83 tempest-VolumesGetTest-692007684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:43:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-03e66a9b-681b-41c4-91d6-06bde9d14a83 tempest-VolumesGetTest-692007684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:43:53 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-03e66a9b-681b-41c4-91d6-06bde9d14a83 tempest-VolumesGetTest-692007684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:43:53 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-03e66a9b-681b-41c4-91d6-06bde9d14a83 tempest-VolumesGetTest-692007684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:43:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-03e66a9b-681b-41c4-91d6-06bde9d14a83 tempest-VolumesGetTest-692007684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:43:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-03e66a9b-681b-41c4-91d6-06bde9d14a83 tempest-VolumesGetTest-692007684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:53 devstack cinder-volume[86081]: INFO cinder.volume.manager [req-b0af5989-572c-43a1-82f3-9c3168718aae req-1c69424e-1a3e-41ce-a119-8fd50f4e2cba tempest-TestStampPattern-672193429 None] Terminate volume connection completed successfully. Aug 28 09:43:53 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-b0af5989-572c-43a1-82f3-9c3168718aae req-1c69424e-1a3e-41ce-a119-8fd50f4e2cba tempest-TestStampPattern-672193429 None] Deleting attachment fbc71979-1392-4b02-a27c-3bcbad3c06c0. {{(pid=86081) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 09:43:53 devstack sudo[100554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:43:53 devstack sudo[100554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:53 devstack sudo[100554]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-03e66a9b-681b-41c4-91d6-06bde9d14a83 tempest-VolumesGetTest-692007684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.345s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:53 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-03e66a9b-681b-41c4-91d6-06bde9d14a83 tempest-VolumesGetTest-692007684 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:43:53 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-03e66a9b-681b-41c4-91d6-06bde9d14a83 tempest-VolumesGetTest-692007684 None] Deleted volume successfully. Aug 28 09:43:53 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-03e66a9b-681b-41c4-91d6-06bde9d14a83 tempest-VolumesGetTest-692007684 None] Lock "cinder-991861cf-6baa-4c83-b41b-438669f22bd8-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:43:53 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-dcb7b272-97ca-40b8-b2c7-c483493c08b9 tempest-VolumesImageMetadata-798816539 None] Acquiring lock "cinder-4a545939-4124-4aba-afa9-bfa87d8291e2-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:43:54 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-dcb7b272-97ca-40b8-b2c7-c483493c08b9 tempest-VolumesImageMetadata-798816539 None] Lock "cinder-4a545939-4124-4aba-afa9-bfa87d8291e2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:43:54 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-dcb7b272-97ca-40b8-b2c7-c483493c08b9 tempest-VolumesImageMetadata-798816539 None] Acquiring lock "cinder-quobyte-4a545939-4124-4aba-afa9-bfa87d8291e2" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:43:54 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-dcb7b272-97ca-40b8-b2c7-c483493c08b9 tempest-VolumesImageMetadata-798816539 None] Lock "cinder-quobyte-4a545939-4124-4aba-afa9-bfa87d8291e2" acquired by "delete_volume" :: waited 0.036s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:43:54 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0bbca6-596c-4c20-bd32-e65c68686b7a]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:43:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-dcb7b272-97ca-40b8-b2c7-c483493c08b9 tempest-VolumesImageMetadata-798816539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4a545939-4124-4aba-afa9-bfa87d8291e2 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:54 devstack sudo[100557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4a545939-4124-4aba-afa9-bfa87d8291e2 Aug 28 09:43:54 devstack sudo[100557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:54 devstack sudo[100557]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-dcb7b272-97ca-40b8-b2c7-c483493c08b9 tempest-VolumesImageMetadata-798816539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4a545939-4124-4aba-afa9-bfa87d8291e2" returned: 0 in 0.643s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-dcb7b272-97ca-40b8-b2c7-c483493c08b9 tempest-VolumesImageMetadata-798816539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4a545939-4124-4aba-afa9-bfa87d8291e2 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:54 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:43:54 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] Flow 'volume_create_manager' (4aef5f26-1a1a-4de2-899a-5572908ae115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:43:54 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48fecde1-db54-48f2-9597-078671acfb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:54 devstack sudo[100563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4a545939-4124-4aba-afa9-bfa87d8291e2 Aug 28 09:43:54 devstack sudo[100563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:54 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48fecde1-db54-48f2-9597-078671acfb3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:43:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-787767511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebecfb6f-2433-44e0-9223-6e9d5336d503,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='83205def167d4a9db6262cd882759ac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:43:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:43:55Z,use_quota=True,user_id='a75cc7859236419b9b52cb4e732324cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:54 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f0139bd-2563-4de2-9032-c70f29bff0d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:54 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f0139bd-2563-4de2-9032-c70f29bff0d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:54 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (224c961f-1fe9-4aa9-8e7d-d2be6be88b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:54 devstack cinder-volume[86081]: DEBUG cinder.image.glance [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] Creating Keystone auth plugin from conf {{(pid=86081) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 28 09:43:55 devstack sudo[100563]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-dcb7b272-97ca-40b8-b2c7-c483493c08b9 tempest-VolumesImageMetadata-798816539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4a545939-4124-4aba-afa9-bfa87d8291e2" returned: 0 in 0.353s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:55 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-dcb7b272-97ca-40b8-b2c7-c483493c08b9 tempest-VolumesImageMetadata-798816539 None] Lock "cinder-quobyte-4a545939-4124-4aba-afa9-bfa87d8291e2" released by "delete_volume" :: held 1.068s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:43:55 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-dcb7b272-97ca-40b8-b2c7-c483493c08b9 tempest-VolumesImageMetadata-798816539 None] Created reservations ['0610c4be-dbda-4fac-9e7e-b4b5e613d968', 'd9aeb2cb-b8f8-4346-afa4-932d368de2bd', 'f1ea70a2-7d61-4a3d-9776-2f9fbd9221ca', 'd0f9c845-4f2e-4cba-ad51-82dbf17fc174'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:43:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-dcb7b272-97ca-40b8-b2c7-c483493c08b9 tempest-VolumesImageMetadata-798816539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:43:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-dcb7b272-97ca-40b8-b2c7-c483493c08b9 tempest-VolumesImageMetadata-798816539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:43:55 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-dcb7b272-97ca-40b8-b2c7-c483493c08b9 tempest-VolumesImageMetadata-798816539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:43:55 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-dcb7b272-97ca-40b8-b2c7-c483493c08b9 tempest-VolumesImageMetadata-798816539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:43:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-dcb7b272-97ca-40b8-b2c7-c483493c08b9 tempest-VolumesImageMetadata-798816539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:43:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-dcb7b272-97ca-40b8-b2c7-c483493c08b9 tempest-VolumesImageMetadata-798816539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:55 devstack sudo[100568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:43:55 devstack sudo[100568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:55 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (224c961f-1fe9-4aa9-8e7d-d2be6be88b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ebecfb6f-2433-44e0-9223-6e9d5336d503', 'volume_name': 'volume-ebecfb6f-2433-44e0-9223-6e9d5336d503', 'volume_size': 1, 'image_id': '4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b980c3c37cfa4760ad4846d0fd4baffc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'created_at': datetime.datetime(2026, 8, 28, 7, 25, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 7, 25, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:55 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d612a03-7b7f-4410-99c6-0b0dfd56e0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:55 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d612a03-7b7f-4410-99c6-0b0dfd56e0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:43:55 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (059a11e2-338a-4fa6-b419-f691b46bff46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:43:55 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] Volume ebecfb6f-2433-44e0-9223-6e9d5336d503: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ebecfb6f-2433-44e0-9223-6e9d5336d503', 'volume_size': 1, 'image_id': '4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b980c3c37cfa4760ad4846d0fd4baffc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'created_at': datetime.datetime(2026, 8, 28, 7, 25, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 7, 25, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 28 09:43:55 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] Trying to clone ebecfb6f-2433-44e0-9223-6e9d5336d503 from image 4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'metadata': {}}]). {{(pid=86081) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 28 09:43:56 devstack sudo[100568]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-dcb7b272-97ca-40b8-b2c7-c483493c08b9 tempest-VolumesImageMetadata-798816539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.671s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:56 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-dcb7b272-97ca-40b8-b2c7-c483493c08b9 tempest-VolumesImageMetadata-798816539 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:43:56 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-dcb7b272-97ca-40b8-b2c7-c483493c08b9 tempest-VolumesImageMetadata-798816539 None] Deleted volume successfully. Aug 28 09:43:56 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-dcb7b272-97ca-40b8-b2c7-c483493c08b9 tempest-VolumesImageMetadata-798816539 None] Lock "cinder-4a545939-4124-4aba-afa9-bfa87d8291e2-delete_volume" released by "delete_volume" :: held 2.196s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:43:56 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_a0serctddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86081) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 28 09:43:56 devstack cinder-volume[86081]: INFO cinder.image.image_utils [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] Image download 20.69 MB at 20.69 MB/s Aug 28 09:43:56 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9621155-b0f0-4342-9eb7-7390b6edf5fd]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:43:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_a0serctddevstack@QuobyteHD {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:56 devstack sudo[100594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_a0serctddevstack@QuobyteHD Aug 28 09:43:56 devstack sudo[100594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:57 devstack sudo[100594]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_a0serctddevstack@QuobyteHD" returned: 0 in 0.532s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:57 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] Temporary image 4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0 is fetched for user a75cc7859236419b9b52cb4e732324cf. {{(pid=86081) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 28 09:43:57 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[815dca89-0633-4a76-bc8d-9f870e3b2758]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:43:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_a0serctddevstack@QuobyteHD {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:57 devstack sudo[100601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_a0serctddevstack@QuobyteHD Aug 28 09:43:57 devstack sudo[100601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:57 devstack sudo[100601]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_a0serctddevstack@QuobyteHD" returned: 0 in 0.538s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:43:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:43:57 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:43:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-787767511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebecfb6f-2433-44e0-9223-6e9d5336d503,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='83205def167d4a9db6262cd882759ac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:43:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:43:55Z,use_quota=True,user_id='a75cc7859236419b9b52cb4e732324cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:43:57 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] Creating volume ebecfb6f-2433-44e0-9223-6e9d5336d503 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:43:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:43:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:43:57 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:43:57 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:43:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:43:57 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:43:57 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:43:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ebecfb6f-2433-44e0-9223-6e9d5336d503 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:57 devstack sudo[100607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ebecfb6f-2433-44e0-9223-6e9d5336d503 1073741824 Aug 28 09:43:57 devstack sudo[100607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:58 devstack sudo[100607]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ebecfb6f-2433-44e0-9223-6e9d5336d503 1073741824" returned: 0 in 0.572s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ebecfb6f-2433-44e0-9223-6e9d5336d503 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:58 devstack sudo[100612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ebecfb6f-2433-44e0-9223-6e9d5336d503 Aug 28 09:43:58 devstack sudo[100612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:58 devstack sudo[100612]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ebecfb6f-2433-44e0-9223-6e9d5336d503" returned: 0 in 0.341s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:58 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:43:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:43:58 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-84f07a80-e6bf-457c-9885-4a3211f2095b tempest-TestStampPattern-672193429 None] Acquiring lock "cinder-e59a5996-e55d-4891-8de0-1ba8309f0f2f-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:43:58 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-84f07a80-e6bf-457c-9885-4a3211f2095b tempest-TestStampPattern-672193429 None] Lock "cinder-e59a5996-e55d-4891-8de0-1ba8309f0f2f-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:43:58 devstack cinder-volume[86081]: DEBUG cinder.volume.volume_utils [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] Attempting download of 4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0 ((None, [{'url': 'file:///opt/stack/data/glance/images/4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'metadata': {}}])) to volume ebecfb6f-2433-44e0-9223-6e9d5336d503. {{(pid=86081) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 28 09:43:58 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-84f07a80-e6bf-457c-9885-4a3211f2095b tempest-TestStampPattern-672193429 None] Acquiring lock "cinder-quobyte-e59a5996-e55d-4891-8de0-1ba8309f0f2f" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:43:59 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-84f07a80-e6bf-457c-9885-4a3211f2095b tempest-TestStampPattern-672193429 None] Lock "cinder-quobyte-e59a5996-e55d-4891-8de0-1ba8309f0f2f" acquired by "delete_volume" :: waited 0.017s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:43:59 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e9ec30-879d-4506-aa4a-c019d30c9bf3]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:43:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-84f07a80-e6bf-457c-9885-4a3211f2095b tempest-TestStampPattern-672193429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e59a5996-e55d-4891-8de0-1ba8309f0f2f {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:59 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb42b056-8d2f-42bc-95bc-4041c403fb89]: (4, 'raw') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:43:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_f9rwte4v {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:59 devstack sudo[100615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e59a5996-e55d-4891-8de0-1ba8309f0f2f Aug 28 09:43:59 devstack sudo[100615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:59 devstack sudo[100616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_f9rwte4v Aug 28 09:43:59 devstack sudo[100616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:59 devstack sudo[100616]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_f9rwte4v" returned: 0 in 0.390s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_f9rwte4v {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:59 devstack sudo[100615]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-84f07a80-e6bf-457c-9885-4a3211f2095b tempest-TestStampPattern-672193429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e59a5996-e55d-4891-8de0-1ba8309f0f2f" returned: 0 in 0.447s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-84f07a80-e6bf-457c-9885-4a3211f2095b tempest-TestStampPattern-672193429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e59a5996-e55d-4891-8de0-1ba8309f0f2f {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:59 devstack sudo[100626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e59a5996-e55d-4891-8de0-1ba8309f0f2f Aug 28 09:43:59 devstack sudo[100626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:59 devstack sudo[100625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_f9rwte4v Aug 28 09:43:59 devstack sudo[100625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:43:59 devstack sudo[100626]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-84f07a80-e6bf-457c-9885-4a3211f2095b tempest-TestStampPattern-672193429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e59a5996-e55d-4891-8de0-1ba8309f0f2f" returned: 0 in 0.292s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:59 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-84f07a80-e6bf-457c-9885-4a3211f2095b tempest-TestStampPattern-672193429 None] Lock "cinder-quobyte-e59a5996-e55d-4891-8de0-1ba8309f0f2f" released by "delete_volume" :: held 0.801s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:43:59 devstack sudo[100625]: pam_unix(sudo:session): session closed for user root Aug 28 09:43:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_f9rwte4v" returned: 1 in 0.394s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:43:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_f9rwte4v' failed. Not Retrying. {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 09:43:59 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb199528-de1d-4ac1-aa28-92029a47d8c9]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:43:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_a0serctddevstack@QuobyteHD {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:43:59 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-84f07a80-e6bf-457c-9885-4a3211f2095b tempest-TestStampPattern-672193429 None] Created reservations ['edfb2f49-0657-4e6d-b087-18d042fd6100', 'f888287c-b0df-4517-8717-a57b73b31496', 'f782eb3d-79b8-447a-ab3a-ce7b6a957f07', '94d1a0d8-973c-4dd2-b1ba-2986aeef017a'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:43:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-84f07a80-e6bf-457c-9885-4a3211f2095b tempest-TestStampPattern-672193429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:43:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-84f07a80-e6bf-457c-9885-4a3211f2095b tempest-TestStampPattern-672193429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:43:59 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-84f07a80-e6bf-457c-9885-4a3211f2095b tempest-TestStampPattern-672193429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:43:59 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-84f07a80-e6bf-457c-9885-4a3211f2095b tempest-TestStampPattern-672193429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:43:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-84f07a80-e6bf-457c-9885-4a3211f2095b tempest-TestStampPattern-672193429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:43:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-84f07a80-e6bf-457c-9885-4a3211f2095b tempest-TestStampPattern-672193429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:00 devstack sudo[100632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_a0serctddevstack@QuobyteHD Aug 28 09:44:00 devstack sudo[100632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:00 devstack sudo[100633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:44:00 devstack sudo[100633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:00 devstack sudo[100633]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:00 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-84f07a80-e6bf-457c-9885-4a3211f2095b tempest-TestStampPattern-672193429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.281s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:00 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-84f07a80-e6bf-457c-9885-4a3211f2095b tempest-TestStampPattern-672193429 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:44:00 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-84f07a80-e6bf-457c-9885-4a3211f2095b tempest-TestStampPattern-672193429 None] Deleted volume successfully. Aug 28 09:44:00 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-84f07a80-e6bf-457c-9885-4a3211f2095b tempest-TestStampPattern-672193429 None] Lock "cinder-e59a5996-e55d-4891-8de0-1ba8309f0f2f-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:44:00 devstack sudo[100632]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:00 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_a0serctddevstack@QuobyteHD" returned: 0 in 0.534s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:00 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] 4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0 was qcow2, converting to qcow2 {{(pid=86081) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 28 09:44:00 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_a0serctddevstack@QuobyteHD /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ebecfb6f-2433-44e0-9223-6e9d5336d503 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:00 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-474baa67-656b-4787-8904-226be2f11f45 tempest-TestStampPattern-672193429 None] Acquiring lock "cinder-e9114a22-4c32-4a2d-bb1b-0f2e6f577c1a-delete_snapshot" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:44:00 devstack sudo[100640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_a0serctddevstack@QuobyteHD /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ebecfb6f-2433-44e0-9223-6e9d5336d503 Aug 28 09:44:00 devstack sudo[100640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:00 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-474baa67-656b-4787-8904-226be2f11f45 tempest-TestStampPattern-672193429 None] Lock "cinder-e9114a22-4c32-4a2d-bb1b-0f2e6f577c1a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:44:00 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-474baa67-656b-4787-8904-226be2f11f45 tempest-TestStampPattern-672193429 None] Acquiring lock "cinder-quobyte-fdaebbe4-a086-4d5a-b030-ad882ad73b9f" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:44:00 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-474baa67-656b-4787-8904-226be2f11f45 tempest-TestStampPattern-672193429 None] Lock "cinder-quobyte-fdaebbe4-a086-4d5a-b030-ad882ad73b9f" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:44:00 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-474baa67-656b-4787-8904-226be2f11f45 tempest-TestStampPattern-672193429 None] Acquiring lock "cinder-quobyte-e9114a22-4c32-4a2d-bb1b-0f2e6f577c1a" by "_delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:44:00 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-474baa67-656b-4787-8904-226be2f11f45 tempest-TestStampPattern-672193429 None] Lock "cinder-quobyte-e9114a22-4c32-4a2d-bb1b-0f2e6f577c1a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:44:00 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-474baa67-656b-4787-8904-226be2f11f45 tempest-TestStampPattern-672193429 None] Deleting offline snapshot e9114a22-4c32-4a2d-bb1b-0f2e6f577c1a of volume fdaebbe4-a086-4d5a-b030-ad882ad73b9f {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:44:00 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-474baa67-656b-4787-8904-226be2f11f45 tempest-TestStampPattern-672193429 None] snapshot_file for this snap is: volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f.e9114a22-4c32-4a2d-bb1b-0f2e6f577c1a {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:44:00 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fe585a-9ed7-4797-98d4-243c75ab1187]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:44:00 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-474baa67-656b-4787-8904-226be2f11f45 tempest-TestStampPattern-672193429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f.e9114a22-4c32-4a2d-bb1b-0f2e6f577c1a {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:00 devstack sudo[100642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f.e9114a22-4c32-4a2d-bb1b-0f2e6f577c1a Aug 28 09:44:00 devstack sudo[100642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:01 devstack sudo[100642]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-474baa67-656b-4787-8904-226be2f11f45 tempest-TestStampPattern-672193429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f.e9114a22-4c32-4a2d-bb1b-0f2e6f577c1a" returned: 0 in 0.530s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:01 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-474baa67-656b-4787-8904-226be2f11f45 tempest-TestStampPattern-672193429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:44:01 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee27c8e-7db4-4131-8317-85dfc564370b]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:44:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-474baa67-656b-4787-8904-226be2f11f45 tempest-TestStampPattern-672193429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:01 devstack sudo[100653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f Aug 28 09:44:01 devstack sudo[100653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:01 devstack sudo[100653]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-474baa67-656b-4787-8904-226be2f11f45 tempest-TestStampPattern-672193429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f" returned: 0 in 0.718s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-474baa67-656b-4787-8904-226be2f11f45 tempest-TestStampPattern-672193429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f.e9114a22-4c32-4a2d-bb1b-0f2e6f577c1a {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:01 devstack sudo[100658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f.e9114a22-4c32-4a2d-bb1b-0f2e6f577c1a Aug 28 09:44:01 devstack sudo[100658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:02 devstack sudo[100658]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-474baa67-656b-4787-8904-226be2f11f45 tempest-TestStampPattern-672193429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f.e9114a22-4c32-4a2d-bb1b-0f2e6f577c1a" returned: 0 in 0.453s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-474baa67-656b-4787-8904-226be2f11f45 tempest-TestStampPattern-672193429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f.e9114a22-4c32-4a2d-bb1b-0f2e6f577c1a {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:02 devstack sudo[100663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f.e9114a22-4c32-4a2d-bb1b-0f2e6f577c1a Aug 28 09:44:02 devstack sudo[100663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:02 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:44:02 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Flow 'volume_create_manager' (c5976a8a-42d3-4d31-bcbb-df3a9e7ba12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:44:02 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5910ebb-a197-4fda-8dcd-0c9eec0a69d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:02 devstack sudo[100663]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-474baa67-656b-4787-8904-226be2f11f45 tempest-TestStampPattern-672193429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f.e9114a22-4c32-4a2d-bb1b-0f2e6f577c1a" returned: 0 in 0.410s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:02 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5910ebb-a197-4fda-8dcd-0c9eec0a69d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:44:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=742fc64a-b8df-469d-acc7-606b750ae9f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='254b7318b769436e967a671d9b5dd024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:44:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:44:03Z,use_quota=True,user_id='38179513f8f8410792a1b27027ed8794',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(12a53c4e-499e-4530-91cc-8b212e5eeeb4),volume_type_id=12a53c4e-499e-4530-91cc-8b212e5eeeb4)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:02 devstack sudo[100640]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:02 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eed50077-0f3d-4db8-bb2f-a61284e259ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:02 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eed50077-0f3d-4db8-bb2f-a61284e259ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:02 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (138fe711-399a-40fc-a925-4a6994e501db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:02 devstack cinder-volume[86081]: DEBUG cinder.image.glance [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Creating Keystone auth plugin from conf {{(pid=86081) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 28 09:44:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_a0serctddevstack@QuobyteHD /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ebecfb6f-2433-44e0-9223-6e9d5336d503" returned: 0 in 2.409s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:02 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0_a0serctddevstack@QuobyteHD, size 112.00 MB, duration 2.41 sec, destination /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ebecfb6f-2433-44e0-9223-6e9d5336d503 {{(pid=86081) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 09:44:02 devstack cinder-volume[86081]: INFO cinder.image.image_utils [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] Converted 112.00 MB image at 46.47 MB/s Aug 28 09:44:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ebecfb6f-2433-44e0-9223-6e9d5336d503 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:02 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-474baa67-656b-4787-8904-226be2f11f45 tempest-TestStampPattern-672193429 None] Lock "cinder-quobyte-e9114a22-4c32-4a2d-bb1b-0f2e6f577c1a" released by "_delete_snapshot" :: held 2.308s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:44:02 devstack sudo[100666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ebecfb6f-2433-44e0-9223-6e9d5336d503 1G Aug 28 09:44:02 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-474baa67-656b-4787-8904-226be2f11f45 tempest-TestStampPattern-672193429 None] Lock "cinder-quobyte-fdaebbe4-a086-4d5a-b030-ad882ad73b9f" released by "delete_snapshot" :: held 2.338s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:44:02 devstack sudo[100666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:02 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-474baa67-656b-4787-8904-226be2f11f45 tempest-TestStampPattern-672193429 None] Created reservations ['bc893a67-60b2-4153-8353-5ea24bcf8162', 'ba0de77d-08a7-4340-95fc-cbc796f40ed0', '4f5e2b84-9dc6-452b-b62c-e0498105b64e', '96e44c77-43b9-499d-9396-b65f3ec96f06'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:44:03 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-474baa67-656b-4787-8904-226be2f11f45 tempest-TestStampPattern-672193429 None] Delete snapshot completed successfully. Aug 28 09:44:03 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-474baa67-656b-4787-8904-226be2f11f45 tempest-TestStampPattern-672193429 None] Lock "cinder-e9114a22-4c32-4a2d-bb1b-0f2e6f577c1a-delete_snapshot" released by "delete_snapshot" :: held 2.542s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:44:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (138fe711-399a-40fc-a925-4a6994e501db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '742fc64a-b8df-469d-acc7-606b750ae9f8', 'volume_name': 'volume-742fc64a-b8df-469d-acc7-606b750ae9f8', 'volume_size': 1, 'image_id': '9235ce3f-ddf9-4a61-bdea-82abb46ef92a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9235ce3f-ddf9-4a61-bdea-82abb46ef92a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '293bdb7d472ccc5f27e27ffa2073b4d1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '254b7318b769436e967a671d9b5dd024', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '38b4b4a549020339868fa0a1eb915371eba5b0622fbfbbb5d21a1cb6a208017ddcb24acc1fe409b43ba67ac20d46c772594a3e04d3cb367eb258df8f72954bde', 'id': '9235ce3f-ddf9-4a61-bdea-82abb46ef92a', 'created_at': datetime.datetime(2026, 8, 28, 7, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 7, 44, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9235ce3f-ddf9-4a61-bdea-82abb46ef92a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (592648e1-1d31-4144-941c-ced3ac98a918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (592648e1-1d31-4144-941c-ced3ac98a918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e948adb9-51ea-46f0-b860-9774371cad7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:03 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Volume 742fc64a-b8df-469d-acc7-606b750ae9f8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-742fc64a-b8df-469d-acc7-606b750ae9f8', 'volume_size': 1, 'image_id': '9235ce3f-ddf9-4a61-bdea-82abb46ef92a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9235ce3f-ddf9-4a61-bdea-82abb46ef92a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '293bdb7d472ccc5f27e27ffa2073b4d1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '254b7318b769436e967a671d9b5dd024', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '38b4b4a549020339868fa0a1eb915371eba5b0622fbfbbb5d21a1cb6a208017ddcb24acc1fe409b43ba67ac20d46c772594a3e04d3cb367eb258df8f72954bde', 'id': '9235ce3f-ddf9-4a61-bdea-82abb46ef92a', 'created_at': datetime.datetime(2026, 8, 28, 7, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 7, 44, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9235ce3f-ddf9-4a61-bdea-82abb46ef92a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 28 09:44:03 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Trying to clone 742fc64a-b8df-469d-acc7-606b750ae9f8 from image 9235ce3f-ddf9-4a61-bdea-82abb46ef92a at location (None, [{'url': 'file:///opt/stack/data/glance/images/9235ce3f-ddf9-4a61-bdea-82abb46ef92a', 'metadata': {}}]). {{(pid=86081) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 28 09:44:03 devstack sudo[100666]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ebecfb6f-2433-44e0-9223-6e9d5336d503 1G" returned: 0 in 0.384s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:03 devstack cinder-volume[86081]: DEBUG cinder.volume.volume_utils [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] Downloaded image 4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0 ((None, [{'url': 'file:///opt/stack/data/glance/images/4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'metadata': {}}])) to volume ebecfb6f-2433-44e0-9223-6e9d5336d503 successfully. {{(pid=86081) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 28 09:44:03 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] Temporary image 4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0 for user a75cc7859236419b9b52cb4e732324cf is deleted. {{(pid=86081) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 28 09:44:03 devstack cinder-volume[86081]: DEBUG cinder.volume.volume_utils [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] Marking volume ebecfb6f-2433-44e0-9223-6e9d5336d503 as bootable. {{(pid=86081) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 28 09:44:03 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] Copying metadata from image 4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0 to ebecfb6f-2433-44e0-9223-6e9d5336d503. {{(pid=86081) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 28 09:44:03 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] Creating volume glance metadata for volume ebecfb6f-2433-44e0-9223-6e9d5336d503 backed by image 4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86081) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 28 09:44:03 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9235ce3f-ddf9-4a61-bdea-82abb46ef92a_toqnu2k1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86081) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 28 09:44:03 devstack cinder-volume[86081]: INFO cinder.image.image_utils [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Image download 0.00 MB at 0.00 MB/s Aug 28 09:44:03 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2997d1f-9cda-41a0-8e0f-6b77e4496e91]: (4, 'raw') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:44:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9235ce3f-ddf9-4a61-bdea-82abb46ef92a_toqnu2k1devstack@QuobyteHD {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (059a11e2-338a-4fa6-b419-f691b46bff46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebecfb6f-2433-44e0-9223-6e9d5336d503', 'volume_size': 1, 'image_id': '4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b980c3c37cfa4760ad4846d0fd4baffc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0', 'created_at': datetime.datetime(2026, 8, 28, 7, 25, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 7, 25, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d55e6eb-8ca2-4a40-87cb-4c12f1d299e0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed333e60-4897-4d46-bda9-a9d9e5e9eed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:03 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] Volume volume-ebecfb6f-2433-44e0-9223-6e9d5336d503 (ebecfb6f-2433-44e0-9223-6e9d5336d503): created successfully Aug 28 09:44:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed333e60-4897-4d46-bda9-a9d9e5e9eed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] Flow 'volume_create_manager' (4aef5f26-1a1a-4de2-899a-5572908ae115) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:44:03 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-f8fe381f-62b2-4fae-944e-18aba7a20b30 tempest-VolumesGetTest-692007684 None] Created volume successfully. Aug 28 09:44:03 devstack sudo[100672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9235ce3f-ddf9-4a61-bdea-82abb46ef92a_toqnu2k1devstack@QuobyteHD Aug 28 09:44:03 devstack sudo[100672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:03 devstack sudo[100672]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9235ce3f-ddf9-4a61-bdea-82abb46ef92a_toqnu2k1devstack@QuobyteHD" returned: 0 in 0.361s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9235ce3f-ddf9-4a61-bdea-82abb46ef92a_toqnu2k1devstack@QuobyteHD {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:03 devstack sudo[100676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9235ce3f-ddf9-4a61-bdea-82abb46ef92a_toqnu2k1devstack@QuobyteHD Aug 28 09:44:03 devstack sudo[100676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:04 devstack sudo[100676]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9235ce3f-ddf9-4a61-bdea-82abb46ef92a_toqnu2k1devstack@QuobyteHD" returned: 1 in 0.374s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9235ce3f-ddf9-4a61-bdea-82abb46ef92a_toqnu2k1devstack@QuobyteHD' failed. Not Retrying. {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 09:44:04 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Temporary image 9235ce3f-ddf9-4a61-bdea-82abb46ef92a is fetched for user 38179513f8f8410792a1b27027ed8794. {{(pid=86081) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 28 09:44:04 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbcf0421-b7ca-4c03-97c9-d65fb3b3af79]: (4, 'raw') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:44:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9235ce3f-ddf9-4a61-bdea-82abb46ef92a_toqnu2k1devstack@QuobyteHD {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:04 devstack sudo[100687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9235ce3f-ddf9-4a61-bdea-82abb46ef92a_toqnu2k1devstack@QuobyteHD Aug 28 09:44:04 devstack sudo[100687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:04 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-57b07fce-1dae-473c-8a2d-ea211e4d62ac tempest-AbsoluteLimitsTests-1725170126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:44:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-57b07fce-1dae-473c-8a2d-ea211e4d62ac tempest-AbsoluteLimitsTests-1725170126 None] Flow 'volume_create_manager' (3a1c33b5-065b-4e97-bcec-a2c0202bb607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:44:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-57b07fce-1dae-473c-8a2d-ea211e4d62ac tempest-AbsoluteLimitsTests-1725170126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e857f963-7628-4fe3-8b6d-489d21af61f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-57b07fce-1dae-473c-8a2d-ea211e4d62ac tempest-AbsoluteLimitsTests-1725170126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e857f963-7628-4fe3-8b6d-489d21af61f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:44:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-924219251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f25ddcc-891e-46c6-83b8-fb94e5902983,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98661e3919c24d74b6f4a8db4cd6ded1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:44:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:44:04Z,use_quota=True,user_id='421cb7a5d47c401dac5feec8173fb308',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-57b07fce-1dae-473c-8a2d-ea211e4d62ac tempest-AbsoluteLimitsTests-1725170126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (325b9f0e-14c8-43d5-84d5-fcc0aaf6f402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-57b07fce-1dae-473c-8a2d-ea211e4d62ac tempest-AbsoluteLimitsTests-1725170126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (325b9f0e-14c8-43d5-84d5-fcc0aaf6f402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-57b07fce-1dae-473c-8a2d-ea211e4d62ac tempest-AbsoluteLimitsTests-1725170126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e90eb665-c84a-45cc-95f9-320447ec472b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:04 devstack sudo[100687]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-57b07fce-1dae-473c-8a2d-ea211e4d62ac tempest-AbsoluteLimitsTests-1725170126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e90eb665-c84a-45cc-95f9-320447ec472b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f25ddcc-891e-46c6-83b8-fb94e5902983', 'volume_name': 'volume-4f25ddcc-891e-46c6-83b8-fb94e5902983', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-57b07fce-1dae-473c-8a2d-ea211e4d62ac tempest-AbsoluteLimitsTests-1725170126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b1bec66-bf26-49eb-b180-3ad4bd8b19b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-57b07fce-1dae-473c-8a2d-ea211e4d62ac tempest-AbsoluteLimitsTests-1725170126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b1bec66-bf26-49eb-b180-3ad4bd8b19b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-57b07fce-1dae-473c-8a2d-ea211e4d62ac tempest-AbsoluteLimitsTests-1725170126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (879344f8-15d1-4127-850e-0fdc04197792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:04 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-57b07fce-1dae-473c-8a2d-ea211e4d62ac tempest-AbsoluteLimitsTests-1725170126 None] Volume 4f25ddcc-891e-46c6-83b8-fb94e5902983: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f25ddcc-891e-46c6-83b8-fb94e5902983', 'volume_size': 1} Aug 28 09:44:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-57b07fce-1dae-473c-8a2d-ea211e4d62ac tempest-AbsoluteLimitsTests-1725170126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-57b07fce-1dae-473c-8a2d-ea211e4d62ac tempest-AbsoluteLimitsTests-1725170126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:04 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-57b07fce-1dae-473c-8a2d-ea211e4d62ac tempest-AbsoluteLimitsTests-1725170126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:44:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-924219251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f25ddcc-891e-46c6-83b8-fb94e5902983,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98661e3919c24d74b6f4a8db4cd6ded1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:44:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:44:04Z,use_quota=True,user_id='421cb7a5d47c401dac5feec8173fb308',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:44:04 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-57b07fce-1dae-473c-8a2d-ea211e4d62ac tempest-AbsoluteLimitsTests-1725170126 None] Creating volume 4f25ddcc-891e-46c6-83b8-fb94e5902983 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:44:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-57b07fce-1dae-473c-8a2d-ea211e4d62ac tempest-AbsoluteLimitsTests-1725170126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-57b07fce-1dae-473c-8a2d-ea211e4d62ac tempest-AbsoluteLimitsTests-1725170126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:04 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-57b07fce-1dae-473c-8a2d-ea211e4d62ac tempest-AbsoluteLimitsTests-1725170126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:44:04 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-57b07fce-1dae-473c-8a2d-ea211e4d62ac tempest-AbsoluteLimitsTests-1725170126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:44:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-57b07fce-1dae-473c-8a2d-ea211e4d62ac tempest-AbsoluteLimitsTests-1725170126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:04 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-57b07fce-1dae-473c-8a2d-ea211e4d62ac tempest-AbsoluteLimitsTests-1725170126 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:44:04 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-57b07fce-1dae-473c-8a2d-ea211e4d62ac tempest-AbsoluteLimitsTests-1725170126 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:44:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-57b07fce-1dae-473c-8a2d-ea211e4d62ac tempest-AbsoluteLimitsTests-1725170126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4f25ddcc-891e-46c6-83b8-fb94e5902983 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9235ce3f-ddf9-4a61-bdea-82abb46ef92a_toqnu2k1devstack@QuobyteHD" returned: 0 in 0.467s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9235ce3f-ddf9-4a61-bdea-82abb46ef92a_toqnu2k1devstack@QuobyteHD {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:04 devstack sudo[100693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4f25ddcc-891e-46c6-83b8-fb94e5902983 1073741824 Aug 28 09:44:04 devstack sudo[100693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:04 devstack sudo[100694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9235ce3f-ddf9-4a61-bdea-82abb46ef92a_toqnu2k1devstack@QuobyteHD Aug 28 09:44:04 devstack sudo[100694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:05 devstack sudo[100694]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9235ce3f-ddf9-4a61-bdea-82abb46ef92a_toqnu2k1devstack@QuobyteHD" returned: 1 in 0.591s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9235ce3f-ddf9-4a61-bdea-82abb46ef92a_toqnu2k1devstack@QuobyteHD' failed. Not Retrying. {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 09:44:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:05 devstack sudo[100693]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-57b07fce-1dae-473c-8a2d-ea211e4d62ac tempest-AbsoluteLimitsTests-1725170126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4f25ddcc-891e-46c6-83b8-fb94e5902983 1073741824" returned: 0 in 0.955s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-57b07fce-1dae-473c-8a2d-ea211e4d62ac tempest-AbsoluteLimitsTests-1725170126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4f25ddcc-891e-46c6-83b8-fb94e5902983 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:05 devstack sudo[100728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4f25ddcc-891e-46c6-83b8-fb94e5902983 Aug 28 09:44:05 devstack sudo[100728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:05 devstack sudo[100728]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-57b07fce-1dae-473c-8a2d-ea211e4d62ac tempest-AbsoluteLimitsTests-1725170126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4f25ddcc-891e-46c6-83b8-fb94e5902983" returned: 0 in 0.379s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:05 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-57b07fce-1dae-473c-8a2d-ea211e4d62ac tempest-AbsoluteLimitsTests-1725170126 None] <== create_volume: return (1398ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:44:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-57b07fce-1dae-473c-8a2d-ea211e4d62ac tempest-AbsoluteLimitsTests-1725170126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.401s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.778s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:05 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:44:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=742fc64a-b8df-469d-acc7-606b750ae9f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='254b7318b769436e967a671d9b5dd024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:44:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:44:03Z,use_quota=True,user_id='38179513f8f8410792a1b27027ed8794',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(12a53c4e-499e-4530-91cc-8b212e5eeeb4),volume_type_id=12a53c4e-499e-4530-91cc-8b212e5eeeb4)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:44:05 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Creating volume 742fc64a-b8df-469d-acc7-606b750ae9f8 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:44:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:05 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:44:05 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:44:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:05 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:44:05 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:44:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-742fc64a-b8df-469d-acc7-606b750ae9f8 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:06 devstack sudo[100732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-742fc64a-b8df-469d-acc7-606b750ae9f8 1073741824 Aug 28 09:44:06 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-57b07fce-1dae-473c-8a2d-ea211e4d62ac tempest-AbsoluteLimitsTests-1725170126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (879344f8-15d1-4127-850e-0fdc04197792) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f25ddcc-891e-46c6-83b8-fb94e5902983', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:06 devstack sudo[100732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:06 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-57b07fce-1dae-473c-8a2d-ea211e4d62ac tempest-AbsoluteLimitsTests-1725170126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c8fe315-e0bc-48b2-a85b-fd6e18da282b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:06 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-57b07fce-1dae-473c-8a2d-ea211e4d62ac tempest-AbsoluteLimitsTests-1725170126 None] Volume volume-4f25ddcc-891e-46c6-83b8-fb94e5902983 (4f25ddcc-891e-46c6-83b8-fb94e5902983): created successfully Aug 28 09:44:06 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-57b07fce-1dae-473c-8a2d-ea211e4d62ac tempest-AbsoluteLimitsTests-1725170126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c8fe315-e0bc-48b2-a85b-fd6e18da282b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:06 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-57b07fce-1dae-473c-8a2d-ea211e4d62ac tempest-AbsoluteLimitsTests-1725170126 None] Flow 'volume_create_manager' (3a1c33b5-065b-4e97-bcec-a2c0202bb607) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:44:06 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-57b07fce-1dae-473c-8a2d-ea211e4d62ac tempest-AbsoluteLimitsTests-1725170126 None] Created volume successfully. Aug 28 09:44:06 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-e802e94e-fce1-4d29-8b2e-f6dc951588d6 tempest-VolumesGetTest-692007684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:44:06 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e802e94e-fce1-4d29-8b2e-f6dc951588d6 tempest-VolumesGetTest-692007684 None] Flow 'volume_create_manager' (a60fed06-29e3-4ae9-bb49-171c3366309c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:44:06 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e802e94e-fce1-4d29-8b2e-f6dc951588d6 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5ef56b5-061f-4fd5-a50b-c2d4986e0d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:06 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e802e94e-fce1-4d29-8b2e-f6dc951588d6 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5ef56b5-061f-4fd5-a50b-c2d4986e0d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:44:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1083253493',display_name='tempest-VolumesGetTest-Volume-1225968303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63d4fae3-7da1-4e8a-9179-b1e9cdd6d602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83205def167d4a9db6262cd882759ac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:44:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:44:06Z,use_quota=True,user_id='a75cc7859236419b9b52cb4e732324cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:06 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e802e94e-fce1-4d29-8b2e-f6dc951588d6 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (100e103a-f819-4442-a608-732eb6bfe4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:06 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e802e94e-fce1-4d29-8b2e-f6dc951588d6 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (100e103a-f819-4442-a608-732eb6bfe4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:06 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e802e94e-fce1-4d29-8b2e-f6dc951588d6 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3473b010-3ad6-4ffd-b527-a37df07d49ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:06 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e802e94e-fce1-4d29-8b2e-f6dc951588d6 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3473b010-3ad6-4ffd-b527-a37df07d49ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63d4fae3-7da1-4e8a-9179-b1e9cdd6d602', 'volume_name': 'volume-63d4fae3-7da1-4e8a-9179-b1e9cdd6d602', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:06 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e802e94e-fce1-4d29-8b2e-f6dc951588d6 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (356992cd-41ed-4931-b3e6-6922a4375699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:06 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e802e94e-fce1-4d29-8b2e-f6dc951588d6 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (356992cd-41ed-4931-b3e6-6922a4375699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:06 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e802e94e-fce1-4d29-8b2e-f6dc951588d6 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02c1e9c8-ecd3-410a-aca9-6638d741398d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:06 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-e802e94e-fce1-4d29-8b2e-f6dc951588d6 tempest-VolumesGetTest-692007684 None] Volume 63d4fae3-7da1-4e8a-9179-b1e9cdd6d602: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63d4fae3-7da1-4e8a-9179-b1e9cdd6d602', 'volume_size': 1} Aug 28 09:44:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e802e94e-fce1-4d29-8b2e-f6dc951588d6 tempest-VolumesGetTest-692007684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:06 devstack sudo[100732]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-742fc64a-b8df-469d-acc7-606b750ae9f8 1073741824" returned: 0 in 0.639s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-742fc64a-b8df-469d-acc7-606b750ae9f8 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:06 devstack sudo[100740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-742fc64a-b8df-469d-acc7-606b750ae9f8 Aug 28 09:44:06 devstack sudo[100740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:06 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-f00c6ee4-8150-4c58-a216-e2333f8428a7 tempest-AbsoluteLimitsTests-1725170126 None] Acquiring lock "cinder-4f25ddcc-891e-46c6-83b8-fb94e5902983-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:44:06 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-f00c6ee4-8150-4c58-a216-e2333f8428a7 tempest-AbsoluteLimitsTests-1725170126 None] Lock "cinder-4f25ddcc-891e-46c6-83b8-fb94e5902983-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:44:06 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-f00c6ee4-8150-4c58-a216-e2333f8428a7 tempest-AbsoluteLimitsTests-1725170126 None] Acquiring lock "cinder-quobyte-4f25ddcc-891e-46c6-83b8-fb94e5902983" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:44:06 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-f00c6ee4-8150-4c58-a216-e2333f8428a7 tempest-AbsoluteLimitsTests-1725170126 None] Lock "cinder-quobyte-4f25ddcc-891e-46c6-83b8-fb94e5902983" acquired by "delete_volume" :: waited 0.029s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:44:06 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f184bdd-7993-4944-9bbf-1900eaaf3993]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:44:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f00c6ee4-8150-4c58-a216-e2333f8428a7 tempest-AbsoluteLimitsTests-1725170126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4f25ddcc-891e-46c6-83b8-fb94e5902983 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:07 devstack sudo[100740]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-742fc64a-b8df-469d-acc7-606b750ae9f8" returned: 0 in 0.319s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:07 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:44:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:07 devstack sudo[100742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4f25ddcc-891e-46c6-83b8-fb94e5902983 Aug 28 09:44:07 devstack sudo[100742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e802e94e-fce1-4d29-8b2e-f6dc951588d6 tempest-VolumesGetTest-692007684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.802s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:07 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e802e94e-fce1-4d29-8b2e-f6dc951588d6 tempest-VolumesGetTest-692007684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:44:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1083253493',display_name='tempest-VolumesGetTest-Volume-1225968303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63d4fae3-7da1-4e8a-9179-b1e9cdd6d602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83205def167d4a9db6262cd882759ac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:44:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:44:06Z,use_quota=True,user_id='a75cc7859236419b9b52cb4e732324cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:44:07 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-e802e94e-fce1-4d29-8b2e-f6dc951588d6 tempest-VolumesGetTest-692007684 None] Creating volume 63d4fae3-7da1-4e8a-9179-b1e9cdd6d602 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:44:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e802e94e-fce1-4d29-8b2e-f6dc951588d6 tempest-VolumesGetTest-692007684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e802e94e-fce1-4d29-8b2e-f6dc951588d6 tempest-VolumesGetTest-692007684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:07 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e802e94e-fce1-4d29-8b2e-f6dc951588d6 tempest-VolumesGetTest-692007684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:44:07 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e802e94e-fce1-4d29-8b2e-f6dc951588d6 tempest-VolumesGetTest-692007684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:44:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e802e94e-fce1-4d29-8b2e-f6dc951588d6 tempest-VolumesGetTest-692007684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:07 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e802e94e-fce1-4d29-8b2e-f6dc951588d6 tempest-VolumesGetTest-692007684 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:44:07 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-e802e94e-fce1-4d29-8b2e-f6dc951588d6 tempest-VolumesGetTest-692007684 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:44:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e802e94e-fce1-4d29-8b2e-f6dc951588d6 tempest-VolumesGetTest-692007684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-63d4fae3-7da1-4e8a-9179-b1e9cdd6d602 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:07 devstack cinder-volume[86081]: DEBUG cinder.volume.volume_utils [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Attempting download of 9235ce3f-ddf9-4a61-bdea-82abb46ef92a ((None, [{'url': 'file:///opt/stack/data/glance/images/9235ce3f-ddf9-4a61-bdea-82abb46ef92a', 'metadata': {}}])) to volume 742fc64a-b8df-469d-acc7-606b750ae9f8. {{(pid=86081) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 28 09:44:07 devstack sudo[100745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-63d4fae3-7da1-4e8a-9179-b1e9cdd6d602 1073741824 Aug 28 09:44:07 devstack sudo[100745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:07 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e988ffd-85dd-457f-a504-b19966b04635]: (4, 'raw') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:44:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9235ce3f-ddf9-4a61-bdea-82abb46ef92a_21_vshf_ {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:07 devstack sudo[100747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9235ce3f-ddf9-4a61-bdea-82abb46ef92a_21_vshf_ Aug 28 09:44:07 devstack sudo[100747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:07 devstack sudo[100742]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f00c6ee4-8150-4c58-a216-e2333f8428a7 tempest-AbsoluteLimitsTests-1725170126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4f25ddcc-891e-46c6-83b8-fb94e5902983" returned: 0 in 0.402s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f00c6ee4-8150-4c58-a216-e2333f8428a7 tempest-AbsoluteLimitsTests-1725170126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4f25ddcc-891e-46c6-83b8-fb94e5902983 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:07 devstack sudo[100755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4f25ddcc-891e-46c6-83b8-fb94e5902983 Aug 28 09:44:07 devstack sudo[100755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:07 devstack sudo[100747]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9235ce3f-ddf9-4a61-bdea-82abb46ef92a_21_vshf_" returned: 0 in 0.361s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9235ce3f-ddf9-4a61-bdea-82abb46ef92a_21_vshf_ {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:07 devstack sudo[100745]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e802e94e-fce1-4d29-8b2e-f6dc951588d6 tempest-VolumesGetTest-692007684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-63d4fae3-7da1-4e8a-9179-b1e9cdd6d602 1073741824" returned: 0 in 0.498s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e802e94e-fce1-4d29-8b2e-f6dc951588d6 tempest-VolumesGetTest-692007684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-63d4fae3-7da1-4e8a-9179-b1e9cdd6d602 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:07 devstack sudo[100755]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f00c6ee4-8150-4c58-a216-e2333f8428a7 tempest-AbsoluteLimitsTests-1725170126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4f25ddcc-891e-46c6-83b8-fb94e5902983" returned: 0 in 0.299s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:07 devstack sudo[100763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-63d4fae3-7da1-4e8a-9179-b1e9cdd6d602 Aug 28 09:44:07 devstack sudo[100763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:07 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-f00c6ee4-8150-4c58-a216-e2333f8428a7 tempest-AbsoluteLimitsTests-1725170126 None] Lock "cinder-quobyte-4f25ddcc-891e-46c6-83b8-fb94e5902983" released by "delete_volume" :: held 0.760s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:44:07 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-82ec7296-0340-4452-9e2e-9b9866cda7ed tempest-TestStampPattern-672193429 None] Acquiring lock "cinder-fdaebbe4-a086-4d5a-b030-ad882ad73b9f-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:44:07 devstack sudo[100761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9235ce3f-ddf9-4a61-bdea-82abb46ef92a_21_vshf_ Aug 28 09:44:07 devstack sudo[100761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:07 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-82ec7296-0340-4452-9e2e-9b9866cda7ed tempest-TestStampPattern-672193429 None] Lock "cinder-fdaebbe4-a086-4d5a-b030-ad882ad73b9f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:44:07 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-82ec7296-0340-4452-9e2e-9b9866cda7ed tempest-TestStampPattern-672193429 None] Acquiring lock "cinder-quobyte-fdaebbe4-a086-4d5a-b030-ad882ad73b9f" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:44:07 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-82ec7296-0340-4452-9e2e-9b9866cda7ed tempest-TestStampPattern-672193429 None] Lock "cinder-quobyte-fdaebbe4-a086-4d5a-b030-ad882ad73b9f" acquired by "delete_volume" :: waited 0.020s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:44:07 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-f00c6ee4-8150-4c58-a216-e2333f8428a7 tempest-AbsoluteLimitsTests-1725170126 None] Created reservations ['a2041051-8724-478d-947c-4a2e81d9c7c8', '2eb8134e-61dc-4f73-a9d1-11e489f22793', '71e19d31-237a-40a8-b9ef-0f5914f86f3b', 'bd0a13f4-ddf9-456b-8d75-60c70799da03'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:44:07 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[7adffafc-fc83-41ec-a8f2-840f646b6e8c]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:44:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-82ec7296-0340-4452-9e2e-9b9866cda7ed tempest-TestStampPattern-672193429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f00c6ee4-8150-4c58-a216-e2333f8428a7 tempest-AbsoluteLimitsTests-1725170126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f00c6ee4-8150-4c58-a216-e2333f8428a7 tempest-AbsoluteLimitsTests-1725170126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:07 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-f00c6ee4-8150-4c58-a216-e2333f8428a7 tempest-AbsoluteLimitsTests-1725170126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:44:07 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-f00c6ee4-8150-4c58-a216-e2333f8428a7 tempest-AbsoluteLimitsTests-1725170126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:44:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f00c6ee4-8150-4c58-a216-e2333f8428a7 tempest-AbsoluteLimitsTests-1725170126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f00c6ee4-8150-4c58-a216-e2333f8428a7 tempest-AbsoluteLimitsTests-1725170126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:07 devstack sudo[100768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:44:07 devstack sudo[100768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:07 devstack sudo[100763]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e802e94e-fce1-4d29-8b2e-f6dc951588d6 tempest-VolumesGetTest-692007684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-63d4fae3-7da1-4e8a-9179-b1e9cdd6d602" returned: 0 in 0.378s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:07 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e802e94e-fce1-4d29-8b2e-f6dc951588d6 tempest-VolumesGetTest-692007684 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:44:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e802e94e-fce1-4d29-8b2e-f6dc951588d6 tempest-VolumesGetTest-692007684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:07 devstack sudo[100766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f Aug 28 09:44:07 devstack sudo[100766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:08 devstack sudo[100761]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:08 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e802e94e-fce1-4d29-8b2e-f6dc951588d6 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02c1e9c8-ecd3-410a-aca9-6638d741398d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63d4fae3-7da1-4e8a-9179-b1e9cdd6d602', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:08 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e802e94e-fce1-4d29-8b2e-f6dc951588d6 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (262da34d-b1af-499f-9baf-b1cb4da3753e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9235ce3f-ddf9-4a61-bdea-82abb46ef92a_21_vshf_" returned: 1 in 0.497s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9235ce3f-ddf9-4a61-bdea-82abb46ef92a_21_vshf_' failed. Not Retrying. {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 09:44:08 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[75af62b1-4837-4c50-9eb7-5f321802b993]: (4, 'raw') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:44:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9235ce3f-ddf9-4a61-bdea-82abb46ef92a_toqnu2k1devstack@QuobyteHD {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:08 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-e802e94e-fce1-4d29-8b2e-f6dc951588d6 tempest-VolumesGetTest-692007684 None] Volume volume-63d4fae3-7da1-4e8a-9179-b1e9cdd6d602 (63d4fae3-7da1-4e8a-9179-b1e9cdd6d602): created successfully Aug 28 09:44:08 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e802e94e-fce1-4d29-8b2e-f6dc951588d6 tempest-VolumesGetTest-692007684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (262da34d-b1af-499f-9baf-b1cb4da3753e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:08 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e802e94e-fce1-4d29-8b2e-f6dc951588d6 tempest-VolumesGetTest-692007684 None] Flow 'volume_create_manager' (a60fed06-29e3-4ae9-bb49-171c3366309c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:44:08 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-e802e94e-fce1-4d29-8b2e-f6dc951588d6 tempest-VolumesGetTest-692007684 None] Created volume successfully. Aug 28 09:44:08 devstack sudo[100773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9235ce3f-ddf9-4a61-bdea-82abb46ef92a_toqnu2k1devstack@QuobyteHD Aug 28 09:44:08 devstack sudo[100773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:08 devstack sudo[100768]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f00c6ee4-8150-4c58-a216-e2333f8428a7 tempest-AbsoluteLimitsTests-1725170126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.381s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:08 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-f00c6ee4-8150-4c58-a216-e2333f8428a7 tempest-AbsoluteLimitsTests-1725170126 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:44:08 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-f00c6ee4-8150-4c58-a216-e2333f8428a7 tempest-AbsoluteLimitsTests-1725170126 None] Deleted volume successfully. Aug 28 09:44:08 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-f00c6ee4-8150-4c58-a216-e2333f8428a7 tempest-AbsoluteLimitsTests-1725170126 None] Lock "cinder-4f25ddcc-891e-46c6-83b8-fb94e5902983-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:44:08 devstack sudo[100766]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-82ec7296-0340-4452-9e2e-9b9866cda7ed tempest-TestStampPattern-672193429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f" returned: 0 in 0.592s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-82ec7296-0340-4452-9e2e-9b9866cda7ed tempest-TestStampPattern-672193429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:08 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-0e6cefa5-9ff8-45e4-b355-002065c60398 tempest-VolumesGetTest-692007684 None] Acquiring lock "cinder-63d4fae3-7da1-4e8a-9179-b1e9cdd6d602-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:44:08 devstack sudo[100779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f Aug 28 09:44:08 devstack sudo[100779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:08 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-0e6cefa5-9ff8-45e4-b355-002065c60398 tempest-VolumesGetTest-692007684 None] Lock "cinder-63d4fae3-7da1-4e8a-9179-b1e9cdd6d602-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:44:08 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-0e6cefa5-9ff8-45e4-b355-002065c60398 tempest-VolumesGetTest-692007684 None] Acquiring lock "cinder-quobyte-63d4fae3-7da1-4e8a-9179-b1e9cdd6d602" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:44:08 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-0e6cefa5-9ff8-45e4-b355-002065c60398 tempest-VolumesGetTest-692007684 None] Lock "cinder-quobyte-63d4fae3-7da1-4e8a-9179-b1e9cdd6d602" acquired by "delete_volume" :: waited 0.027s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:44:08 devstack sudo[100773]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9235ce3f-ddf9-4a61-bdea-82abb46ef92a_toqnu2k1devstack@QuobyteHD" returned: 0 in 0.546s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9235ce3f-ddf9-4a61-bdea-82abb46ef92a_toqnu2k1devstack@QuobyteHD {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:08 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3e7a18-b4e2-4c80-b3d0-23a4efb7a468]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:44:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0e6cefa5-9ff8-45e4-b355-002065c60398 tempest-VolumesGetTest-692007684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-63d4fae3-7da1-4e8a-9179-b1e9cdd6d602 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:08 devstack sudo[100783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9235ce3f-ddf9-4a61-bdea-82abb46ef92a_toqnu2k1devstack@QuobyteHD Aug 28 09:44:08 devstack sudo[100783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:08 devstack sudo[100779]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-82ec7296-0340-4452-9e2e-9b9866cda7ed tempest-TestStampPattern-672193429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fdaebbe4-a086-4d5a-b030-ad882ad73b9f" returned: 0 in 0.352s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:08 devstack sudo[100784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-63d4fae3-7da1-4e8a-9179-b1e9cdd6d602 Aug 28 09:44:08 devstack sudo[100784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:08 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-82ec7296-0340-4452-9e2e-9b9866cda7ed tempest-TestStampPattern-672193429 None] Lock "cinder-quobyte-fdaebbe4-a086-4d5a-b030-ad882ad73b9f" released by "delete_volume" :: held 1.032s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:44:08 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-82ec7296-0340-4452-9e2e-9b9866cda7ed tempest-TestStampPattern-672193429 None] Created reservations ['5531f379-0fd0-4bbc-85fe-c68a6766b4c0', '06af0617-3c02-4a33-a53b-4baf5687395d', '063061f1-74d3-4ddf-a629-b45149893407', '103f38ab-d192-4a9f-a471-ad351ef41340'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:44:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-82ec7296-0340-4452-9e2e-9b9866cda7ed tempest-TestStampPattern-672193429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-82ec7296-0340-4452-9e2e-9b9866cda7ed tempest-TestStampPattern-672193429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:08 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-82ec7296-0340-4452-9e2e-9b9866cda7ed tempest-TestStampPattern-672193429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:44:09 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-82ec7296-0340-4452-9e2e-9b9866cda7ed tempest-TestStampPattern-672193429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:44:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-82ec7296-0340-4452-9e2e-9b9866cda7ed tempest-TestStampPattern-672193429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-82ec7296-0340-4452-9e2e-9b9866cda7ed tempest-TestStampPattern-672193429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:09 devstack sudo[100783]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9235ce3f-ddf9-4a61-bdea-82abb46ef92a_toqnu2k1devstack@QuobyteHD" returned: 1 in 0.435s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9235ce3f-ddf9-4a61-bdea-82abb46ef92a_toqnu2k1devstack@QuobyteHD' failed. Not Retrying. {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 09:44:09 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] 9235ce3f-ddf9-4a61-bdea-82abb46ef92a was raw, converting to qcow2 {{(pid=86081) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 28 09:44:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9235ce3f-ddf9-4a61-bdea-82abb46ef92a_toqnu2k1devstack@QuobyteHD /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-742fc64a-b8df-469d-acc7-606b750ae9f8 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:09 devstack sudo[100791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:44:09 devstack sudo[100791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:09 devstack sudo[100792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9235ce3f-ddf9-4a61-bdea-82abb46ef92a_toqnu2k1devstack@QuobyteHD /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-742fc64a-b8df-469d-acc7-606b750ae9f8 Aug 28 09:44:09 devstack sudo[100792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:09 devstack sudo[100784]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0e6cefa5-9ff8-45e4-b355-002065c60398 tempest-VolumesGetTest-692007684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-63d4fae3-7da1-4e8a-9179-b1e9cdd6d602" returned: 0 in 0.556s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0e6cefa5-9ff8-45e4-b355-002065c60398 tempest-VolumesGetTest-692007684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-63d4fae3-7da1-4e8a-9179-b1e9cdd6d602 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:09 devstack sudo[100800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-63d4fae3-7da1-4e8a-9179-b1e9cdd6d602 Aug 28 09:44:09 devstack sudo[100800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:09 devstack sudo[100791]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-82ec7296-0340-4452-9e2e-9b9866cda7ed tempest-TestStampPattern-672193429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.285s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:09 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-82ec7296-0340-4452-9e2e-9b9866cda7ed tempest-TestStampPattern-672193429 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:44:09 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-82ec7296-0340-4452-9e2e-9b9866cda7ed tempest-TestStampPattern-672193429 None] Deleted volume successfully. Aug 28 09:44:09 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-82ec7296-0340-4452-9e2e-9b9866cda7ed tempest-TestStampPattern-672193429 None] Lock "cinder-fdaebbe4-a086-4d5a-b030-ad882ad73b9f-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:44:09 devstack sudo[100800]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0e6cefa5-9ff8-45e4-b355-002065c60398 tempest-VolumesGetTest-692007684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-63d4fae3-7da1-4e8a-9179-b1e9cdd6d602" returned: 0 in 0.339s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:09 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-0e6cefa5-9ff8-45e4-b355-002065c60398 tempest-VolumesGetTest-692007684 None] Lock "cinder-quobyte-63d4fae3-7da1-4e8a-9179-b1e9cdd6d602" released by "delete_volume" :: held 0.961s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:44:09 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-0e6cefa5-9ff8-45e4-b355-002065c60398 tempest-VolumesGetTest-692007684 None] Created reservations ['71467aad-1d07-4e46-b2f2-dc008e94d455', '79f0c5ec-e91e-49cb-af1e-351b7e73ecc1', '87d4aad3-69ca-475e-8be7-ab28937f8bf6', '37dd775d-65ea-4df2-a28b-ff3797ea25d0'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:44:09 devstack sudo[100792]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9235ce3f-ddf9-4a61-bdea-82abb46ef92a_toqnu2k1devstack@QuobyteHD /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-742fc64a-b8df-469d-acc7-606b750ae9f8" returned: 0 in 0.597s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:09 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9235ce3f-ddf9-4a61-bdea-82abb46ef92a_toqnu2k1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-742fc64a-b8df-469d-acc7-606b750ae9f8 {{(pid=86081) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 09:44:09 devstack cinder-volume[86081]: INFO cinder.image.image_utils [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Converted 0.00 MB image at 0.00 MB/s Aug 28 09:44:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-742fc64a-b8df-469d-acc7-606b750ae9f8 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:09 devstack sudo[100808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-742fc64a-b8df-469d-acc7-606b750ae9f8 1G Aug 28 09:44:09 devstack sudo[100808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0e6cefa5-9ff8-45e4-b355-002065c60398 tempest-VolumesGetTest-692007684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0e6cefa5-9ff8-45e4-b355-002065c60398 tempest-VolumesGetTest-692007684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:09 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0e6cefa5-9ff8-45e4-b355-002065c60398 tempest-VolumesGetTest-692007684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:44:09 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0e6cefa5-9ff8-45e4-b355-002065c60398 tempest-VolumesGetTest-692007684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:44:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0e6cefa5-9ff8-45e4-b355-002065c60398 tempest-VolumesGetTest-692007684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0e6cefa5-9ff8-45e4-b355-002065c60398 tempest-VolumesGetTest-692007684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:09 devstack sudo[100810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:44:09 devstack sudo[100810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:09 devstack sudo[100810]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0e6cefa5-9ff8-45e4-b355-002065c60398 tempest-VolumesGetTest-692007684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.287s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:10 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-0e6cefa5-9ff8-45e4-b355-002065c60398 tempest-VolumesGetTest-692007684 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:44:10 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-0e6cefa5-9ff8-45e4-b355-002065c60398 tempest-VolumesGetTest-692007684 None] Deleted volume successfully. Aug 28 09:44:10 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-0e6cefa5-9ff8-45e4-b355-002065c60398 tempest-VolumesGetTest-692007684 None] Lock "cinder-63d4fae3-7da1-4e8a-9179-b1e9cdd6d602-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:44:10 devstack sudo[100808]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-742fc64a-b8df-469d-acc7-606b750ae9f8 1G" returned: 0 in 0.449s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:10 devstack cinder-volume[86081]: DEBUG cinder.volume.volume_utils [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Downloaded image 9235ce3f-ddf9-4a61-bdea-82abb46ef92a ((None, [{'url': 'file:///opt/stack/data/glance/images/9235ce3f-ddf9-4a61-bdea-82abb46ef92a', 'metadata': {}}])) to volume 742fc64a-b8df-469d-acc7-606b750ae9f8 successfully. {{(pid=86081) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 28 09:44:10 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Temporary image 9235ce3f-ddf9-4a61-bdea-82abb46ef92a for user 38179513f8f8410792a1b27027ed8794 is deleted. {{(pid=86081) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 28 09:44:10 devstack cinder-volume[86081]: DEBUG cinder.volume.volume_utils [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Marking volume 742fc64a-b8df-469d-acc7-606b750ae9f8 as bootable. {{(pid=86081) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 28 09:44:10 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Copying metadata from image 9235ce3f-ddf9-4a61-bdea-82abb46ef92a to 742fc64a-b8df-469d-acc7-606b750ae9f8. {{(pid=86081) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 28 09:44:10 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Creating volume glance metadata for volume 742fc64a-b8df-469d-acc7-606b750ae9f8 backed by image 9235ce3f-ddf9-4a61-bdea-82abb46ef92a with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '9235ce3f-ddf9-4a61-bdea-82abb46ef92a', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '293bdb7d472ccc5f27e27ffa2073b4d1', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86081) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 28 09:44:10 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e948adb9-51ea-46f0-b860-9774371cad7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-742fc64a-b8df-469d-acc7-606b750ae9f8', 'volume_size': 1, 'image_id': '9235ce3f-ddf9-4a61-bdea-82abb46ef92a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9235ce3f-ddf9-4a61-bdea-82abb46ef92a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '293bdb7d472ccc5f27e27ffa2073b4d1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '254b7318b769436e967a671d9b5dd024', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '38b4b4a549020339868fa0a1eb915371eba5b0622fbfbbb5d21a1cb6a208017ddcb24acc1fe409b43ba67ac20d46c772594a3e04d3cb367eb258df8f72954bde', 'id': '9235ce3f-ddf9-4a61-bdea-82abb46ef92a', 'created_at': datetime.datetime(2026, 8, 28, 7, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 7, 44, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9235ce3f-ddf9-4a61-bdea-82abb46ef92a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:10 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1f99837-e629-4f2b-a0ff-ad14b91c2dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:10 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Volume volume-742fc64a-b8df-469d-acc7-606b750ae9f8 (742fc64a-b8df-469d-acc7-606b750ae9f8): created successfully Aug 28 09:44:10 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1f99837-e629-4f2b-a0ff-ad14b91c2dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:10 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Flow 'volume_create_manager' (c5976a8a-42d3-4d31-bcbb-df3a9e7ba12b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:44:10 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-9e1a5496-a9f2-489c-8b84-025b3581f3e8 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Created volume successfully. Aug 28 09:44:10 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2d50819d-9255-41d4-93fd-7f82734f1340 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Acquiring lock "cinder-742fc64a-b8df-469d-acc7-606b750ae9f8-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:44:10 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2d50819d-9255-41d4-93fd-7f82734f1340 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Lock "cinder-742fc64a-b8df-469d-acc7-606b750ae9f8-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:44:10 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2d50819d-9255-41d4-93fd-7f82734f1340 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Acquiring lock "cinder-quobyte-742fc64a-b8df-469d-acc7-606b750ae9f8" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:44:10 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2d50819d-9255-41d4-93fd-7f82734f1340 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Lock "cinder-quobyte-742fc64a-b8df-469d-acc7-606b750ae9f8" acquired by "delete_volume" :: waited 0.028s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:44:10 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48547a2-9ac9-48fd-a825-9f184b126cc8]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:44:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2d50819d-9255-41d4-93fd-7f82734f1340 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-742fc64a-b8df-469d-acc7-606b750ae9f8 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:10 devstack sudo[100816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-742fc64a-b8df-469d-acc7-606b750ae9f8 Aug 28 09:44:10 devstack sudo[100816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:10 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2a41678a-343b-4b21-a807-89759299204e tempest-VolumesGetTest-692007684 None] Acquiring lock "cinder-ebecfb6f-2433-44e0-9223-6e9d5336d503-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:44:10 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2a41678a-343b-4b21-a807-89759299204e tempest-VolumesGetTest-692007684 None] Lock "cinder-ebecfb6f-2433-44e0-9223-6e9d5336d503-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:44:11 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2a41678a-343b-4b21-a807-89759299204e tempest-VolumesGetTest-692007684 None] Acquiring lock "cinder-quobyte-ebecfb6f-2433-44e0-9223-6e9d5336d503" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:44:11 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2a41678a-343b-4b21-a807-89759299204e tempest-VolumesGetTest-692007684 None] Lock "cinder-quobyte-ebecfb6f-2433-44e0-9223-6e9d5336d503" acquired by "delete_volume" :: waited 0.015s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:44:11 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a243e9-18e2-4bab-a763-b71ef59d5516]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:44:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2a41678a-343b-4b21-a807-89759299204e tempest-VolumesGetTest-692007684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ebecfb6f-2433-44e0-9223-6e9d5336d503 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:11 devstack sudo[100816]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2d50819d-9255-41d4-93fd-7f82734f1340 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-742fc64a-b8df-469d-acc7-606b750ae9f8" returned: 0 in 0.488s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2d50819d-9255-41d4-93fd-7f82734f1340 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-742fc64a-b8df-469d-acc7-606b750ae9f8 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:11 devstack sudo[100822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-742fc64a-b8df-469d-acc7-606b750ae9f8 Aug 28 09:44:11 devstack sudo[100822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:11 devstack sudo[100821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ebecfb6f-2433-44e0-9223-6e9d5336d503 Aug 28 09:44:11 devstack sudo[100821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:11 devstack sudo[100822]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2d50819d-9255-41d4-93fd-7f82734f1340 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-742fc64a-b8df-469d-acc7-606b750ae9f8" returned: 0 in 0.376s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:11 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2d50819d-9255-41d4-93fd-7f82734f1340 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Lock "cinder-quobyte-742fc64a-b8df-469d-acc7-606b750ae9f8" released by "delete_volume" :: held 0.933s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:44:11 devstack sudo[100821]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2a41678a-343b-4b21-a807-89759299204e tempest-VolumesGetTest-692007684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ebecfb6f-2433-44e0-9223-6e9d5336d503" returned: 0 in 0.524s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2a41678a-343b-4b21-a807-89759299204e tempest-VolumesGetTest-692007684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ebecfb6f-2433-44e0-9223-6e9d5336d503 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:11 devstack cinder-volume[86081]: WARNING cinder.quota [None req-2d50819d-9255-41d4-93fd-7f82734f1340 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 28 09:44:11 devstack cinder-volume[86081]: WARNING cinder.quota [None req-2d50819d-9255-41d4-93fd-7f82734f1340 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 28 09:44:11 devstack sudo[100863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ebecfb6f-2433-44e0-9223-6e9d5336d503 Aug 28 09:44:11 devstack sudo[100863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:11 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-2d50819d-9255-41d4-93fd-7f82734f1340 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Created reservations ['581ad8c9-503c-4ddf-b884-dddb6fef612b', '14088d7d-1343-4a30-bf59-cc02d83ca41d', '300375ec-852f-4f5c-9d0c-3b8c7d135999', 'f695d8e8-a3db-4357-b24c-6fa1ef40e566'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:44:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-2d50819d-9255-41d4-93fd-7f82734f1340 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-2d50819d-9255-41d4-93fd-7f82734f1340 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:11 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-2d50819d-9255-41d4-93fd-7f82734f1340 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:44:11 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-2d50819d-9255-41d4-93fd-7f82734f1340 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:44:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-2d50819d-9255-41d4-93fd-7f82734f1340 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2d50819d-9255-41d4-93fd-7f82734f1340 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:11 devstack sudo[100865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:44:11 devstack sudo[100865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:12 devstack sudo[100863]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2a41678a-343b-4b21-a807-89759299204e tempest-VolumesGetTest-692007684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ebecfb6f-2433-44e0-9223-6e9d5336d503" returned: 0 in 0.466s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:12 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2a41678a-343b-4b21-a807-89759299204e tempest-VolumesGetTest-692007684 None] Lock "cinder-quobyte-ebecfb6f-2433-44e0-9223-6e9d5336d503" released by "delete_volume" :: held 1.048s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:44:12 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-2a41678a-343b-4b21-a807-89759299204e tempest-VolumesGetTest-692007684 None] Created reservations ['22671fbc-dc35-4e4b-838f-f8c8694740df', '1140c6ab-319f-4fab-b258-48731919455c', 'd38ee257-b5b4-4b59-a24d-acca8dd0080f', 'c095e528-2529-445d-b5aa-d0607647fe0a'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:44:12 devstack sudo[100865]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2d50819d-9255-41d4-93fd-7f82734f1340 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.409s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:12 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-2d50819d-9255-41d4-93fd-7f82734f1340 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:44:12 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-2d50819d-9255-41d4-93fd-7f82734f1340 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Deleted volume successfully. Aug 28 09:44:12 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2d50819d-9255-41d4-93fd-7f82734f1340 tempest-VolumeAndVolumeTypeFromImageTest-1675431308 None] Lock "cinder-742fc64a-b8df-469d-acc7-606b750ae9f8-delete_volume" released by "delete_volume" :: held 1.801s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:44:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-2a41678a-343b-4b21-a807-89759299204e tempest-VolumesGetTest-692007684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-2a41678a-343b-4b21-a807-89759299204e tempest-VolumesGetTest-692007684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:12 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-2a41678a-343b-4b21-a807-89759299204e tempest-VolumesGetTest-692007684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:44:12 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-2a41678a-343b-4b21-a807-89759299204e tempest-VolumesGetTest-692007684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:44:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-2a41678a-343b-4b21-a807-89759299204e tempest-VolumesGetTest-692007684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2a41678a-343b-4b21-a807-89759299204e tempest-VolumesGetTest-692007684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:12 devstack sudo[100871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:44:12 devstack sudo[100871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:12 devstack sudo[100871]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2a41678a-343b-4b21-a807-89759299204e tempest-VolumesGetTest-692007684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.275s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:12 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-2a41678a-343b-4b21-a807-89759299204e tempest-VolumesGetTest-692007684 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:44:12 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-2a41678a-343b-4b21-a807-89759299204e tempest-VolumesGetTest-692007684 None] Deleted volume successfully. Aug 28 09:44:12 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2a41678a-343b-4b21-a807-89759299204e tempest-VolumesGetTest-692007684 None] Lock "cinder-ebecfb6f-2433-44e0-9223-6e9d5336d503-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:44:15 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-08b84dfc-339c-4e26-9ce1-656eb63037b0 tempest-VolumesTransfersTest-592287831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:44:15 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-08b84dfc-339c-4e26-9ce1-656eb63037b0 tempest-VolumesTransfersTest-592287831 None] Flow 'volume_create_manager' (2b6b8362-1842-4351-b5ae-b14b0db2b016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:44:15 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-08b84dfc-339c-4e26-9ce1-656eb63037b0 tempest-VolumesTransfersTest-592287831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2c6ce68-6a96-487f-8eeb-5e83122b2b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:15 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-08b84dfc-339c-4e26-9ce1-656eb63037b0 tempest-VolumesTransfersTest-592287831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2c6ce68-6a96-487f-8eeb-5e83122b2b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:44:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-198603134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=480c6d45-5c66-4a7d-89ab-d03a4b0fa001,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cb8db0490284ab783203e852d578e75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:44:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:44:16Z,use_quota=True,user_id='2b49931e9cd7415fafbcac6610ab694a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:15 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-08b84dfc-339c-4e26-9ce1-656eb63037b0 tempest-VolumesTransfersTest-592287831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb322de6-abe1-49af-ab80-3392b70db2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:16 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-08b84dfc-339c-4e26-9ce1-656eb63037b0 tempest-VolumesTransfersTest-592287831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb322de6-abe1-49af-ab80-3392b70db2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:16 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-08b84dfc-339c-4e26-9ce1-656eb63037b0 tempest-VolumesTransfersTest-592287831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29b95c7e-6eb1-43f4-8697-0475442399ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:16 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-08b84dfc-339c-4e26-9ce1-656eb63037b0 tempest-VolumesTransfersTest-592287831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29b95c7e-6eb1-43f4-8697-0475442399ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '480c6d45-5c66-4a7d-89ab-d03a4b0fa001', 'volume_name': 'volume-480c6d45-5c66-4a7d-89ab-d03a4b0fa001', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:16 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-08b84dfc-339c-4e26-9ce1-656eb63037b0 tempest-VolumesTransfersTest-592287831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e19a3c5-f4f8-451b-8c18-a2c89b17dab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:16 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-08b84dfc-339c-4e26-9ce1-656eb63037b0 tempest-VolumesTransfersTest-592287831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e19a3c5-f4f8-451b-8c18-a2c89b17dab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:16 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-08b84dfc-339c-4e26-9ce1-656eb63037b0 tempest-VolumesTransfersTest-592287831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d5a8f92-b2c7-44d4-b72b-08222e501fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:16 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-08b84dfc-339c-4e26-9ce1-656eb63037b0 tempest-VolumesTransfersTest-592287831 None] Volume 480c6d45-5c66-4a7d-89ab-d03a4b0fa001: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-480c6d45-5c66-4a7d-89ab-d03a4b0fa001', 'volume_size': 1} Aug 28 09:44:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-08b84dfc-339c-4e26-9ce1-656eb63037b0 tempest-VolumesTransfersTest-592287831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-08b84dfc-339c-4e26-9ce1-656eb63037b0 tempest-VolumesTransfersTest-592287831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:16 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-08b84dfc-339c-4e26-9ce1-656eb63037b0 tempest-VolumesTransfersTest-592287831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:44:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-198603134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=480c6d45-5c66-4a7d-89ab-d03a4b0fa001,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cb8db0490284ab783203e852d578e75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:44:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:44:16Z,use_quota=True,user_id='2b49931e9cd7415fafbcac6610ab694a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:44:16 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-08b84dfc-339c-4e26-9ce1-656eb63037b0 tempest-VolumesTransfersTest-592287831 None] Creating volume 480c6d45-5c66-4a7d-89ab-d03a4b0fa001 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:44:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-08b84dfc-339c-4e26-9ce1-656eb63037b0 tempest-VolumesTransfersTest-592287831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-08b84dfc-339c-4e26-9ce1-656eb63037b0 tempest-VolumesTransfersTest-592287831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:16 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-08b84dfc-339c-4e26-9ce1-656eb63037b0 tempest-VolumesTransfersTest-592287831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:44:16 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-08b84dfc-339c-4e26-9ce1-656eb63037b0 tempest-VolumesTransfersTest-592287831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:44:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-08b84dfc-339c-4e26-9ce1-656eb63037b0 tempest-VolumesTransfersTest-592287831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:16 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-08b84dfc-339c-4e26-9ce1-656eb63037b0 tempest-VolumesTransfersTest-592287831 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:44:16 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-08b84dfc-339c-4e26-9ce1-656eb63037b0 tempest-VolumesTransfersTest-592287831 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:44:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-08b84dfc-339c-4e26-9ce1-656eb63037b0 tempest-VolumesTransfersTest-592287831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-480c6d45-5c66-4a7d-89ab-d03a4b0fa001 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:16 devstack sudo[100875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-480c6d45-5c66-4a7d-89ab-d03a4b0fa001 1073741824 Aug 28 09:44:16 devstack sudo[100875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:16 devstack sudo[100875]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-08b84dfc-339c-4e26-9ce1-656eb63037b0 tempest-VolumesTransfersTest-592287831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-480c6d45-5c66-4a7d-89ab-d03a4b0fa001 1073741824" returned: 0 in 0.654s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-08b84dfc-339c-4e26-9ce1-656eb63037b0 tempest-VolumesTransfersTest-592287831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-480c6d45-5c66-4a7d-89ab-d03a4b0fa001 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:16 devstack sudo[100883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-480c6d45-5c66-4a7d-89ab-d03a4b0fa001 Aug 28 09:44:16 devstack sudo[100883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:17 devstack sudo[100883]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-08b84dfc-339c-4e26-9ce1-656eb63037b0 tempest-VolumesTransfersTest-592287831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-480c6d45-5c66-4a7d-89ab-d03a4b0fa001" returned: 0 in 0.274s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:17 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-08b84dfc-339c-4e26-9ce1-656eb63037b0 tempest-VolumesTransfersTest-592287831 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:44:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-08b84dfc-339c-4e26-9ce1-656eb63037b0 tempest-VolumesTransfersTest-592287831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:17 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-08b84dfc-339c-4e26-9ce1-656eb63037b0 tempest-VolumesTransfersTest-592287831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d5a8f92-b2c7-44d4-b72b-08222e501fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-480c6d45-5c66-4a7d-89ab-d03a4b0fa001', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:17 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-08b84dfc-339c-4e26-9ce1-656eb63037b0 tempest-VolumesTransfersTest-592287831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f6a0566-b4c1-4314-bdbc-08a7bddd3a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:17 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-08b84dfc-339c-4e26-9ce1-656eb63037b0 tempest-VolumesTransfersTest-592287831 None] Volume volume-480c6d45-5c66-4a7d-89ab-d03a4b0fa001 (480c6d45-5c66-4a7d-89ab-d03a4b0fa001): created successfully Aug 28 09:44:17 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-08b84dfc-339c-4e26-9ce1-656eb63037b0 tempest-VolumesTransfersTest-592287831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f6a0566-b4c1-4314-bdbc-08a7bddd3a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:17 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-08b84dfc-339c-4e26-9ce1-656eb63037b0 tempest-VolumesTransfersTest-592287831 None] Flow 'volume_create_manager' (2b6b8362-1842-4351-b5ae-b14b0db2b016) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:44:17 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-08b84dfc-339c-4e26-9ce1-656eb63037b0 tempest-VolumesTransfersTest-592287831 None] Created volume successfully. Aug 28 09:44:18 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-2d6022ed-382f-407f-8030-b1d48bdc7dcc tempest-VolumesTransfersTest-541518235 None] Transfer volume completed successfully. Aug 28 09:44:19 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-7bcf7a7b-3765-4833-b7de-06f211c83ab0 tempest-VolumesTransfersTest-1384395675 None] Acquiring lock "cinder-480c6d45-5c66-4a7d-89ab-d03a4b0fa001-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:44:19 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-7bcf7a7b-3765-4833-b7de-06f211c83ab0 tempest-VolumesTransfersTest-1384395675 None] Lock "cinder-480c6d45-5c66-4a7d-89ab-d03a4b0fa001-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:44:19 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-7bcf7a7b-3765-4833-b7de-06f211c83ab0 tempest-VolumesTransfersTest-1384395675 None] Acquiring lock "cinder-quobyte-480c6d45-5c66-4a7d-89ab-d03a4b0fa001" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:44:19 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-7bcf7a7b-3765-4833-b7de-06f211c83ab0 tempest-VolumesTransfersTest-1384395675 None] Lock "cinder-quobyte-480c6d45-5c66-4a7d-89ab-d03a4b0fa001" acquired by "delete_volume" :: waited 0.017s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:44:19 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3fe0dc-9d44-4502-84a6-f907e01104a7]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:44:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7bcf7a7b-3765-4833-b7de-06f211c83ab0 tempest-VolumesTransfersTest-1384395675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-480c6d45-5c66-4a7d-89ab-d03a4b0fa001 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:20 devstack sudo[100890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-480c6d45-5c66-4a7d-89ab-d03a4b0fa001 Aug 28 09:44:20 devstack sudo[100890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:20 devstack sudo[100890]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7bcf7a7b-3765-4833-b7de-06f211c83ab0 tempest-VolumesTransfersTest-1384395675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-480c6d45-5c66-4a7d-89ab-d03a4b0fa001" returned: 0 in 0.503s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7bcf7a7b-3765-4833-b7de-06f211c83ab0 tempest-VolumesTransfersTest-1384395675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-480c6d45-5c66-4a7d-89ab-d03a4b0fa001 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:20 devstack sudo[100895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-480c6d45-5c66-4a7d-89ab-d03a4b0fa001 Aug 28 09:44:20 devstack sudo[100895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:20 devstack sudo[100895]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7bcf7a7b-3765-4833-b7de-06f211c83ab0 tempest-VolumesTransfersTest-1384395675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-480c6d45-5c66-4a7d-89ab-d03a4b0fa001" returned: 0 in 0.367s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:20 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-7bcf7a7b-3765-4833-b7de-06f211c83ab0 tempest-VolumesTransfersTest-1384395675 None] Lock "cinder-quobyte-480c6d45-5c66-4a7d-89ab-d03a4b0fa001" released by "delete_volume" :: held 0.942s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:44:20 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-cac30ad2-1ce2-46b7-8c1f-bbc49e974a88 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:44:20 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-cac30ad2-1ce2-46b7-8c1f-bbc49e974a88 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Flow 'volume_create_manager' (2a686092-0698-4f66-8737-1f86217b04b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:44:20 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-cac30ad2-1ce2-46b7-8c1f-bbc49e974a88 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcc3aea2-e3cd-46ea-903e-f33e6f464736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:20 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-cac30ad2-1ce2-46b7-8c1f-bbc49e974a88 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcc3aea2-e3cd-46ea-903e-f33e6f464736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:44:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-795172107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a104067-ee68-418b-a455-bd97674e4f7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22686c85866b45288b7094eb71842c0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:44:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:44:21Z,use_quota=True,user_id='9d4d9d8070eb489e90ea9e839df57ab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:21 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-cac30ad2-1ce2-46b7-8c1f-bbc49e974a88 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90e02e1d-0e85-4d4e-9163-aa46f1f75bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:21 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-cac30ad2-1ce2-46b7-8c1f-bbc49e974a88 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90e02e1d-0e85-4d4e-9163-aa46f1f75bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:21 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-cac30ad2-1ce2-46b7-8c1f-bbc49e974a88 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fed59611-751c-4f91-abcd-20be460171a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:21 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-cac30ad2-1ce2-46b7-8c1f-bbc49e974a88 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fed59611-751c-4f91-abcd-20be460171a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a104067-ee68-418b-a455-bd97674e4f7d', 'volume_name': 'volume-8a104067-ee68-418b-a455-bd97674e4f7d', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:21 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-cac30ad2-1ce2-46b7-8c1f-bbc49e974a88 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e8d3440-8e05-4ffe-93a2-b3a665977864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:21 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-cac30ad2-1ce2-46b7-8c1f-bbc49e974a88 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e8d3440-8e05-4ffe-93a2-b3a665977864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:21 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-cac30ad2-1ce2-46b7-8c1f-bbc49e974a88 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa3658ee-2684-45c7-9c9e-1b29f201561f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:21 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-cac30ad2-1ce2-46b7-8c1f-bbc49e974a88 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Volume 8a104067-ee68-418b-a455-bd97674e4f7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a104067-ee68-418b-a455-bd97674e4f7d', 'volume_size': 1} Aug 28 09:44:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-cac30ad2-1ce2-46b7-8c1f-bbc49e974a88 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-cac30ad2-1ce2-46b7-8c1f-bbc49e974a88 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:21 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-cac30ad2-1ce2-46b7-8c1f-bbc49e974a88 tempest-CreateVolumesFromSnapshotTest-1214825562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:44:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-795172107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a104067-ee68-418b-a455-bd97674e4f7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22686c85866b45288b7094eb71842c0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:44:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:44:21Z,use_quota=True,user_id='9d4d9d8070eb489e90ea9e839df57ab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:44:21 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-cac30ad2-1ce2-46b7-8c1f-bbc49e974a88 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Creating volume 8a104067-ee68-418b-a455-bd97674e4f7d {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:44:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-cac30ad2-1ce2-46b7-8c1f-bbc49e974a88 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-cac30ad2-1ce2-46b7-8c1f-bbc49e974a88 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:21 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-cac30ad2-1ce2-46b7-8c1f-bbc49e974a88 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:44:21 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-cac30ad2-1ce2-46b7-8c1f-bbc49e974a88 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:44:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-cac30ad2-1ce2-46b7-8c1f-bbc49e974a88 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:21 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-cac30ad2-1ce2-46b7-8c1f-bbc49e974a88 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:44:21 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-cac30ad2-1ce2-46b7-8c1f-bbc49e974a88 tempest-CreateVolumesFromSnapshotTest-1214825562 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:44:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-cac30ad2-1ce2-46b7-8c1f-bbc49e974a88 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8a104067-ee68-418b-a455-bd97674e4f7d 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:21 devstack sudo[100898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8a104067-ee68-418b-a455-bd97674e4f7d 1073741824 Aug 28 09:44:21 devstack sudo[100898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:21 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-7bcf7a7b-3765-4833-b7de-06f211c83ab0 tempest-VolumesTransfersTest-1384395675 None] Created reservations ['7ea9c4a6-6421-48f6-b7b1-7e44a7488f7b', '1dc98605-dbc4-487f-88f6-f9458f5467b6', 'd2898f64-a828-4a16-8411-2cff03bced5b', 'ac9ec5c2-3d67-48dd-a236-bfd1942c00c3'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:44:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-7bcf7a7b-3765-4833-b7de-06f211c83ab0 tempest-VolumesTransfersTest-1384395675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-7bcf7a7b-3765-4833-b7de-06f211c83ab0 tempest-VolumesTransfersTest-1384395675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:21 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-7bcf7a7b-3765-4833-b7de-06f211c83ab0 tempest-VolumesTransfersTest-1384395675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:44:21 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-7bcf7a7b-3765-4833-b7de-06f211c83ab0 tempest-VolumesTransfersTest-1384395675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:44:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-7bcf7a7b-3765-4833-b7de-06f211c83ab0 tempest-VolumesTransfersTest-1384395675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7bcf7a7b-3765-4833-b7de-06f211c83ab0 tempest-VolumesTransfersTest-1384395675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:21 devstack sudo[100900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:44:21 devstack sudo[100900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:21 devstack sudo[100900]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7bcf7a7b-3765-4833-b7de-06f211c83ab0 tempest-VolumesTransfersTest-1384395675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.281s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:21 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-7bcf7a7b-3765-4833-b7de-06f211c83ab0 tempest-VolumesTransfersTest-1384395675 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:44:21 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-7bcf7a7b-3765-4833-b7de-06f211c83ab0 tempest-VolumesTransfersTest-1384395675 None] Deleted volume successfully. Aug 28 09:44:21 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-7bcf7a7b-3765-4833-b7de-06f211c83ab0 tempest-VolumesTransfersTest-1384395675 None] Lock "cinder-480c6d45-5c66-4a7d-89ab-d03a4b0fa001-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:44:21 devstack sudo[100898]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-cac30ad2-1ce2-46b7-8c1f-bbc49e974a88 tempest-CreateVolumesFromSnapshotTest-1214825562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8a104067-ee68-418b-a455-bd97674e4f7d 1073741824" returned: 0 in 0.684s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-cac30ad2-1ce2-46b7-8c1f-bbc49e974a88 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8a104067-ee68-418b-a455-bd97674e4f7d {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:21 devstack sudo[100906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8a104067-ee68-418b-a455-bd97674e4f7d Aug 28 09:44:21 devstack sudo[100906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:22 devstack sudo[100906]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-cac30ad2-1ce2-46b7-8c1f-bbc49e974a88 tempest-CreateVolumesFromSnapshotTest-1214825562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8a104067-ee68-418b-a455-bd97674e4f7d" returned: 0 in 0.281s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:22 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-cac30ad2-1ce2-46b7-8c1f-bbc49e974a88 tempest-CreateVolumesFromSnapshotTest-1214825562 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:44:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-cac30ad2-1ce2-46b7-8c1f-bbc49e974a88 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-cac30ad2-1ce2-46b7-8c1f-bbc49e974a88 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa3658ee-2684-45c7-9c9e-1b29f201561f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a104067-ee68-418b-a455-bd97674e4f7d', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-cac30ad2-1ce2-46b7-8c1f-bbc49e974a88 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9d46b9c-d523-4d21-9b0e-558fb6242367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:22 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-cac30ad2-1ce2-46b7-8c1f-bbc49e974a88 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Volume volume-8a104067-ee68-418b-a455-bd97674e4f7d (8a104067-ee68-418b-a455-bd97674e4f7d): created successfully Aug 28 09:44:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-cac30ad2-1ce2-46b7-8c1f-bbc49e974a88 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9d46b9c-d523-4d21-9b0e-558fb6242367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-cac30ad2-1ce2-46b7-8c1f-bbc49e974a88 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Flow 'volume_create_manager' (2a686092-0698-4f66-8737-1f86217b04b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:44:22 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-cac30ad2-1ce2-46b7-8c1f-bbc49e974a88 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Created volume successfully. Aug 28 09:44:22 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-865c1906-7e10-4bac-83bd-04215c8c84df tempest-VolumesTransfersTest-592287831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:44:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-865c1906-7e10-4bac-83bd-04215c8c84df tempest-VolumesTransfersTest-592287831 None] Flow 'volume_create_manager' (6b66c63c-a736-47c8-9183-405d58b8b9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:44:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-865c1906-7e10-4bac-83bd-04215c8c84df tempest-VolumesTransfersTest-592287831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbe28d36-4765-4f3f-81b8-605716f6f49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-865c1906-7e10-4bac-83bd-04215c8c84df tempest-VolumesTransfersTest-592287831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbe28d36-4765-4f3f-81b8-605716f6f49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:44:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-276413869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4ef7f10-dc0b-4128-9ec9-06df9d720d53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cb8db0490284ab783203e852d578e75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:44:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:44:23Z,use_quota=True,user_id='2b49931e9cd7415fafbcac6610ab694a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-865c1906-7e10-4bac-83bd-04215c8c84df tempest-VolumesTransfersTest-592287831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78e8a4a3-4f76-4c17-9c3a-a34356f7a99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-865c1906-7e10-4bac-83bd-04215c8c84df tempest-VolumesTransfersTest-592287831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78e8a4a3-4f76-4c17-9c3a-a34356f7a99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-865c1906-7e10-4bac-83bd-04215c8c84df tempest-VolumesTransfersTest-592287831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bf3609e-dff5-4686-945f-4e4bdf070b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-865c1906-7e10-4bac-83bd-04215c8c84df tempest-VolumesTransfersTest-592287831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bf3609e-dff5-4686-945f-4e4bdf070b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4ef7f10-dc0b-4128-9ec9-06df9d720d53', 'volume_name': 'volume-b4ef7f10-dc0b-4128-9ec9-06df9d720d53', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-865c1906-7e10-4bac-83bd-04215c8c84df tempest-VolumesTransfersTest-592287831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46afdb21-9416-49a7-952d-10878514d32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-865c1906-7e10-4bac-83bd-04215c8c84df tempest-VolumesTransfersTest-592287831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46afdb21-9416-49a7-952d-10878514d32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-865c1906-7e10-4bac-83bd-04215c8c84df tempest-VolumesTransfersTest-592287831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8120441d-dfba-4aae-b4fd-cbb428bf52dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:22 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-865c1906-7e10-4bac-83bd-04215c8c84df tempest-VolumesTransfersTest-592287831 None] Volume b4ef7f10-dc0b-4128-9ec9-06df9d720d53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4ef7f10-dc0b-4128-9ec9-06df9d720d53', 'volume_size': 1} Aug 28 09:44:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-865c1906-7e10-4bac-83bd-04215c8c84df tempest-VolumesTransfersTest-592287831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-865c1906-7e10-4bac-83bd-04215c8c84df tempest-VolumesTransfersTest-592287831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:22 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-865c1906-7e10-4bac-83bd-04215c8c84df tempest-VolumesTransfersTest-592287831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:44:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-276413869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4ef7f10-dc0b-4128-9ec9-06df9d720d53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cb8db0490284ab783203e852d578e75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:44:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:44:23Z,use_quota=True,user_id='2b49931e9cd7415fafbcac6610ab694a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:44:22 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-865c1906-7e10-4bac-83bd-04215c8c84df tempest-VolumesTransfersTest-592287831 None] Creating volume b4ef7f10-dc0b-4128-9ec9-06df9d720d53 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:44:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-865c1906-7e10-4bac-83bd-04215c8c84df tempest-VolumesTransfersTest-592287831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-865c1906-7e10-4bac-83bd-04215c8c84df tempest-VolumesTransfersTest-592287831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:22 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-865c1906-7e10-4bac-83bd-04215c8c84df tempest-VolumesTransfersTest-592287831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:44:22 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-865c1906-7e10-4bac-83bd-04215c8c84df tempest-VolumesTransfersTest-592287831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:44:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-865c1906-7e10-4bac-83bd-04215c8c84df tempest-VolumesTransfersTest-592287831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:22 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-865c1906-7e10-4bac-83bd-04215c8c84df tempest-VolumesTransfersTest-592287831 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:44:22 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-865c1906-7e10-4bac-83bd-04215c8c84df tempest-VolumesTransfersTest-592287831 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:44:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-865c1906-7e10-4bac-83bd-04215c8c84df tempest-VolumesTransfersTest-592287831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b4ef7f10-dc0b-4128-9ec9-06df9d720d53 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:22 devstack sudo[100910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b4ef7f10-dc0b-4128-9ec9-06df9d720d53 1073741824 Aug 28 09:44:22 devstack sudo[100910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ab48ac8b-95e3-4431-9e36-e47afa89ace4 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:23 devstack sudo[100910]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-865c1906-7e10-4bac-83bd-04215c8c84df tempest-VolumesTransfersTest-592287831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b4ef7f10-dc0b-4128-9ec9-06df9d720d53 1073741824" returned: 0 in 0.627s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-865c1906-7e10-4bac-83bd-04215c8c84df tempest-VolumesTransfersTest-592287831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b4ef7f10-dc0b-4128-9ec9-06df9d720d53 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:23 devstack sudo[100916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b4ef7f10-dc0b-4128-9ec9-06df9d720d53 Aug 28 09:44:23 devstack sudo[100916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:23 devstack sudo[100916]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-865c1906-7e10-4bac-83bd-04215c8c84df tempest-VolumesTransfersTest-592287831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b4ef7f10-dc0b-4128-9ec9-06df9d720d53" returned: 0 in 0.296s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:23 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-865c1906-7e10-4bac-83bd-04215c8c84df tempest-VolumesTransfersTest-592287831 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:44:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-865c1906-7e10-4bac-83bd-04215c8c84df tempest-VolumesTransfersTest-592287831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ab48ac8b-95e3-4431-9e36-e47afa89ace4 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.401s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:23 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-ab48ac8b-95e3-4431-9e36-e47afa89ace4 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Creating offline snapshot 4cd2f30d-eba6-4aad-ab66-afd3ea3ef93f of volume 8a104067-ee68-418b-a455-bd97674e4f7d {{(pid=86081) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:44:23 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-865c1906-7e10-4bac-83bd-04215c8c84df tempest-VolumesTransfersTest-592287831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8120441d-dfba-4aae-b4fd-cbb428bf52dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4ef7f10-dc0b-4128-9ec9-06df9d720d53', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:23 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-865c1906-7e10-4bac-83bd-04215c8c84df tempest-VolumesTransfersTest-592287831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fc0b142-5e35-42a5-a143-2f4c231a2395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:23 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f463fe-d579-46d3-bd81-e195783471fc]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:44:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ab48ac8b-95e3-4431-9e36-e47afa89ace4 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8a104067-ee68-418b-a455-bd97674e4f7d {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:23 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-865c1906-7e10-4bac-83bd-04215c8c84df tempest-VolumesTransfersTest-592287831 None] Volume volume-b4ef7f10-dc0b-4128-9ec9-06df9d720d53 (b4ef7f10-dc0b-4128-9ec9-06df9d720d53): created successfully Aug 28 09:44:23 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-865c1906-7e10-4bac-83bd-04215c8c84df tempest-VolumesTransfersTest-592287831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fc0b142-5e35-42a5-a143-2f4c231a2395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:23 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-865c1906-7e10-4bac-83bd-04215c8c84df tempest-VolumesTransfersTest-592287831 None] Flow 'volume_create_manager' (6b66c63c-a736-47c8-9183-405d58b8b9ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:44:23 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-865c1906-7e10-4bac-83bd-04215c8c84df tempest-VolumesTransfersTest-592287831 None] Created volume successfully. Aug 28 09:44:23 devstack sudo[100919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8a104067-ee68-418b-a455-bd97674e4f7d Aug 28 09:44:23 devstack sudo[100919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:24 devstack sudo[100919]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ab48ac8b-95e3-4431-9e36-e47afa89ace4 tempest-CreateVolumesFromSnapshotTest-1214825562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8a104067-ee68-418b-a455-bd97674e4f7d" returned: 0 in 0.427s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ab48ac8b-95e3-4431-9e36-e47afa89ace4 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8a104067-ee68-418b-a455-bd97674e4f7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8a104067-ee68-418b-a455-bd97674e4f7d.4cd2f30d-eba6-4aad-ab66-afd3ea3ef93f 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:24 devstack sudo[100925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8a104067-ee68-418b-a455-bd97674e4f7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8a104067-ee68-418b-a455-bd97674e4f7d.4cd2f30d-eba6-4aad-ab66-afd3ea3ef93f 1G Aug 28 09:44:24 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:24 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ab48ac8b-95e3-4431-9e36-e47afa89ace4 tempest-CreateVolumesFromSnapshotTest-1214825562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8a104067-ee68-418b-a455-bd97674e4f7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8a104067-ee68-418b-a455-bd97674e4f7d.4cd2f30d-eba6-4aad-ab66-afd3ea3ef93f 1G" returned: 0 in 0.600s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ab48ac8b-95e3-4431-9e36-e47afa89ace4 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a104067-ee68-418b-a455-bd97674e4f7d -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8a104067-ee68-418b-a455-bd97674e4f7d.4cd2f30d-eba6-4aad-ab66-afd3ea3ef93f {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:24 devstack sudo[100931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a104067-ee68-418b-a455-bd97674e4f7d -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8a104067-ee68-418b-a455-bd97674e4f7d.4cd2f30d-eba6-4aad-ab66-afd3ea3ef93f Aug 28 09:44:24 devstack sudo[100931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:25 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-1f5314fb-2719-458a-8bcc-8db7d2d3e5d6 tempest-VolumesTransfersTest-1384395675 None] Acquiring lock "cinder-b4ef7f10-dc0b-4128-9ec9-06df9d720d53-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:44:25 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-1f5314fb-2719-458a-8bcc-8db7d2d3e5d6 tempest-VolumesTransfersTest-1384395675 None] Lock "cinder-b4ef7f10-dc0b-4128-9ec9-06df9d720d53-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:44:25 devstack sudo[100931]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ab48ac8b-95e3-4431-9e36-e47afa89ace4 tempest-CreateVolumesFromSnapshotTest-1214825562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a104067-ee68-418b-a455-bd97674e4f7d -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8a104067-ee68-418b-a455-bd97674e4f7d.4cd2f30d-eba6-4aad-ab66-afd3ea3ef93f" returned: 0 in 0.411s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:25 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-ab48ac8b-95e3-4431-9e36-e47afa89ace4 tempest-CreateVolumesFromSnapshotTest-1214825562 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8a104067-ee68-418b-a455-bd97674e4f7d.4cd2f30d-eba6-4aad-ab66-afd3ea3ef93f is being set with open permissions: ugo+rw Aug 28 09:44:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ab48ac8b-95e3-4431-9e36-e47afa89ace4 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8a104067-ee68-418b-a455-bd97674e4f7d.4cd2f30d-eba6-4aad-ab66-afd3ea3ef93f {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:25 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-1f5314fb-2719-458a-8bcc-8db7d2d3e5d6 tempest-VolumesTransfersTest-1384395675 None] Acquiring lock "cinder-quobyte-b4ef7f10-dc0b-4128-9ec9-06df9d720d53" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:44:25 devstack sudo[100936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8a104067-ee68-418b-a455-bd97674e4f7d.4cd2f30d-eba6-4aad-ab66-afd3ea3ef93f Aug 28 09:44:25 devstack sudo[100936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:25 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-1f5314fb-2719-458a-8bcc-8db7d2d3e5d6 tempest-VolumesTransfersTest-1384395675 None] Lock "cinder-quobyte-b4ef7f10-dc0b-4128-9ec9-06df9d720d53" acquired by "delete_volume" :: waited 0.027s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:44:25 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e4b9c1-82c5-4e7c-b268-295da911ced6]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:44:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1f5314fb-2719-458a-8bcc-8db7d2d3e5d6 tempest-VolumesTransfersTest-1384395675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b4ef7f10-dc0b-4128-9ec9-06df9d720d53 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:25 devstack sudo[100938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b4ef7f10-dc0b-4128-9ec9-06df9d720d53 Aug 28 09:44:25 devstack sudo[100938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:25 devstack sudo[100936]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ab48ac8b-95e3-4431-9e36-e47afa89ace4 tempest-CreateVolumesFromSnapshotTest-1214825562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8a104067-ee68-418b-a455-bd97674e4f7d.4cd2f30d-eba6-4aad-ab66-afd3ea3ef93f" returned: 0 in 0.322s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ab48ac8b-95e3-4431-9e36-e47afa89ace4 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8a104067-ee68-418b-a455-bd97674e4f7d.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:25 devstack sudo[100941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8a104067-ee68-418b-a455-bd97674e4f7d.info Aug 28 09:44:25 devstack sudo[100941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:25 devstack sudo[100938]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1f5314fb-2719-458a-8bcc-8db7d2d3e5d6 tempest-VolumesTransfersTest-1384395675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b4ef7f10-dc0b-4128-9ec9-06df9d720d53" returned: 0 in 0.489s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1f5314fb-2719-458a-8bcc-8db7d2d3e5d6 tempest-VolumesTransfersTest-1384395675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b4ef7f10-dc0b-4128-9ec9-06df9d720d53 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:25 devstack sudo[100946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b4ef7f10-dc0b-4128-9ec9-06df9d720d53 Aug 28 09:44:25 devstack sudo[100946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:26 devstack sudo[100941]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ab48ac8b-95e3-4431-9e36-e47afa89ace4 tempest-CreateVolumesFromSnapshotTest-1214825562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8a104067-ee68-418b-a455-bd97674e4f7d.info" returned: 0 in 0.352s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:26 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-ab48ac8b-95e3-4431-9e36-e47afa89ace4 tempest-CreateVolumesFromSnapshotTest-1214825562 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8a104067-ee68-418b-a455-bd97674e4f7d.info is being set with open permissions: ugo+rw Aug 28 09:44:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ab48ac8b-95e3-4431-9e36-e47afa89ace4 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8a104067-ee68-418b-a455-bd97674e4f7d.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:26 devstack sudo[100949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8a104067-ee68-418b-a455-bd97674e4f7d.info Aug 28 09:44:26 devstack sudo[100949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:26 devstack sudo[100946]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1f5314fb-2719-458a-8bcc-8db7d2d3e5d6 tempest-VolumesTransfersTest-1384395675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b4ef7f10-dc0b-4128-9ec9-06df9d720d53" returned: 0 in 0.337s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:26 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-1f5314fb-2719-458a-8bcc-8db7d2d3e5d6 tempest-VolumesTransfersTest-1384395675 None] Lock "cinder-quobyte-b4ef7f10-dc0b-4128-9ec9-06df9d720d53" released by "delete_volume" :: held 0.899s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:44:26 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-1f5314fb-2719-458a-8bcc-8db7d2d3e5d6 tempest-VolumesTransfersTest-1384395675 None] Created reservations ['1d348394-7ba5-4e67-8a27-2e8c57cfb3dc', '6f2091e0-cec9-4631-84d7-a708360a68be', '7e38dc2e-d729-4c9e-9d86-9daaa41752a4', '63ad26ed-bf84-4686-85b6-c87da5153b28'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:44:26 devstack sudo[100949]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ab48ac8b-95e3-4431-9e36-e47afa89ace4 tempest-CreateVolumesFromSnapshotTest-1214825562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8a104067-ee68-418b-a455-bd97674e4f7d.info" returned: 0 in 0.347s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ab48ac8b-95e3-4431-9e36-e47afa89ace4 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.571s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:26 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-ab48ac8b-95e3-4431-9e36-e47afa89ace4 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Create snapshot completed successfully Aug 28 09:44:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-1f5314fb-2719-458a-8bcc-8db7d2d3e5d6 tempest-VolumesTransfersTest-1384395675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-1f5314fb-2719-458a-8bcc-8db7d2d3e5d6 tempest-VolumesTransfersTest-1384395675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:26 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-1f5314fb-2719-458a-8bcc-8db7d2d3e5d6 tempest-VolumesTransfersTest-1384395675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:44:26 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-1f5314fb-2719-458a-8bcc-8db7d2d3e5d6 tempest-VolumesTransfersTest-1384395675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:44:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-1f5314fb-2719-458a-8bcc-8db7d2d3e5d6 tempest-VolumesTransfersTest-1384395675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1f5314fb-2719-458a-8bcc-8db7d2d3e5d6 tempest-VolumesTransfersTest-1384395675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:26 devstack sudo[100953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:44:26 devstack sudo[100953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:26 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7a8dd46-d0f8-438f-850b-05abedba188c tempest-CreateVolumesFromImageTest-617874580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:44:26 devstack sudo[100953]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-d7a8dd46-d0f8-438f-850b-05abedba188c tempest-CreateVolumesFromImageTest-617874580 None] Flow 'volume_create_manager' (490bd86f-b0ec-412e-8a9d-8cd104bab195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:44:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-d7a8dd46-d0f8-438f-850b-05abedba188c tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d77cc982-84a4-4149-8740-ebaa680e3801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1f5314fb-2719-458a-8bcc-8db7d2d3e5d6 tempest-VolumesTransfersTest-1384395675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.464s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:26 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-1f5314fb-2719-458a-8bcc-8db7d2d3e5d6 tempest-VolumesTransfersTest-1384395675 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:44:26 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-1f5314fb-2719-458a-8bcc-8db7d2d3e5d6 tempest-VolumesTransfersTest-1384395675 None] Deleted volume successfully. Aug 28 09:44:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-d7a8dd46-d0f8-438f-850b-05abedba188c tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d77cc982-84a4-4149-8740-ebaa680e3801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:44:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1293316849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67ce92ae-cf79-4585-ae42-a8a16fa3f62a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad5ef28c467a4624879621d72a829ffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:44:27Z,use_quota=True,user_id='050839beb6d84937881dadd31ea4065f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-d7a8dd46-d0f8-438f-850b-05abedba188c tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55c3fa23-bca8-4a2b-a185-72fef167849e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-d7a8dd46-d0f8-438f-850b-05abedba188c tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55c3fa23-bca8-4a2b-a185-72fef167849e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-d7a8dd46-d0f8-438f-850b-05abedba188c tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6755452c-cc47-4735-a5b8-216f54fb3594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-d7a8dd46-d0f8-438f-850b-05abedba188c tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6755452c-cc47-4735-a5b8-216f54fb3594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67ce92ae-cf79-4585-ae42-a8a16fa3f62a', 'volume_name': 'volume-67ce92ae-cf79-4585-ae42-a8a16fa3f62a', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-d7a8dd46-d0f8-438f-850b-05abedba188c tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35f1d6f9-2c27-4d86-946a-5a85f44fb6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-d7a8dd46-d0f8-438f-850b-05abedba188c tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35f1d6f9-2c27-4d86-946a-5a85f44fb6ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-d7a8dd46-d0f8-438f-850b-05abedba188c tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e1a90dc-337c-42ca-9b02-5f99daa22cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:27 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-d7a8dd46-d0f8-438f-850b-05abedba188c tempest-CreateVolumesFromImageTest-617874580 None] Volume 67ce92ae-cf79-4585-ae42-a8a16fa3f62a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67ce92ae-cf79-4585-ae42-a8a16fa3f62a', 'volume_size': 1} Aug 28 09:44:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-d7a8dd46-d0f8-438f-850b-05abedba188c tempest-CreateVolumesFromImageTest-617874580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-d7a8dd46-d0f8-438f-850b-05abedba188c tempest-CreateVolumesFromImageTest-617874580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:27 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-d7a8dd46-d0f8-438f-850b-05abedba188c tempest-CreateVolumesFromImageTest-617874580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:44:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1293316849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67ce92ae-cf79-4585-ae42-a8a16fa3f62a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad5ef28c467a4624879621d72a829ffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:44:27Z,use_quota=True,user_id='050839beb6d84937881dadd31ea4065f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:44:27 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-d7a8dd46-d0f8-438f-850b-05abedba188c tempest-CreateVolumesFromImageTest-617874580 None] Creating volume 67ce92ae-cf79-4585-ae42-a8a16fa3f62a {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:44:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-d7a8dd46-d0f8-438f-850b-05abedba188c tempest-CreateVolumesFromImageTest-617874580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-d7a8dd46-d0f8-438f-850b-05abedba188c tempest-CreateVolumesFromImageTest-617874580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:27 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-d7a8dd46-d0f8-438f-850b-05abedba188c tempest-CreateVolumesFromImageTest-617874580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:44:27 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-d7a8dd46-d0f8-438f-850b-05abedba188c tempest-CreateVolumesFromImageTest-617874580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:44:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-d7a8dd46-d0f8-438f-850b-05abedba188c tempest-CreateVolumesFromImageTest-617874580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:27 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-d7a8dd46-d0f8-438f-850b-05abedba188c tempest-CreateVolumesFromImageTest-617874580 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:44:27 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-d7a8dd46-d0f8-438f-850b-05abedba188c tempest-CreateVolumesFromImageTest-617874580 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:44:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d7a8dd46-d0f8-438f-850b-05abedba188c tempest-CreateVolumesFromImageTest-617874580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-67ce92ae-cf79-4585-ae42-a8a16fa3f62a 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:27 devstack sudo[100956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-67ce92ae-cf79-4585-ae42-a8a16fa3f62a 1073741824 Aug 28 09:44:27 devstack sudo[100956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:27 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-1f5314fb-2719-458a-8bcc-8db7d2d3e5d6 tempest-VolumesTransfersTest-1384395675 None] Lock "cinder-b4ef7f10-dc0b-4128-9ec9-06df9d720d53-delete_volume" released by "delete_volume" :: held 1.854s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:44:27 devstack sudo[100956]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d7a8dd46-d0f8-438f-850b-05abedba188c tempest-CreateVolumesFromImageTest-617874580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-67ce92ae-cf79-4585-ae42-a8a16fa3f62a 1073741824" returned: 0 in 0.723s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:27 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d893a5d-dce8-4279-b921-c2f0026aa789 tempest-CreateVolumesFromImageTest-617874580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:44:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7d893a5d-dce8-4279-b921-c2f0026aa789 tempest-CreateVolumesFromImageTest-617874580 None] Flow 'volume_create_manager' (2fb9f915-f5e4-45a8-a490-5d7c5445dbb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:44:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7d893a5d-dce8-4279-b921-c2f0026aa789 tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2410c6a-d69a-4653-9e5f-6e3e904189a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7d893a5d-dce8-4279-b921-c2f0026aa789 tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2410c6a-d69a-4653-9e5f-6e3e904189a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-897714157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94ed7042-ddad-4b2a-81dd-624cb01e3e59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad5ef28c467a4624879621d72a829ffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:44:28Z,use_quota=True,user_id='050839beb6d84937881dadd31ea4065f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7d893a5d-dce8-4279-b921-c2f0026aa789 tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14e35078-aa6f-4f8d-a320-3b874128d975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7d893a5d-dce8-4279-b921-c2f0026aa789 tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14e35078-aa6f-4f8d-a320-3b874128d975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7d893a5d-dce8-4279-b921-c2f0026aa789 tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bff865f-1333-4837-839f-0550ec9f577d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7d893a5d-dce8-4279-b921-c2f0026aa789 tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bff865f-1333-4837-839f-0550ec9f577d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94ed7042-ddad-4b2a-81dd-624cb01e3e59', 'volume_name': 'volume-94ed7042-ddad-4b2a-81dd-624cb01e3e59', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7d893a5d-dce8-4279-b921-c2f0026aa789 tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7b82033-3cbd-49ec-99c3-c6c3c9211551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7d893a5d-dce8-4279-b921-c2f0026aa789 tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7b82033-3cbd-49ec-99c3-c6c3c9211551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7d893a5d-dce8-4279-b921-c2f0026aa789 tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a54139f9-7080-4e47-86a7-9a053b0b0e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:28 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-7d893a5d-dce8-4279-b921-c2f0026aa789 tempest-CreateVolumesFromImageTest-617874580 None] Volume 94ed7042-ddad-4b2a-81dd-624cb01e3e59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94ed7042-ddad-4b2a-81dd-624cb01e3e59', 'volume_size': 1} Aug 28 09:44:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-7d893a5d-dce8-4279-b921-c2f0026aa789 tempest-CreateVolumesFromImageTest-617874580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d7a8dd46-d0f8-438f-850b-05abedba188c tempest-CreateVolumesFromImageTest-617874580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-67ce92ae-cf79-4585-ae42-a8a16fa3f62a {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:28 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b00a22b-88b8-488a-bd6a-bc98b9348c1e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:44:28 devstack sudo[100965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-67ce92ae-cf79-4585-ae42-a8a16fa3f62a Aug 28 09:44:28 devstack sudo[100965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5b00a22b-88b8-488a-bd6a-bc98b9348c1e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Flow 'volume_create_manager' (dd1346be-0dd1-443e-88b1-90cae3ebfc5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:44:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5b00a22b-88b8-488a-bd6a-bc98b9348c1e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10e0b79c-12bf-48c2-af7e-93cf37c68dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5b00a22b-88b8-488a-bd6a-bc98b9348c1e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10e0b79c-12bf-48c2-af7e-93cf37c68dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1909585961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e3dd741-45d0-44ba-9e71-722eb5247881,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22686c85866b45288b7094eb71842c0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:44:28Z,use_quota=True,user_id='9d4d9d8070eb489e90ea9e839df57ab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5b00a22b-88b8-488a-bd6a-bc98b9348c1e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecc7cfa5-899f-428e-abd5-733d9133740c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5b00a22b-88b8-488a-bd6a-bc98b9348c1e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecc7cfa5-899f-428e-abd5-733d9133740c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5b00a22b-88b8-488a-bd6a-bc98b9348c1e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a24ff3a-b61f-45d9-b642-c37a889e66fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5b00a22b-88b8-488a-bd6a-bc98b9348c1e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a24ff3a-b61f-45d9-b642-c37a889e66fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e3dd741-45d0-44ba-9e71-722eb5247881', 'volume_name': 'volume-1e3dd741-45d0-44ba-9e71-722eb5247881', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5b00a22b-88b8-488a-bd6a-bc98b9348c1e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80b23334-7a81-4bd1-b75c-8b95b0055602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5b00a22b-88b8-488a-bd6a-bc98b9348c1e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80b23334-7a81-4bd1-b75c-8b95b0055602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5b00a22b-88b8-488a-bd6a-bc98b9348c1e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b3a9ead-50cc-4028-9e99-1b35b7beab50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:28 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-5b00a22b-88b8-488a-bd6a-bc98b9348c1e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Volume 1e3dd741-45d0-44ba-9e71-722eb5247881: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e3dd741-45d0-44ba-9e71-722eb5247881', 'volume_size': 1} Aug 28 09:44:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-5b00a22b-88b8-488a-bd6a-bc98b9348c1e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:28 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-745d7c10-b156-456d-8f89-d9ac701512d2 tempest-CreateVolumesFromImageTest-617874580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:44:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-745d7c10-b156-456d-8f89-d9ac701512d2 tempest-CreateVolumesFromImageTest-617874580 None] Flow 'volume_create_manager' (1282368e-a181-450d-a4aa-93a60bebea52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:44:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-745d7c10-b156-456d-8f89-d9ac701512d2 tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7011522e-3bee-4e47-8dd1-345dfbe48dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-745d7c10-b156-456d-8f89-d9ac701512d2 tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7011522e-3bee-4e47-8dd1-345dfbe48dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-385192793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3571150e-b829-480c-98d7-63244f74e20e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad5ef28c467a4624879621d72a829ffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:44:28Z,use_quota=True,user_id='050839beb6d84937881dadd31ea4065f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-745d7c10-b156-456d-8f89-d9ac701512d2 tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa8df18b-5510-4205-89cd-fdf7ed807a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-745d7c10-b156-456d-8f89-d9ac701512d2 tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa8df18b-5510-4205-89cd-fdf7ed807a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:28 devstack sudo[100965]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-745d7c10-b156-456d-8f89-d9ac701512d2 tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c311a5f-dc1b-46bc-a931-884dd76c0c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-745d7c10-b156-456d-8f89-d9ac701512d2 tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c311a5f-dc1b-46bc-a931-884dd76c0c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3571150e-b829-480c-98d7-63244f74e20e', 'volume_name': 'volume-3571150e-b829-480c-98d7-63244f74e20e', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-745d7c10-b156-456d-8f89-d9ac701512d2 tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66d9cdf3-5424-47c0-9dc1-1cee1ec19fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-745d7c10-b156-456d-8f89-d9ac701512d2 tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66d9cdf3-5424-47c0-9dc1-1cee1ec19fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-745d7c10-b156-456d-8f89-d9ac701512d2 tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc8c4d2f-0228-4a4a-8241-b674f8709783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:28 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-745d7c10-b156-456d-8f89-d9ac701512d2 tempest-CreateVolumesFromImageTest-617874580 None] Volume 3571150e-b829-480c-98d7-63244f74e20e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3571150e-b829-480c-98d7-63244f74e20e', 'volume_size': 1} Aug 28 09:44:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-745d7c10-b156-456d-8f89-d9ac701512d2 tempest-CreateVolumesFromImageTest-617874580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d7a8dd46-d0f8-438f-850b-05abedba188c tempest-CreateVolumesFromImageTest-617874580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-67ce92ae-cf79-4585-ae42-a8a16fa3f62a" returned: 0 in 0.616s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:28 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-d7a8dd46-d0f8-438f-850b-05abedba188c tempest-CreateVolumesFromImageTest-617874580 None] <== create_volume: return (1680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:44:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-d7a8dd46-d0f8-438f-850b-05abedba188c tempest-CreateVolumesFromImageTest-617874580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.683s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-7d893a5d-dce8-4279-b921-c2f0026aa789 tempest-CreateVolumesFromImageTest-617874580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.652s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:28 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-7d893a5d-dce8-4279-b921-c2f0026aa789 tempest-CreateVolumesFromImageTest-617874580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-897714157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94ed7042-ddad-4b2a-81dd-624cb01e3e59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad5ef28c467a4624879621d72a829ffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:44:28Z,use_quota=True,user_id='050839beb6d84937881dadd31ea4065f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:44:28 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-7d893a5d-dce8-4279-b921-c2f0026aa789 tempest-CreateVolumesFromImageTest-617874580 None] Creating volume 94ed7042-ddad-4b2a-81dd-624cb01e3e59 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:44:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-7d893a5d-dce8-4279-b921-c2f0026aa789 tempest-CreateVolumesFromImageTest-617874580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-7d893a5d-dce8-4279-b921-c2f0026aa789 tempest-CreateVolumesFromImageTest-617874580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:28 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-7d893a5d-dce8-4279-b921-c2f0026aa789 tempest-CreateVolumesFromImageTest-617874580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:44:28 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-7d893a5d-dce8-4279-b921-c2f0026aa789 tempest-CreateVolumesFromImageTest-617874580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:44:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-7d893a5d-dce8-4279-b921-c2f0026aa789 tempest-CreateVolumesFromImageTest-617874580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:28 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-7d893a5d-dce8-4279-b921-c2f0026aa789 tempest-CreateVolumesFromImageTest-617874580 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:44:28 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-7d893a5d-dce8-4279-b921-c2f0026aa789 tempest-CreateVolumesFromImageTest-617874580 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:44:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7d893a5d-dce8-4279-b921-c2f0026aa789 tempest-CreateVolumesFromImageTest-617874580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-94ed7042-ddad-4b2a-81dd-624cb01e3e59 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:28 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ef415c7-2dc2-4c24-9b61-293435d13988 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:44:28 devstack sudo[100969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-94ed7042-ddad-4b2a-81dd-624cb01e3e59 1073741824 Aug 28 09:44:28 devstack sudo[100969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5ef415c7-2dc2-4c24-9b61-293435d13988 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Flow 'volume_create_manager' (87cd0452-919f-4eba-bea8-e162f2cdad65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:44:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5ef415c7-2dc2-4c24-9b61-293435d13988 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be7b44e3-86f4-4465-98ae-76fb98891e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-d7a8dd46-d0f8-438f-850b-05abedba188c tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e1a90dc-337c-42ca-9b02-5f99daa22cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67ce92ae-cf79-4585-ae42-a8a16fa3f62a', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-d7a8dd46-d0f8-438f-850b-05abedba188c tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bc66505-f18f-40aa-b44d-d7ed31da985c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:29 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5ef415c7-2dc2-4c24-9b61-293435d13988 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be7b44e3-86f4-4465-98ae-76fb98891e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:44:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1788333889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99466e34-1f55-4726-92d0-aa978a197c25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22686c85866b45288b7094eb71842c0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:44:28Z,use_quota=True,user_id='9d4d9d8070eb489e90ea9e839df57ab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:29 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5ef415c7-2dc2-4c24-9b61-293435d13988 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bedb98ff-135a-4159-b395-b3b429e2a76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:29 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5ef415c7-2dc2-4c24-9b61-293435d13988 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bedb98ff-135a-4159-b395-b3b429e2a76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:29 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5ef415c7-2dc2-4c24-9b61-293435d13988 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b05d8f90-4721-447a-b564-67502e83f301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:29 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5ef415c7-2dc2-4c24-9b61-293435d13988 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b05d8f90-4721-447a-b564-67502e83f301) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99466e34-1f55-4726-92d0-aa978a197c25', 'volume_name': 'volume-99466e34-1f55-4726-92d0-aa978a197c25', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:29 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5ef415c7-2dc2-4c24-9b61-293435d13988 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2524425-48b5-438f-91a8-ec8029058bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:29 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5ef415c7-2dc2-4c24-9b61-293435d13988 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2524425-48b5-438f-91a8-ec8029058bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:29 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5ef415c7-2dc2-4c24-9b61-293435d13988 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d959fb3-2267-45e1-80d8-994d141e0628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:29 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-5ef415c7-2dc2-4c24-9b61-293435d13988 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Volume 99466e34-1f55-4726-92d0-aa978a197c25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99466e34-1f55-4726-92d0-aa978a197c25', 'volume_size': 1} Aug 28 09:44:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-5ef415c7-2dc2-4c24-9b61-293435d13988 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:29 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-d7a8dd46-d0f8-438f-850b-05abedba188c tempest-CreateVolumesFromImageTest-617874580 None] Volume volume-67ce92ae-cf79-4585-ae42-a8a16fa3f62a (67ce92ae-cf79-4585-ae42-a8a16fa3f62a): created successfully Aug 28 09:44:29 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-d7a8dd46-d0f8-438f-850b-05abedba188c tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bc66505-f18f-40aa-b44d-d7ed31da985c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:29 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-d7a8dd46-d0f8-438f-850b-05abedba188c tempest-CreateVolumesFromImageTest-617874580 None] Flow 'volume_create_manager' (490bd86f-b0ec-412e-8a9d-8cd104bab195) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:44:29 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-d7a8dd46-d0f8-438f-850b-05abedba188c tempest-CreateVolumesFromImageTest-617874580 None] Created volume successfully. Aug 28 09:44:29 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8084ad9-aa39-4b6d-bb36-826787b46060 tempest-CreateVolumesFromImageTest-617874580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:44:29 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f8084ad9-aa39-4b6d-bb36-826787b46060 tempest-CreateVolumesFromImageTest-617874580 None] Flow 'volume_create_manager' (75dbf437-f0b0-4338-ba95-231e20a61a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:44:29 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f8084ad9-aa39-4b6d-bb36-826787b46060 tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c50d940a-5cc4-433b-a8c4-453cbb2e7468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:29 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-205f8aca-61a9-407c-b6a0-d37e9ef6f401 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:44:29 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-205f8aca-61a9-407c-b6a0-d37e9ef6f401 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Flow 'volume_create_manager' (7322ec71-4413-42cc-be0a-87361ce0a8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:44:29 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-205f8aca-61a9-407c-b6a0-d37e9ef6f401 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf525663-0c1d-427e-a826-1ccddaf43c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:29 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f8084ad9-aa39-4b6d-bb36-826787b46060 tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c50d940a-5cc4-433b-a8c4-453cbb2e7468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:44:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1244975219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfa8af75-87f3-4435-b3e9-595f5f92d016,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad5ef28c467a4624879621d72a829ffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:44:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:44:29Z,use_quota=True,user_id='050839beb6d84937881dadd31ea4065f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:29 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f8084ad9-aa39-4b6d-bb36-826787b46060 tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bcb8360-e89d-450b-9598-1b81326f641b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:29 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f8084ad9-aa39-4b6d-bb36-826787b46060 tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bcb8360-e89d-450b-9598-1b81326f641b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:29 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f8084ad9-aa39-4b6d-bb36-826787b46060 tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (566822a3-8252-4d75-93ae-db305d42528f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:29 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f8084ad9-aa39-4b6d-bb36-826787b46060 tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (566822a3-8252-4d75-93ae-db305d42528f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfa8af75-87f3-4435-b3e9-595f5f92d016', 'volume_name': 'volume-cfa8af75-87f3-4435-b3e9-595f5f92d016', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:29 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f8084ad9-aa39-4b6d-bb36-826787b46060 tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd35d0bd-a570-4c7a-963a-f3f6359cc5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:29 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f8084ad9-aa39-4b6d-bb36-826787b46060 tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd35d0bd-a570-4c7a-963a-f3f6359cc5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:29 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f8084ad9-aa39-4b6d-bb36-826787b46060 tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (692b4d97-7e1a-48c7-a1d6-98dd31e67e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:29 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-f8084ad9-aa39-4b6d-bb36-826787b46060 tempest-CreateVolumesFromImageTest-617874580 None] Volume cfa8af75-87f3-4435-b3e9-595f5f92d016: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfa8af75-87f3-4435-b3e9-595f5f92d016', 'volume_size': 1} Aug 28 09:44:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f8084ad9-aa39-4b6d-bb36-826787b46060 tempest-CreateVolumesFromImageTest-617874580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:29 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-205f8aca-61a9-407c-b6a0-d37e9ef6f401 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf525663-0c1d-427e-a826-1ccddaf43c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:44:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1820913591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a825f91b-0004-4296-a42f-0c853658e1ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22686c85866b45288b7094eb71842c0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:44:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:44:29Z,use_quota=True,user_id='9d4d9d8070eb489e90ea9e839df57ab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:29 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-205f8aca-61a9-407c-b6a0-d37e9ef6f401 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a6d8849-16e0-49ed-bfc5-72e71340cef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:29 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-205f8aca-61a9-407c-b6a0-d37e9ef6f401 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a6d8849-16e0-49ed-bfc5-72e71340cef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:29 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-205f8aca-61a9-407c-b6a0-d37e9ef6f401 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be45fb64-ce34-40ae-bce8-551091fcdfdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:29 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-205f8aca-61a9-407c-b6a0-d37e9ef6f401 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be45fb64-ce34-40ae-bce8-551091fcdfdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a825f91b-0004-4296-a42f-0c853658e1ee', 'volume_name': 'volume-a825f91b-0004-4296-a42f-0c853658e1ee', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:29 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-205f8aca-61a9-407c-b6a0-d37e9ef6f401 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d758f784-fc57-48bc-85a3-cc1228e9ed42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:29 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-205f8aca-61a9-407c-b6a0-d37e9ef6f401 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d758f784-fc57-48bc-85a3-cc1228e9ed42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:29 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-205f8aca-61a9-407c-b6a0-d37e9ef6f401 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fed8fe3-3e9a-4eb2-9ad0-f6c353d79429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:29 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-205f8aca-61a9-407c-b6a0-d37e9ef6f401 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Volume a825f91b-0004-4296-a42f-0c853658e1ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a825f91b-0004-4296-a42f-0c853658e1ee', 'volume_size': 1} Aug 28 09:44:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-205f8aca-61a9-407c-b6a0-d37e9ef6f401 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:29 devstack sudo[100969]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7d893a5d-dce8-4279-b921-c2f0026aa789 tempest-CreateVolumesFromImageTest-617874580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-94ed7042-ddad-4b2a-81dd-624cb01e3e59 1073741824" returned: 0 in 0.866s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7d893a5d-dce8-4279-b921-c2f0026aa789 tempest-CreateVolumesFromImageTest-617874580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-94ed7042-ddad-4b2a-81dd-624cb01e3e59 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:29 devstack sudo[100975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-94ed7042-ddad-4b2a-81dd-624cb01e3e59 Aug 28 09:44:29 devstack sudo[100975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:29 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-72466fd1-5f05-4102-89a3-ec109c23f1bb tempest-CreateVolumesFromImageTest-617874580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:44:29 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-72466fd1-5f05-4102-89a3-ec109c23f1bb tempest-CreateVolumesFromImageTest-617874580 None] Flow 'volume_create_manager' (2802a20d-bb3b-4764-b808-736b04c148ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:44:29 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-72466fd1-5f05-4102-89a3-ec109c23f1bb tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2c54e07-82ab-4d14-9b40-36f412cdb232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:30 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-72466fd1-5f05-4102-89a3-ec109c23f1bb tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2c54e07-82ab-4d14-9b40-36f412cdb232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:44:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-167713503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81d589ed-b2e3-47e5-a1b2-4324c348e778,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad5ef28c467a4624879621d72a829ffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:44:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:44:30Z,use_quota=True,user_id='050839beb6d84937881dadd31ea4065f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:30 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-72466fd1-5f05-4102-89a3-ec109c23f1bb tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fc4c372-93ee-4db2-b842-573466a44311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:30 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-72466fd1-5f05-4102-89a3-ec109c23f1bb tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fc4c372-93ee-4db2-b842-573466a44311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:30 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-72466fd1-5f05-4102-89a3-ec109c23f1bb tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (425b624a-018a-433d-ba10-352f688ebfdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:30 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-72466fd1-5f05-4102-89a3-ec109c23f1bb tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (425b624a-018a-433d-ba10-352f688ebfdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81d589ed-b2e3-47e5-a1b2-4324c348e778', 'volume_name': 'volume-81d589ed-b2e3-47e5-a1b2-4324c348e778', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:30 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-72466fd1-5f05-4102-89a3-ec109c23f1bb tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25e67673-005d-49fb-826c-89af0b13abe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:30 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-72466fd1-5f05-4102-89a3-ec109c23f1bb tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25e67673-005d-49fb-826c-89af0b13abe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:30 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-72466fd1-5f05-4102-89a3-ec109c23f1bb tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55ebc728-9110-4593-bcd0-5e71d572b14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:30 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-72466fd1-5f05-4102-89a3-ec109c23f1bb tempest-CreateVolumesFromImageTest-617874580 None] Volume 81d589ed-b2e3-47e5-a1b2-4324c348e778: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81d589ed-b2e3-47e5-a1b2-4324c348e778', 'volume_size': 1} Aug 28 09:44:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-72466fd1-5f05-4102-89a3-ec109c23f1bb tempest-CreateVolumesFromImageTest-617874580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:30 devstack sudo[100975]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7d893a5d-dce8-4279-b921-c2f0026aa789 tempest-CreateVolumesFromImageTest-617874580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-94ed7042-ddad-4b2a-81dd-624cb01e3e59" returned: 0 in 0.421s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:30 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-7d893a5d-dce8-4279-b921-c2f0026aa789 tempest-CreateVolumesFromImageTest-617874580 None] <== create_volume: return (1382ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:44:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-7d893a5d-dce8-4279-b921-c2f0026aa789 tempest-CreateVolumesFromImageTest-617874580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.388s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-5b00a22b-88b8-488a-bd6a-bc98b9348c1e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.810s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:30 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-5b00a22b-88b8-488a-bd6a-bc98b9348c1e tempest-CreateVolumesFromSnapshotTest-1214825562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1909585961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e3dd741-45d0-44ba-9e71-722eb5247881,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22686c85866b45288b7094eb71842c0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:44:28Z,use_quota=True,user_id='9d4d9d8070eb489e90ea9e839df57ab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:44:30 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-5b00a22b-88b8-488a-bd6a-bc98b9348c1e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Creating volume 1e3dd741-45d0-44ba-9e71-722eb5247881 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:44:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-5b00a22b-88b8-488a-bd6a-bc98b9348c1e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-5b00a22b-88b8-488a-bd6a-bc98b9348c1e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:30 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-5b00a22b-88b8-488a-bd6a-bc98b9348c1e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:44:30 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-5b00a22b-88b8-488a-bd6a-bc98b9348c1e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:44:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-5b00a22b-88b8-488a-bd6a-bc98b9348c1e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:30 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-5b00a22b-88b8-488a-bd6a-bc98b9348c1e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:44:30 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-5b00a22b-88b8-488a-bd6a-bc98b9348c1e tempest-CreateVolumesFromSnapshotTest-1214825562 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:44:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5b00a22b-88b8-488a-bd6a-bc98b9348c1e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1e3dd741-45d0-44ba-9e71-722eb5247881 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:30 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7d893a5d-dce8-4279-b921-c2f0026aa789 tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a54139f9-7080-4e47-86a7-9a053b0b0e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94ed7042-ddad-4b2a-81dd-624cb01e3e59', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:30 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7d893a5d-dce8-4279-b921-c2f0026aa789 tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a00c08ef-5372-4522-99d2-a487e16c4693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:30 devstack sudo[100978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1e3dd741-45d0-44ba-9e71-722eb5247881 1073741824 Aug 28 09:44:30 devstack sudo[100978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:30 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-7d893a5d-dce8-4279-b921-c2f0026aa789 tempest-CreateVolumesFromImageTest-617874580 None] Volume volume-94ed7042-ddad-4b2a-81dd-624cb01e3e59 (94ed7042-ddad-4b2a-81dd-624cb01e3e59): created successfully Aug 28 09:44:30 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7d893a5d-dce8-4279-b921-c2f0026aa789 tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a00c08ef-5372-4522-99d2-a487e16c4693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:30 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7d893a5d-dce8-4279-b921-c2f0026aa789 tempest-CreateVolumesFromImageTest-617874580 None] Flow 'volume_create_manager' (2fb9f915-f5e4-45a8-a490-5d7c5445dbb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:44:30 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-2991c7da-8e0f-4075-b66b-8c314dafc147 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:44:30 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2991c7da-8e0f-4075-b66b-8c314dafc147 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Flow 'volume_create_manager' (a563a943-0ad2-4228-b2b2-6dfca5d1676f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:44:30 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2991c7da-8e0f-4075-b66b-8c314dafc147 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbf2d832-e7d6-4075-953f-6b33ed8dcec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:30 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2991c7da-8e0f-4075-b66b-8c314dafc147 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbf2d832-e7d6-4075-953f-6b33ed8dcec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:44:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-91604748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d68a2d6-0495-4af8-92b2-044344107dcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22686c85866b45288b7094eb71842c0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:44:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:44:30Z,use_quota=True,user_id='9d4d9d8070eb489e90ea9e839df57ab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:30 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2991c7da-8e0f-4075-b66b-8c314dafc147 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (002051db-4f33-4fb1-bd3c-cfecf92c25a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:30 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2991c7da-8e0f-4075-b66b-8c314dafc147 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (002051db-4f33-4fb1-bd3c-cfecf92c25a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:30 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2991c7da-8e0f-4075-b66b-8c314dafc147 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cb3672f-5a99-4d5e-b80f-58a297607b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:30 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2991c7da-8e0f-4075-b66b-8c314dafc147 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cb3672f-5a99-4d5e-b80f-58a297607b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d68a2d6-0495-4af8-92b2-044344107dcf', 'volume_name': 'volume-3d68a2d6-0495-4af8-92b2-044344107dcf', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:30 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2991c7da-8e0f-4075-b66b-8c314dafc147 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd4f55b6-a43d-4519-b173-12190bc4971a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:30 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2991c7da-8e0f-4075-b66b-8c314dafc147 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd4f55b6-a43d-4519-b173-12190bc4971a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:30 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2991c7da-8e0f-4075-b66b-8c314dafc147 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fe5b1ee-57ce-40bd-ab8f-94bf9d939db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:30 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-2991c7da-8e0f-4075-b66b-8c314dafc147 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Volume 3d68a2d6-0495-4af8-92b2-044344107dcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d68a2d6-0495-4af8-92b2-044344107dcf', 'volume_size': 1} Aug 28 09:44:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-2991c7da-8e0f-4075-b66b-8c314dafc147 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:30 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-7d893a5d-dce8-4279-b921-c2f0026aa789 tempest-CreateVolumesFromImageTest-617874580 None] Created volume successfully. Aug 28 09:44:30 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-8866b0a4-6532-490d-86e1-ee473d9764a9 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:44:30 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8866b0a4-6532-490d-86e1-ee473d9764a9 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Flow 'volume_create_manager' (4db6321d-d74c-4170-8ca8-5609f928ba07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:44:30 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8866b0a4-6532-490d-86e1-ee473d9764a9 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee0b2e31-63c9-4a07-83eb-cec7e7d0520d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:30 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8866b0a4-6532-490d-86e1-ee473d9764a9 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee0b2e31-63c9-4a07-83eb-cec7e7d0520d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:44:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1590478959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b87abecf-e162-4b61-8131-cd8d5e7c54cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22686c85866b45288b7094eb71842c0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:44:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:44:30Z,use_quota=True,user_id='9d4d9d8070eb489e90ea9e839df57ab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:30 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8866b0a4-6532-490d-86e1-ee473d9764a9 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66b9a88d-4b21-42a6-9228-33ea6fa69551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:30 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8866b0a4-6532-490d-86e1-ee473d9764a9 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66b9a88d-4b21-42a6-9228-33ea6fa69551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:30 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8866b0a4-6532-490d-86e1-ee473d9764a9 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f10d8480-b8f8-4870-9794-7f036c54d388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:30 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8866b0a4-6532-490d-86e1-ee473d9764a9 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f10d8480-b8f8-4870-9794-7f036c54d388) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b87abecf-e162-4b61-8131-cd8d5e7c54cd', 'volume_name': 'volume-b87abecf-e162-4b61-8131-cd8d5e7c54cd', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:30 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8866b0a4-6532-490d-86e1-ee473d9764a9 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ecc2366-7bf0-4b3c-be11-6140879183c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:30 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8866b0a4-6532-490d-86e1-ee473d9764a9 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ecc2366-7bf0-4b3c-be11-6140879183c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:30 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8866b0a4-6532-490d-86e1-ee473d9764a9 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34f78fdc-2b6e-48d8-95c6-a70cfa2f1659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:30 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-8866b0a4-6532-490d-86e1-ee473d9764a9 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Volume b87abecf-e162-4b61-8131-cd8d5e7c54cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b87abecf-e162-4b61-8131-cd8d5e7c54cd', 'volume_size': 1} Aug 28 09:44:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8866b0a4-6532-490d-86e1-ee473d9764a9 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:30 devstack sudo[100978]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5b00a22b-88b8-488a-bd6a-bc98b9348c1e tempest-CreateVolumesFromSnapshotTest-1214825562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1e3dd741-45d0-44ba-9e71-722eb5247881 1073741824" returned: 0 in 0.703s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5b00a22b-88b8-488a-bd6a-bc98b9348c1e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1e3dd741-45d0-44ba-9e71-722eb5247881 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:30 devstack sudo[100984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1e3dd741-45d0-44ba-9e71-722eb5247881 Aug 28 09:44:30 devstack sudo[100984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:31 devstack sudo[100984]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5b00a22b-88b8-488a-bd6a-bc98b9348c1e tempest-CreateVolumesFromSnapshotTest-1214825562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1e3dd741-45d0-44ba-9e71-722eb5247881" returned: 0 in 0.301s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:31 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-5b00a22b-88b8-488a-bd6a-bc98b9348c1e tempest-CreateVolumesFromSnapshotTest-1214825562 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:44:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-5b00a22b-88b8-488a-bd6a-bc98b9348c1e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-745d7c10-b156-456d-8f89-d9ac701512d2 tempest-CreateVolumesFromImageTest-617874580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.488s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:31 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-745d7c10-b156-456d-8f89-d9ac701512d2 tempest-CreateVolumesFromImageTest-617874580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-385192793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3571150e-b829-480c-98d7-63244f74e20e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad5ef28c467a4624879621d72a829ffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:44:28Z,use_quota=True,user_id='050839beb6d84937881dadd31ea4065f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:44:31 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-745d7c10-b156-456d-8f89-d9ac701512d2 tempest-CreateVolumesFromImageTest-617874580 None] Creating volume 3571150e-b829-480c-98d7-63244f74e20e {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:44:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-745d7c10-b156-456d-8f89-d9ac701512d2 tempest-CreateVolumesFromImageTest-617874580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-745d7c10-b156-456d-8f89-d9ac701512d2 tempest-CreateVolumesFromImageTest-617874580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:31 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-745d7c10-b156-456d-8f89-d9ac701512d2 tempest-CreateVolumesFromImageTest-617874580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:44:31 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-745d7c10-b156-456d-8f89-d9ac701512d2 tempest-CreateVolumesFromImageTest-617874580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:44:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-745d7c10-b156-456d-8f89-d9ac701512d2 tempest-CreateVolumesFromImageTest-617874580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:31 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-745d7c10-b156-456d-8f89-d9ac701512d2 tempest-CreateVolumesFromImageTest-617874580 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:44:31 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-745d7c10-b156-456d-8f89-d9ac701512d2 tempest-CreateVolumesFromImageTest-617874580 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:44:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-745d7c10-b156-456d-8f89-d9ac701512d2 tempest-CreateVolumesFromImageTest-617874580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3571150e-b829-480c-98d7-63244f74e20e 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:31 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5b00a22b-88b8-488a-bd6a-bc98b9348c1e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b3a9ead-50cc-4028-9e99-1b35b7beab50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e3dd741-45d0-44ba-9e71-722eb5247881', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:31 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5b00a22b-88b8-488a-bd6a-bc98b9348c1e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11789eed-e846-438b-89e5-145e6739f596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:31 devstack sudo[100987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3571150e-b829-480c-98d7-63244f74e20e 1073741824 Aug 28 09:44:31 devstack sudo[100987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:31 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-5b00a22b-88b8-488a-bd6a-bc98b9348c1e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Volume volume-1e3dd741-45d0-44ba-9e71-722eb5247881 (1e3dd741-45d0-44ba-9e71-722eb5247881): created successfully Aug 28 09:44:31 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5b00a22b-88b8-488a-bd6a-bc98b9348c1e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11789eed-e846-438b-89e5-145e6739f596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:31 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5b00a22b-88b8-488a-bd6a-bc98b9348c1e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Flow 'volume_create_manager' (dd1346be-0dd1-443e-88b1-90cae3ebfc5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:44:31 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-5b00a22b-88b8-488a-bd6a-bc98b9348c1e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Created volume successfully. Aug 28 09:44:31 devstack sudo[100987]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-745d7c10-b156-456d-8f89-d9ac701512d2 tempest-CreateVolumesFromImageTest-617874580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3571150e-b829-480c-98d7-63244f74e20e 1073741824" returned: 0 in 0.631s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-745d7c10-b156-456d-8f89-d9ac701512d2 tempest-CreateVolumesFromImageTest-617874580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3571150e-b829-480c-98d7-63244f74e20e {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:31 devstack sudo[100993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3571150e-b829-480c-98d7-63244f74e20e Aug 28 09:44:31 devstack sudo[100993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:32 devstack sudo[100993]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-745d7c10-b156-456d-8f89-d9ac701512d2 tempest-CreateVolumesFromImageTest-617874580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3571150e-b829-480c-98d7-63244f74e20e" returned: 0 in 0.285s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:32 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-745d7c10-b156-456d-8f89-d9ac701512d2 tempest-CreateVolumesFromImageTest-617874580 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:44:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-745d7c10-b156-456d-8f89-d9ac701512d2 tempest-CreateVolumesFromImageTest-617874580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-5ef415c7-2dc2-4c24-9b61-293435d13988 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.085s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:32 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-5ef415c7-2dc2-4c24-9b61-293435d13988 tempest-CreateVolumesFromSnapshotTest-1214825562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:44:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1788333889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99466e34-1f55-4726-92d0-aa978a197c25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22686c85866b45288b7094eb71842c0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:44:28Z,use_quota=True,user_id='9d4d9d8070eb489e90ea9e839df57ab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:44:32 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-5ef415c7-2dc2-4c24-9b61-293435d13988 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Creating volume 99466e34-1f55-4726-92d0-aa978a197c25 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:44:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-5ef415c7-2dc2-4c24-9b61-293435d13988 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-5ef415c7-2dc2-4c24-9b61-293435d13988 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:32 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-5ef415c7-2dc2-4c24-9b61-293435d13988 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:44:32 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-5ef415c7-2dc2-4c24-9b61-293435d13988 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:44:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-5ef415c7-2dc2-4c24-9b61-293435d13988 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:32 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-5ef415c7-2dc2-4c24-9b61-293435d13988 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:44:32 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-5ef415c7-2dc2-4c24-9b61-293435d13988 tempest-CreateVolumesFromSnapshotTest-1214825562 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:44:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5ef415c7-2dc2-4c24-9b61-293435d13988 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-99466e34-1f55-4726-92d0-aa978a197c25 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-745d7c10-b156-456d-8f89-d9ac701512d2 tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc8c4d2f-0228-4a4a-8241-b674f8709783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3571150e-b829-480c-98d7-63244f74e20e', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:32 devstack sudo[100996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-99466e34-1f55-4726-92d0-aa978a197c25 1073741824 Aug 28 09:44:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-745d7c10-b156-456d-8f89-d9ac701512d2 tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c7701a6-6006-4823-aa5a-1850af370f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:32 devstack sudo[100996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:32 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-745d7c10-b156-456d-8f89-d9ac701512d2 tempest-CreateVolumesFromImageTest-617874580 None] Volume volume-3571150e-b829-480c-98d7-63244f74e20e (3571150e-b829-480c-98d7-63244f74e20e): created successfully Aug 28 09:44:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-745d7c10-b156-456d-8f89-d9ac701512d2 tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c7701a6-6006-4823-aa5a-1850af370f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-745d7c10-b156-456d-8f89-d9ac701512d2 tempest-CreateVolumesFromImageTest-617874580 None] Flow 'volume_create_manager' (1282368e-a181-450d-a4aa-93a60bebea52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:44:32 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-745d7c10-b156-456d-8f89-d9ac701512d2 tempest-CreateVolumesFromImageTest-617874580 None] Created volume successfully. Aug 28 09:44:32 devstack sudo[100996]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5ef415c7-2dc2-4c24-9b61-293435d13988 tempest-CreateVolumesFromSnapshotTest-1214825562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-99466e34-1f55-4726-92d0-aa978a197c25 1073741824" returned: 0 in 0.565s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5ef415c7-2dc2-4c24-9b61-293435d13988 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-99466e34-1f55-4726-92d0-aa978a197c25 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:32 devstack sudo[101002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-99466e34-1f55-4726-92d0-aa978a197c25 Aug 28 09:44:32 devstack sudo[101002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:33 devstack sudo[101002]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5ef415c7-2dc2-4c24-9b61-293435d13988 tempest-CreateVolumesFromSnapshotTest-1214825562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-99466e34-1f55-4726-92d0-aa978a197c25" returned: 0 in 0.339s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:33 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-5ef415c7-2dc2-4c24-9b61-293435d13988 tempest-CreateVolumesFromSnapshotTest-1214825562 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:44:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-5ef415c7-2dc2-4c24-9b61-293435d13988 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f8084ad9-aa39-4b6d-bb36-826787b46060 tempest-CreateVolumesFromImageTest-617874580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.788s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:33 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-f8084ad9-aa39-4b6d-bb36-826787b46060 tempest-CreateVolumesFromImageTest-617874580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:44:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1244975219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfa8af75-87f3-4435-b3e9-595f5f92d016,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad5ef28c467a4624879621d72a829ffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:44:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:44:29Z,use_quota=True,user_id='050839beb6d84937881dadd31ea4065f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:44:33 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-f8084ad9-aa39-4b6d-bb36-826787b46060 tempest-CreateVolumesFromImageTest-617874580 None] Creating volume cfa8af75-87f3-4435-b3e9-595f5f92d016 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:44:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f8084ad9-aa39-4b6d-bb36-826787b46060 tempest-CreateVolumesFromImageTest-617874580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f8084ad9-aa39-4b6d-bb36-826787b46060 tempest-CreateVolumesFromImageTest-617874580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:33 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-f8084ad9-aa39-4b6d-bb36-826787b46060 tempest-CreateVolumesFromImageTest-617874580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:44:33 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-f8084ad9-aa39-4b6d-bb36-826787b46060 tempest-CreateVolumesFromImageTest-617874580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:44:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f8084ad9-aa39-4b6d-bb36-826787b46060 tempest-CreateVolumesFromImageTest-617874580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:33 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-f8084ad9-aa39-4b6d-bb36-826787b46060 tempest-CreateVolumesFromImageTest-617874580 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:44:33 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-f8084ad9-aa39-4b6d-bb36-826787b46060 tempest-CreateVolumesFromImageTest-617874580 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:44:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f8084ad9-aa39-4b6d-bb36-826787b46060 tempest-CreateVolumesFromImageTest-617874580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cfa8af75-87f3-4435-b3e9-595f5f92d016 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:33 devstack sudo[101005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cfa8af75-87f3-4435-b3e9-595f5f92d016 1073741824 Aug 28 09:44:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5ef415c7-2dc2-4c24-9b61-293435d13988 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d959fb3-2267-45e1-80d8-994d141e0628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99466e34-1f55-4726-92d0-aa978a197c25', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:33 devstack sudo[101005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5ef415c7-2dc2-4c24-9b61-293435d13988 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7b4a5ef-d868-4291-a0d1-56788991b687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:33 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-5ef415c7-2dc2-4c24-9b61-293435d13988 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Volume volume-99466e34-1f55-4726-92d0-aa978a197c25 (99466e34-1f55-4726-92d0-aa978a197c25): created successfully Aug 28 09:44:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5ef415c7-2dc2-4c24-9b61-293435d13988 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7b4a5ef-d868-4291-a0d1-56788991b687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5ef415c7-2dc2-4c24-9b61-293435d13988 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Flow 'volume_create_manager' (87cd0452-919f-4eba-bea8-e162f2cdad65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:44:33 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-5ef415c7-2dc2-4c24-9b61-293435d13988 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Created volume successfully. Aug 28 09:44:33 devstack sudo[101005]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f8084ad9-aa39-4b6d-bb36-826787b46060 tempest-CreateVolumesFromImageTest-617874580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cfa8af75-87f3-4435-b3e9-595f5f92d016 1073741824" returned: 0 in 0.564s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f8084ad9-aa39-4b6d-bb36-826787b46060 tempest-CreateVolumesFromImageTest-617874580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cfa8af75-87f3-4435-b3e9-595f5f92d016 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:33 devstack sudo[101010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cfa8af75-87f3-4435-b3e9-595f5f92d016 Aug 28 09:44:33 devstack sudo[101010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:34 devstack sudo[101010]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f8084ad9-aa39-4b6d-bb36-826787b46060 tempest-CreateVolumesFromImageTest-617874580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cfa8af75-87f3-4435-b3e9-595f5f92d016" returned: 0 in 0.294s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:34 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-f8084ad9-aa39-4b6d-bb36-826787b46060 tempest-CreateVolumesFromImageTest-617874580 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:44:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f8084ad9-aa39-4b6d-bb36-826787b46060 tempest-CreateVolumesFromImageTest-617874580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-205f8aca-61a9-407c-b6a0-d37e9ef6f401 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.594s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:34 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-205f8aca-61a9-407c-b6a0-d37e9ef6f401 tempest-CreateVolumesFromSnapshotTest-1214825562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:44:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1820913591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a825f91b-0004-4296-a42f-0c853658e1ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22686c85866b45288b7094eb71842c0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:44:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:44:29Z,use_quota=True,user_id='9d4d9d8070eb489e90ea9e839df57ab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:44:34 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-205f8aca-61a9-407c-b6a0-d37e9ef6f401 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Creating volume a825f91b-0004-4296-a42f-0c853658e1ee {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:44:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-205f8aca-61a9-407c-b6a0-d37e9ef6f401 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-205f8aca-61a9-407c-b6a0-d37e9ef6f401 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:34 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-205f8aca-61a9-407c-b6a0-d37e9ef6f401 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:44:34 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-205f8aca-61a9-407c-b6a0-d37e9ef6f401 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:44:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-205f8aca-61a9-407c-b6a0-d37e9ef6f401 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:34 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-205f8aca-61a9-407c-b6a0-d37e9ef6f401 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:44:34 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-205f8aca-61a9-407c-b6a0-d37e9ef6f401 tempest-CreateVolumesFromSnapshotTest-1214825562 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:44:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-205f8aca-61a9-407c-b6a0-d37e9ef6f401 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a825f91b-0004-4296-a42f-0c853658e1ee 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:34 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f8084ad9-aa39-4b6d-bb36-826787b46060 tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (692b4d97-7e1a-48c7-a1d6-98dd31e67e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfa8af75-87f3-4435-b3e9-595f5f92d016', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:34 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f8084ad9-aa39-4b6d-bb36-826787b46060 tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59097a42-eb34-4d8d-8d03-1e571f538d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:34 devstack sudo[101013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a825f91b-0004-4296-a42f-0c853658e1ee 1073741824 Aug 28 09:44:34 devstack sudo[101013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:34 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-f8084ad9-aa39-4b6d-bb36-826787b46060 tempest-CreateVolumesFromImageTest-617874580 None] Volume volume-cfa8af75-87f3-4435-b3e9-595f5f92d016 (cfa8af75-87f3-4435-b3e9-595f5f92d016): created successfully Aug 28 09:44:34 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f8084ad9-aa39-4b6d-bb36-826787b46060 tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59097a42-eb34-4d8d-8d03-1e571f538d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:34 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f8084ad9-aa39-4b6d-bb36-826787b46060 tempest-CreateVolumesFromImageTest-617874580 None] Flow 'volume_create_manager' (75dbf437-f0b0-4338-ba95-231e20a61a6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:44:34 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-f8084ad9-aa39-4b6d-bb36-826787b46060 tempest-CreateVolumesFromImageTest-617874580 None] Created volume successfully. Aug 28 09:44:34 devstack sudo[101013]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-205f8aca-61a9-407c-b6a0-d37e9ef6f401 tempest-CreateVolumesFromSnapshotTest-1214825562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a825f91b-0004-4296-a42f-0c853658e1ee 1073741824" returned: 0 in 0.614s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-205f8aca-61a9-407c-b6a0-d37e9ef6f401 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a825f91b-0004-4296-a42f-0c853658e1ee {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:34 devstack sudo[101021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a825f91b-0004-4296-a42f-0c853658e1ee Aug 28 09:44:34 devstack sudo[101021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:35 devstack sudo[101021]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-205f8aca-61a9-407c-b6a0-d37e9ef6f401 tempest-CreateVolumesFromSnapshotTest-1214825562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a825f91b-0004-4296-a42f-0c853658e1ee" returned: 0 in 0.407s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:35 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-205f8aca-61a9-407c-b6a0-d37e9ef6f401 tempest-CreateVolumesFromSnapshotTest-1214825562 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:44:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-205f8aca-61a9-407c-b6a0-d37e9ef6f401 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-72466fd1-5f05-4102-89a3-ec109c23f1bb tempest-CreateVolumesFromImageTest-617874580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.085s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:35 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-72466fd1-5f05-4102-89a3-ec109c23f1bb tempest-CreateVolumesFromImageTest-617874580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:44:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-167713503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81d589ed-b2e3-47e5-a1b2-4324c348e778,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad5ef28c467a4624879621d72a829ffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:44:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:44:30Z,use_quota=True,user_id='050839beb6d84937881dadd31ea4065f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:44:35 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-72466fd1-5f05-4102-89a3-ec109c23f1bb tempest-CreateVolumesFromImageTest-617874580 None] Creating volume 81d589ed-b2e3-47e5-a1b2-4324c348e778 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:44:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-72466fd1-5f05-4102-89a3-ec109c23f1bb tempest-CreateVolumesFromImageTest-617874580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-72466fd1-5f05-4102-89a3-ec109c23f1bb tempest-CreateVolumesFromImageTest-617874580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:35 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-72466fd1-5f05-4102-89a3-ec109c23f1bb tempest-CreateVolumesFromImageTest-617874580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:44:35 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-72466fd1-5f05-4102-89a3-ec109c23f1bb tempest-CreateVolumesFromImageTest-617874580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:44:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-72466fd1-5f05-4102-89a3-ec109c23f1bb tempest-CreateVolumesFromImageTest-617874580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:35 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-72466fd1-5f05-4102-89a3-ec109c23f1bb tempest-CreateVolumesFromImageTest-617874580 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:44:35 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-72466fd1-5f05-4102-89a3-ec109c23f1bb tempest-CreateVolumesFromImageTest-617874580 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:44:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-72466fd1-5f05-4102-89a3-ec109c23f1bb tempest-CreateVolumesFromImageTest-617874580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-81d589ed-b2e3-47e5-a1b2-4324c348e778 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:35 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-205f8aca-61a9-407c-b6a0-d37e9ef6f401 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fed8fe3-3e9a-4eb2-9ad0-f6c353d79429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a825f91b-0004-4296-a42f-0c853658e1ee', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:35 devstack sudo[101024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-81d589ed-b2e3-47e5-a1b2-4324c348e778 1073741824 Aug 28 09:44:35 devstack sudo[101024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:35 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-205f8aca-61a9-407c-b6a0-d37e9ef6f401 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5d17814-4e9e-4395-9f42-78067065d294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:35 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-205f8aca-61a9-407c-b6a0-d37e9ef6f401 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Volume volume-a825f91b-0004-4296-a42f-0c853658e1ee (a825f91b-0004-4296-a42f-0c853658e1ee): created successfully Aug 28 09:44:35 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-205f8aca-61a9-407c-b6a0-d37e9ef6f401 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5d17814-4e9e-4395-9f42-78067065d294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:35 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-205f8aca-61a9-407c-b6a0-d37e9ef6f401 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Flow 'volume_create_manager' (7322ec71-4413-42cc-be0a-87361ce0a8a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:44:35 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-205f8aca-61a9-407c-b6a0-d37e9ef6f401 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Created volume successfully. Aug 28 09:44:35 devstack sudo[101024]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-72466fd1-5f05-4102-89a3-ec109c23f1bb tempest-CreateVolumesFromImageTest-617874580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-81d589ed-b2e3-47e5-a1b2-4324c348e778 1073741824" returned: 0 in 0.473s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-72466fd1-5f05-4102-89a3-ec109c23f1bb tempest-CreateVolumesFromImageTest-617874580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-81d589ed-b2e3-47e5-a1b2-4324c348e778 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:35 devstack sudo[101030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-81d589ed-b2e3-47e5-a1b2-4324c348e778 Aug 28 09:44:35 devstack sudo[101030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:35 devstack sudo[101030]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-72466fd1-5f05-4102-89a3-ec109c23f1bb tempest-CreateVolumesFromImageTest-617874580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-81d589ed-b2e3-47e5-a1b2-4324c348e778" returned: 0 in 0.266s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:35 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-72466fd1-5f05-4102-89a3-ec109c23f1bb tempest-CreateVolumesFromImageTest-617874580 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:44:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-72466fd1-5f05-4102-89a3-ec109c23f1bb tempest-CreateVolumesFromImageTest-617874580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-2991c7da-8e0f-4075-b66b-8c314dafc147 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.626s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:35 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-2991c7da-8e0f-4075-b66b-8c314dafc147 tempest-CreateVolumesFromSnapshotTest-1214825562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:44:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-91604748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d68a2d6-0495-4af8-92b2-044344107dcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22686c85866b45288b7094eb71842c0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:44:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:44:30Z,use_quota=True,user_id='9d4d9d8070eb489e90ea9e839df57ab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:44:35 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-2991c7da-8e0f-4075-b66b-8c314dafc147 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Creating volume 3d68a2d6-0495-4af8-92b2-044344107dcf {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:44:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-2991c7da-8e0f-4075-b66b-8c314dafc147 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-2991c7da-8e0f-4075-b66b-8c314dafc147 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:35 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-2991c7da-8e0f-4075-b66b-8c314dafc147 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:44:35 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-2991c7da-8e0f-4075-b66b-8c314dafc147 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:44:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-2991c7da-8e0f-4075-b66b-8c314dafc147 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:35 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-2991c7da-8e0f-4075-b66b-8c314dafc147 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:44:35 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-2991c7da-8e0f-4075-b66b-8c314dafc147 tempest-CreateVolumesFromSnapshotTest-1214825562 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:44:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2991c7da-8e0f-4075-b66b-8c314dafc147 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3d68a2d6-0495-4af8-92b2-044344107dcf 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:36 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-72466fd1-5f05-4102-89a3-ec109c23f1bb tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55ebc728-9110-4593-bcd0-5e71d572b14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81d589ed-b2e3-47e5-a1b2-4324c348e778', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:36 devstack sudo[101033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3d68a2d6-0495-4af8-92b2-044344107dcf 1073741824 Aug 28 09:44:36 devstack sudo[101033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:36 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-72466fd1-5f05-4102-89a3-ec109c23f1bb tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85e5be61-5c98-43c7-bc5b-8b99d0bcb3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:36 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-72466fd1-5f05-4102-89a3-ec109c23f1bb tempest-CreateVolumesFromImageTest-617874580 None] Volume volume-81d589ed-b2e3-47e5-a1b2-4324c348e778 (81d589ed-b2e3-47e5-a1b2-4324c348e778): created successfully Aug 28 09:44:36 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-72466fd1-5f05-4102-89a3-ec109c23f1bb tempest-CreateVolumesFromImageTest-617874580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85e5be61-5c98-43c7-bc5b-8b99d0bcb3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:36 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-72466fd1-5f05-4102-89a3-ec109c23f1bb tempest-CreateVolumesFromImageTest-617874580 None] Flow 'volume_create_manager' (2802a20d-bb3b-4764-b808-736b04c148ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:44:36 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-72466fd1-5f05-4102-89a3-ec109c23f1bb tempest-CreateVolumesFromImageTest-617874580 None] Created volume successfully. Aug 28 09:44:36 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-d983f93a-cdda-4c52-8b15-a2060a4ae679 tempest-CreateVolumesFromImageTest-617874580 None] Acquiring lock "cinder-81d589ed-b2e3-47e5-a1b2-4324c348e778-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:44:36 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-d983f93a-cdda-4c52-8b15-a2060a4ae679 tempest-CreateVolumesFromImageTest-617874580 None] Lock "cinder-81d589ed-b2e3-47e5-a1b2-4324c348e778-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:44:36 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-d983f93a-cdda-4c52-8b15-a2060a4ae679 tempest-CreateVolumesFromImageTest-617874580 None] Acquiring lock "cinder-quobyte-81d589ed-b2e3-47e5-a1b2-4324c348e778" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:44:36 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-d983f93a-cdda-4c52-8b15-a2060a4ae679 tempest-CreateVolumesFromImageTest-617874580 None] Lock "cinder-quobyte-81d589ed-b2e3-47e5-a1b2-4324c348e778" acquired by "delete_volume" :: waited 0.030s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:44:36 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[6485ed68-ae84-4b9f-bf87-9cb784beeff5]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:44:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d983f93a-cdda-4c52-8b15-a2060a4ae679 tempest-CreateVolumesFromImageTest-617874580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-81d589ed-b2e3-47e5-a1b2-4324c348e778 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:36 devstack sudo[101033]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2991c7da-8e0f-4075-b66b-8c314dafc147 tempest-CreateVolumesFromSnapshotTest-1214825562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3d68a2d6-0495-4af8-92b2-044344107dcf 1073741824" returned: 0 in 0.776s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:36 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-64d2ed94-ed2c-4d3b-8085-269b0164597e tempest-VolumesCloneTest-1631533682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:44:36 devstack sudo[101038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-81d589ed-b2e3-47e5-a1b2-4324c348e778 Aug 28 09:44:36 devstack sudo[101038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:36 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-64d2ed94-ed2c-4d3b-8085-269b0164597e tempest-VolumesCloneTest-1631533682 None] Flow 'volume_create_manager' (2b11718b-8354-4630-876e-c3832e381e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:44:36 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-64d2ed94-ed2c-4d3b-8085-269b0164597e tempest-VolumesCloneTest-1631533682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c349bc2-89b2-4591-a801-dc8c56807a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:36 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-64d2ed94-ed2c-4d3b-8085-269b0164597e tempest-VolumesCloneTest-1631533682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c349bc2-89b2-4591-a801-dc8c56807a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:44:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1162839495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aa4063884cd4430b6e887a1867cd88c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:44:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:44:37Z,use_quota=True,user_id='6d8e20a71d5e4a8992a53b73b6ac8c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:36 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-64d2ed94-ed2c-4d3b-8085-269b0164597e tempest-VolumesCloneTest-1631533682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9337db13-e007-4669-9683-527d3062dec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:36 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-64d2ed94-ed2c-4d3b-8085-269b0164597e tempest-VolumesCloneTest-1631533682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9337db13-e007-4669-9683-527d3062dec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:36 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-64d2ed94-ed2c-4d3b-8085-269b0164597e tempest-VolumesCloneTest-1631533682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9378da5e-24d2-46d5-ac60-2f65cd5c8dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:36 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-64d2ed94-ed2c-4d3b-8085-269b0164597e tempest-VolumesCloneTest-1631533682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9378da5e-24d2-46d5-ac60-2f65cd5c8dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2', 'volume_name': 'volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:36 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-64d2ed94-ed2c-4d3b-8085-269b0164597e tempest-VolumesCloneTest-1631533682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26ccb156-a852-49bf-bf11-0b87e2180b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:36 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-64d2ed94-ed2c-4d3b-8085-269b0164597e tempest-VolumesCloneTest-1631533682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26ccb156-a852-49bf-bf11-0b87e2180b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:36 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-64d2ed94-ed2c-4d3b-8085-269b0164597e tempest-VolumesCloneTest-1631533682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e5d3a6a-805b-4675-bb61-518c87ab2c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:36 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-64d2ed94-ed2c-4d3b-8085-269b0164597e tempest-VolumesCloneTest-1631533682 None] Volume a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2', 'volume_size': 1} Aug 28 09:44:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-64d2ed94-ed2c-4d3b-8085-269b0164597e tempest-VolumesCloneTest-1631533682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2991c7da-8e0f-4075-b66b-8c314dafc147 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3d68a2d6-0495-4af8-92b2-044344107dcf {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:36 devstack sudo[101040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3d68a2d6-0495-4af8-92b2-044344107dcf Aug 28 09:44:36 devstack sudo[101040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:37 devstack sudo[101038]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d983f93a-cdda-4c52-8b15-a2060a4ae679 tempest-CreateVolumesFromImageTest-617874580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-81d589ed-b2e3-47e5-a1b2-4324c348e778" returned: 0 in 0.426s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d983f93a-cdda-4c52-8b15-a2060a4ae679 tempest-CreateVolumesFromImageTest-617874580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-81d589ed-b2e3-47e5-a1b2-4324c348e778 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:37 devstack sudo[101045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-81d589ed-b2e3-47e5-a1b2-4324c348e778 Aug 28 09:44:37 devstack sudo[101045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:37 devstack sudo[101040]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2991c7da-8e0f-4075-b66b-8c314dafc147 tempest-CreateVolumesFromSnapshotTest-1214825562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3d68a2d6-0495-4af8-92b2-044344107dcf" returned: 0 in 0.278s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:37 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-2991c7da-8e0f-4075-b66b-8c314dafc147 tempest-CreateVolumesFromSnapshotTest-1214825562 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:44:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-2991c7da-8e0f-4075-b66b-8c314dafc147 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8866b0a4-6532-490d-86e1-ee473d9764a9 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.548s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:37 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-8866b0a4-6532-490d-86e1-ee473d9764a9 tempest-CreateVolumesFromSnapshotTest-1214825562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:44:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1590478959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b87abecf-e162-4b61-8131-cd8d5e7c54cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22686c85866b45288b7094eb71842c0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:44:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:44:30Z,use_quota=True,user_id='9d4d9d8070eb489e90ea9e839df57ab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:44:37 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-8866b0a4-6532-490d-86e1-ee473d9764a9 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Creating volume b87abecf-e162-4b61-8131-cd8d5e7c54cd {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:44:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8866b0a4-6532-490d-86e1-ee473d9764a9 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8866b0a4-6532-490d-86e1-ee473d9764a9 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:37 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-8866b0a4-6532-490d-86e1-ee473d9764a9 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:44:37 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-8866b0a4-6532-490d-86e1-ee473d9764a9 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:44:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8866b0a4-6532-490d-86e1-ee473d9764a9 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:37 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-8866b0a4-6532-490d-86e1-ee473d9764a9 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:44:37 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-8866b0a4-6532-490d-86e1-ee473d9764a9 tempest-CreateVolumesFromSnapshotTest-1214825562 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:44:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8866b0a4-6532-490d-86e1-ee473d9764a9 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b87abecf-e162-4b61-8131-cd8d5e7c54cd 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:37 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2991c7da-8e0f-4075-b66b-8c314dafc147 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fe5b1ee-57ce-40bd-ab8f-94bf9d939db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d68a2d6-0495-4af8-92b2-044344107dcf', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:37 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2991c7da-8e0f-4075-b66b-8c314dafc147 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4eff3cc-cde0-424f-ab76-04b2a4f9cf3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:37 devstack sudo[101048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b87abecf-e162-4b61-8131-cd8d5e7c54cd 1073741824 Aug 28 09:44:37 devstack sudo[101048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:37 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-2991c7da-8e0f-4075-b66b-8c314dafc147 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Volume volume-3d68a2d6-0495-4af8-92b2-044344107dcf (3d68a2d6-0495-4af8-92b2-044344107dcf): created successfully Aug 28 09:44:37 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2991c7da-8e0f-4075-b66b-8c314dafc147 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4eff3cc-cde0-424f-ab76-04b2a4f9cf3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:37 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2991c7da-8e0f-4075-b66b-8c314dafc147 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Flow 'volume_create_manager' (a563a943-0ad2-4228-b2b2-6dfca5d1676f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:44:37 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-2991c7da-8e0f-4075-b66b-8c314dafc147 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Created volume successfully. Aug 28 09:44:37 devstack sudo[101045]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d983f93a-cdda-4c52-8b15-a2060a4ae679 tempest-CreateVolumesFromImageTest-617874580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-81d589ed-b2e3-47e5-a1b2-4324c348e778" returned: 0 in 0.296s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:37 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-d983f93a-cdda-4c52-8b15-a2060a4ae679 tempest-CreateVolumesFromImageTest-617874580 None] Lock "cinder-quobyte-81d589ed-b2e3-47e5-a1b2-4324c348e778" released by "delete_volume" :: held 0.776s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:44:37 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-d983f93a-cdda-4c52-8b15-a2060a4ae679 tempest-CreateVolumesFromImageTest-617874580 None] Created reservations ['7a106bec-1e01-4616-a937-30472ffe8be9', 'c46b42df-aeea-4eaa-83b0-e102ea5fef39', '5f16e109-1f4d-4bff-96b4-3bccd6cfdf0d', 'd0f5dfc1-55e7-47e1-87bf-d48c4978c069'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:44:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-d983f93a-cdda-4c52-8b15-a2060a4ae679 tempest-CreateVolumesFromImageTest-617874580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-d983f93a-cdda-4c52-8b15-a2060a4ae679 tempest-CreateVolumesFromImageTest-617874580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:37 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-d983f93a-cdda-4c52-8b15-a2060a4ae679 tempest-CreateVolumesFromImageTest-617874580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:44:37 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-d983f93a-cdda-4c52-8b15-a2060a4ae679 tempest-CreateVolumesFromImageTest-617874580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:44:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-d983f93a-cdda-4c52-8b15-a2060a4ae679 tempest-CreateVolumesFromImageTest-617874580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d983f93a-cdda-4c52-8b15-a2060a4ae679 tempest-CreateVolumesFromImageTest-617874580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:37 devstack sudo[101054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:44:37 devstack sudo[101054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:37 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-7ffd4946-3ba1-424b-9d27-d1b4eefe8ead tempest-CreateVolumesFromImageTest-617874580 None] Acquiring lock "cinder-cfa8af75-87f3-4435-b3e9-595f5f92d016-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:44:37 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-7ffd4946-3ba1-424b-9d27-d1b4eefe8ead tempest-CreateVolumesFromImageTest-617874580 None] Lock "cinder-cfa8af75-87f3-4435-b3e9-595f5f92d016-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:44:37 devstack sudo[101048]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8866b0a4-6532-490d-86e1-ee473d9764a9 tempest-CreateVolumesFromSnapshotTest-1214825562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b87abecf-e162-4b61-8131-cd8d5e7c54cd 1073741824" returned: 0 in 0.678s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:37 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-7ffd4946-3ba1-424b-9d27-d1b4eefe8ead tempest-CreateVolumesFromImageTest-617874580 None] Acquiring lock "cinder-quobyte-cfa8af75-87f3-4435-b3e9-595f5f92d016" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:44:37 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-7ffd4946-3ba1-424b-9d27-d1b4eefe8ead tempest-CreateVolumesFromImageTest-617874580 None] Lock "cinder-quobyte-cfa8af75-87f3-4435-b3e9-595f5f92d016" acquired by "delete_volume" :: waited 0.040s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:44:37 devstack sudo[101054]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8866b0a4-6532-490d-86e1-ee473d9764a9 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b87abecf-e162-4b61-8131-cd8d5e7c54cd {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d983f93a-cdda-4c52-8b15-a2060a4ae679 tempest-CreateVolumesFromImageTest-617874580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.439s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:38 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-d983f93a-cdda-4c52-8b15-a2060a4ae679 tempest-CreateVolumesFromImageTest-617874580 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:44:38 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[516ef96f-65bc-4863-bb1f-cacfaae6821c]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:44:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7ffd4946-3ba1-424b-9d27-d1b4eefe8ead tempest-CreateVolumesFromImageTest-617874580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cfa8af75-87f3-4435-b3e9-595f5f92d016 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:38 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-d983f93a-cdda-4c52-8b15-a2060a4ae679 tempest-CreateVolumesFromImageTest-617874580 None] Deleted volume successfully. Aug 28 09:44:38 devstack sudo[101058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b87abecf-e162-4b61-8131-cd8d5e7c54cd Aug 28 09:44:38 devstack sudo[101058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:38 devstack cinder-volume[86081]: DEBUG oslo_service.periodic_task [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86081) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:44:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:44:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:44:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:38 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-d983f93a-cdda-4c52-8b15-a2060a4ae679 tempest-CreateVolumesFromImageTest-617874580 None] Lock "cinder-81d589ed-b2e3-47e5-a1b2-4324c348e778-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:44:38 devstack sudo[101061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:44:38 devstack sudo[101061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:38 devstack sudo[101059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cfa8af75-87f3-4435-b3e9-595f5f92d016 Aug 28 09:44:38 devstack sudo[101059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:38 devstack sudo[101058]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8866b0a4-6532-490d-86e1-ee473d9764a9 tempest-CreateVolumesFromSnapshotTest-1214825562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b87abecf-e162-4b61-8131-cd8d5e7c54cd" returned: 0 in 0.357s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-8866b0a4-6532-490d-86e1-ee473d9764a9 tempest-CreateVolumesFromSnapshotTest-1214825562 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:44:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8866b0a4-6532-490d-86e1-ee473d9764a9 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-64d2ed94-ed2c-4d3b-8085-269b0164597e tempest-VolumesCloneTest-1631533682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.471s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-64d2ed94-ed2c-4d3b-8085-269b0164597e tempest-VolumesCloneTest-1631533682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:44:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1162839495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aa4063884cd4430b6e887a1867cd88c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:44:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:44:37Z,use_quota=True,user_id='6d8e20a71d5e4a8992a53b73b6ac8c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:44:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-64d2ed94-ed2c-4d3b-8085-269b0164597e tempest-VolumesCloneTest-1631533682 None] Creating volume a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:44:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-64d2ed94-ed2c-4d3b-8085-269b0164597e tempest-VolumesCloneTest-1631533682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-64d2ed94-ed2c-4d3b-8085-269b0164597e tempest-VolumesCloneTest-1631533682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-64d2ed94-ed2c-4d3b-8085-269b0164597e tempest-VolumesCloneTest-1631533682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:44:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-64d2ed94-ed2c-4d3b-8085-269b0164597e tempest-VolumesCloneTest-1631533682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:44:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-64d2ed94-ed2c-4d3b-8085-269b0164597e tempest-VolumesCloneTest-1631533682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-64d2ed94-ed2c-4d3b-8085-269b0164597e tempest-VolumesCloneTest-1631533682 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:44:38 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-64d2ed94-ed2c-4d3b-8085-269b0164597e tempest-VolumesCloneTest-1631533682 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:44:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-64d2ed94-ed2c-4d3b-8085-269b0164597e tempest-VolumesCloneTest-1631533682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:38 devstack sudo[101068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2 1073741824 Aug 28 09:44:38 devstack sudo[101068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8866b0a4-6532-490d-86e1-ee473d9764a9 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34f78fdc-2b6e-48d8-95c6-a70cfa2f1659) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b87abecf-e162-4b61-8131-cd8d5e7c54cd', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:38 devstack sudo[101059]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8866b0a4-6532-490d-86e1-ee473d9764a9 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc30025c-105d-4d0e-9112-1b77e3e2c888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:38 devstack sudo[101061]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7ffd4946-3ba1-424b-9d27-d1b4eefe8ead tempest-CreateVolumesFromImageTest-617874580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cfa8af75-87f3-4435-b3e9-595f5f92d016" returned: 0 in 0.515s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7ffd4946-3ba1-424b-9d27-d1b4eefe8ead tempest-CreateVolumesFromImageTest-617874580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cfa8af75-87f3-4435-b3e9-595f5f92d016 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:38 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-8866b0a4-6532-490d-86e1-ee473d9764a9 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Volume volume-b87abecf-e162-4b61-8131-cd8d5e7c54cd (b87abecf-e162-4b61-8131-cd8d5e7c54cd): created successfully Aug 28 09:44:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8866b0a4-6532-490d-86e1-ee473d9764a9 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc30025c-105d-4d0e-9112-1b77e3e2c888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8866b0a4-6532-490d-86e1-ee473d9764a9 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Flow 'volume_create_manager' (4db6321d-d74c-4170-8ca8-5609f928ba07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:44:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.484s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:38 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:44:38 devstack sudo[101071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cfa8af75-87f3-4435-b3e9-595f5f92d016 Aug 28 09:44:38 devstack cinder-volume[86081]: DEBUG oslo_service.periodic_task [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running periodic task VolumeManager._thread_info {{(pid=86081) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:44:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] thread count: 28 {{(pid=86081) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 09:44:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] thread info: [<_MainThread(MainThread, started 129914189705344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86081) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 09:44:38 devstack sudo[101071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:38 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-8866b0a4-6532-490d-86e1-ee473d9764a9 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Created volume successfully. Aug 28 09:44:38 devstack sudo[101071]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7ffd4946-3ba1-424b-9d27-d1b4eefe8ead tempest-CreateVolumesFromImageTest-617874580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cfa8af75-87f3-4435-b3e9-595f5f92d016" returned: 0 in 0.356s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:38 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-7ffd4946-3ba1-424b-9d27-d1b4eefe8ead tempest-CreateVolumesFromImageTest-617874580 None] Lock "cinder-quobyte-cfa8af75-87f3-4435-b3e9-595f5f92d016" released by "delete_volume" :: held 0.940s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:44:38 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-7ffd4946-3ba1-424b-9d27-d1b4eefe8ead tempest-CreateVolumesFromImageTest-617874580 None] Created reservations ['63846820-f7b1-4997-ab51-5763adafeaac', '81bc4328-faf7-4739-aca2-e92177be2797', 'e6dd52e5-6243-4946-93eb-9427f15b0282', '07f4e91a-ff45-4b2a-8f44-bd26ab179de1'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:44:39 devstack sudo[101068]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-64d2ed94-ed2c-4d3b-8085-269b0164597e tempest-VolumesCloneTest-1631533682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2 1073741824" returned: 0 in 0.645s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-64d2ed94-ed2c-4d3b-8085-269b0164597e tempest-VolumesCloneTest-1631533682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-7ffd4946-3ba1-424b-9d27-d1b4eefe8ead tempest-CreateVolumesFromImageTest-617874580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-7ffd4946-3ba1-424b-9d27-d1b4eefe8ead tempest-CreateVolumesFromImageTest-617874580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:39 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-7ffd4946-3ba1-424b-9d27-d1b4eefe8ead tempest-CreateVolumesFromImageTest-617874580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:44:39 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-7ffd4946-3ba1-424b-9d27-d1b4eefe8ead tempest-CreateVolumesFromImageTest-617874580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:44:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-7ffd4946-3ba1-424b-9d27-d1b4eefe8ead tempest-CreateVolumesFromImageTest-617874580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:39 devstack sudo[101078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2 Aug 28 09:44:39 devstack sudo[101078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7ffd4946-3ba1-424b-9d27-d1b4eefe8ead tempest-CreateVolumesFromImageTest-617874580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:39 devstack sudo[101081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:44:39 devstack sudo[101081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:39 devstack sudo[101078]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-64d2ed94-ed2c-4d3b-8085-269b0164597e tempest-VolumesCloneTest-1631533682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2" returned: 0 in 0.327s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:39 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-64d2ed94-ed2c-4d3b-8085-269b0164597e tempest-VolumesCloneTest-1631533682 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:44:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-64d2ed94-ed2c-4d3b-8085-269b0164597e tempest-VolumesCloneTest-1631533682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:39 devstack sudo[101081]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:39 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-64d2ed94-ed2c-4d3b-8085-269b0164597e tempest-VolumesCloneTest-1631533682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e5d3a6a-805b-4675-bb61-518c87ab2c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:39 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-64d2ed94-ed2c-4d3b-8085-269b0164597e tempest-VolumesCloneTest-1631533682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53cf985d-84de-42c2-a4f6-145a0bfe9d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7ffd4946-3ba1-424b-9d27-d1b4eefe8ead tempest-CreateVolumesFromImageTest-617874580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.327s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:39 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-7ffd4946-3ba1-424b-9d27-d1b4eefe8ead tempest-CreateVolumesFromImageTest-617874580 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:44:39 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writing DB stats cinder:INSERT=62,cinder:UPDATE=203,cinder:SELECT=148,cinder:DELETE=19 {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:44:39 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-7ffd4946-3ba1-424b-9d27-d1b4eefe8ead tempest-CreateVolumesFromImageTest-617874580 None] Deleted volume successfully. Aug 28 09:44:39 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writing DB stats cinder:SELECT=157,cinder:INSERT=60,cinder:UPDATE=189,cinder:DELETE=17 {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:44:39 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-64d2ed94-ed2c-4d3b-8085-269b0164597e tempest-VolumesCloneTest-1631533682 None] Volume volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2 (a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2): created successfully Aug 28 09:44:39 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-64d2ed94-ed2c-4d3b-8085-269b0164597e tempest-VolumesCloneTest-1631533682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53cf985d-84de-42c2-a4f6-145a0bfe9d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:39 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-64d2ed94-ed2c-4d3b-8085-269b0164597e tempest-VolumesCloneTest-1631533682 None] Flow 'volume_create_manager' (2b11718b-8354-4630-876e-c3832e381e74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:44:39 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-7ffd4946-3ba1-424b-9d27-d1b4eefe8ead tempest-CreateVolumesFromImageTest-617874580 None] Lock "cinder-cfa8af75-87f3-4435-b3e9-595f5f92d016-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:44:39 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-64d2ed94-ed2c-4d3b-8085-269b0164597e tempest-VolumesCloneTest-1631533682 None] Created volume successfully. Aug 28 09:44:39 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-d9d0b5da-f27d-4fcd-b884-b01aa70ef3fe tempest-CreateVolumesFromSnapshotTest-1214825562 None] Acquiring lock "cinder-b87abecf-e162-4b61-8131-cd8d5e7c54cd-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:44:39 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-d9d0b5da-f27d-4fcd-b884-b01aa70ef3fe tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "cinder-b87abecf-e162-4b61-8131-cd8d5e7c54cd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:44:39 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-d9d0b5da-f27d-4fcd-b884-b01aa70ef3fe tempest-CreateVolumesFromSnapshotTest-1214825562 None] Acquiring lock "cinder-quobyte-b87abecf-e162-4b61-8131-cd8d5e7c54cd" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:44:39 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-d9d0b5da-f27d-4fcd-b884-b01aa70ef3fe tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "cinder-quobyte-b87abecf-e162-4b61-8131-cd8d5e7c54cd" acquired by "delete_volume" :: waited 0.027s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:44:39 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4ade1d-b952-4776-bd80-71c1aedb1605]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:44:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d9d0b5da-f27d-4fcd-b884-b01aa70ef3fe tempest-CreateVolumesFromSnapshotTest-1214825562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b87abecf-e162-4b61-8131-cd8d5e7c54cd {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:40 devstack sudo[101085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b87abecf-e162-4b61-8131-cd8d5e7c54cd Aug 28 09:44:40 devstack sudo[101085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:40 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c16e69db-bbb3-44dc-ba32-96a132dfc156 tempest-CreateVolumesFromImageTest-617874580 None] Acquiring lock "cinder-3571150e-b829-480c-98d7-63244f74e20e-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:44:40 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c16e69db-bbb3-44dc-ba32-96a132dfc156 tempest-CreateVolumesFromImageTest-617874580 None] Lock "cinder-3571150e-b829-480c-98d7-63244f74e20e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:44:40 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c16e69db-bbb3-44dc-ba32-96a132dfc156 tempest-CreateVolumesFromImageTest-617874580 None] Acquiring lock "cinder-quobyte-3571150e-b829-480c-98d7-63244f74e20e" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:44:40 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c16e69db-bbb3-44dc-ba32-96a132dfc156 tempest-CreateVolumesFromImageTest-617874580 None] Lock "cinder-quobyte-3571150e-b829-480c-98d7-63244f74e20e" acquired by "delete_volume" :: waited 0.020s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:44:40 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbde5dff-1019-418b-9862-05f8c951a796]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:44:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c16e69db-bbb3-44dc-ba32-96a132dfc156 tempest-CreateVolumesFromImageTest-617874580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3571150e-b829-480c-98d7-63244f74e20e {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:40 devstack sudo[101085]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d9d0b5da-f27d-4fcd-b884-b01aa70ef3fe tempest-CreateVolumesFromSnapshotTest-1214825562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b87abecf-e162-4b61-8131-cd8d5e7c54cd" returned: 0 in 0.442s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d9d0b5da-f27d-4fcd-b884-b01aa70ef3fe tempest-CreateVolumesFromSnapshotTest-1214825562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b87abecf-e162-4b61-8131-cd8d5e7c54cd {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:40 devstack sudo[101091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b87abecf-e162-4b61-8131-cd8d5e7c54cd Aug 28 09:44:40 devstack sudo[101091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:40 devstack sudo[101090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3571150e-b829-480c-98d7-63244f74e20e Aug 28 09:44:40 devstack sudo[101090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:40 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:44:40 devstack sudo[101091]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d9d0b5da-f27d-4fcd-b884-b01aa70ef3fe tempest-CreateVolumesFromSnapshotTest-1214825562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b87abecf-e162-4b61-8131-cd8d5e7c54cd" returned: 0 in 0.310s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:40 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] Flow 'volume_create_manager' (51644436-416f-4ca0-bb24-612468afecd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:44:40 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac6ea94d-c55d-4a65-b027-4c54ad7ab7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:40 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac6ea94d-c55d-4a65-b027-4c54ad7ab7e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-991669174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a77e461-d1f8-4f42-9e91-2c2d1d091f9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aa4063884cd4430b6e887a1867cd88c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:44:41Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2,status='creating',terminated_at=None,updated_at=2026-08-28T07:44:41Z,use_quota=True,user_id='6d8e20a71d5e4a8992a53b73b6ac8c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:40 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b8a9a22-86ce-40ed-859e-2f47d5db48e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:40 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b8a9a22-86ce-40ed-859e-2f47d5db48e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:40 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19ed14ba-a2b5-4b9a-b1da-581f780d2c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:40 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-d9d0b5da-f27d-4fcd-b884-b01aa70ef3fe tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "cinder-quobyte-b87abecf-e162-4b61-8131-cd8d5e7c54cd" released by "delete_volume" :: held 0.875s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:44:40 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19ed14ba-a2b5-4b9a-b1da-581f780d2c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '6a77e461-d1f8-4f42-9e91-2c2d1d091f9e', 'volume_name': 'volume-6a77e461-d1f8-4f42-9e91-2c2d1d091f9e', 'volume_size': 2, 'source_volid': 'a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2', 'source_volstatus': 'available'}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:40 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f5633d2-68a9-4da0-a45a-18363264bbdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:40 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f5633d2-68a9-4da0-a45a-18363264bbdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:40 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f268672-422b-4523-a629-b34012c600f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:40 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] Volume 6a77e461-d1f8-4f42-9e91-2c2d1d091f9e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-6a77e461-d1f8-4f42-9e91-2c2d1d091f9e', 'volume_size': 2, 'source_volid': 'a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2', 'source_volstatus': 'available'} Aug 28 09:44:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:40 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] Cloning volume a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2 to volume 6a77e461-d1f8-4f42-9e91-2c2d1d091f9e Aug 28 09:44:40 devstack sudo[101090]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c16e69db-bbb3-44dc-ba32-96a132dfc156 tempest-CreateVolumesFromImageTest-617874580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3571150e-b829-480c-98d7-63244f74e20e" returned: 0 in 0.516s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c16e69db-bbb3-44dc-ba32-96a132dfc156 tempest-CreateVolumesFromImageTest-617874580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3571150e-b829-480c-98d7-63244f74e20e {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:40 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] Creating offline snapshot 91074eee-c1ec-4432-8b15-8b4c17b2ed73 of volume a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2 {{(pid=86081) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:44:40 devstack sudo[101099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3571150e-b829-480c-98d7-63244f74e20e Aug 28 09:44:40 devstack sudo[101099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:40 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-d9d0b5da-f27d-4fcd-b884-b01aa70ef3fe tempest-CreateVolumesFromSnapshotTest-1214825562 None] Created reservations ['d8e8f9c3-7549-4299-8a26-82331ae11940', '81f61481-a9ea-46f0-9706-db44b1789551', 'a2cde55a-224e-42f4-88e3-91b4938a222b', '9cfe44c7-c972-46b2-bdad-7c576e6d9ccd'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:44:40 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[09991e9b-83bf-4b08-b62a-880249032261]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:44:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-d9d0b5da-f27d-4fcd-b884-b01aa70ef3fe tempest-CreateVolumesFromSnapshotTest-1214825562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-d9d0b5da-f27d-4fcd-b884-b01aa70ef3fe tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:40 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-d9d0b5da-f27d-4fcd-b884-b01aa70ef3fe tempest-CreateVolumesFromSnapshotTest-1214825562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:44:40 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-d9d0b5da-f27d-4fcd-b884-b01aa70ef3fe tempest-CreateVolumesFromSnapshotTest-1214825562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:44:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-d9d0b5da-f27d-4fcd-b884-b01aa70ef3fe tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d9d0b5da-f27d-4fcd-b884-b01aa70ef3fe tempest-CreateVolumesFromSnapshotTest-1214825562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:41 devstack sudo[101102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:44:41 devstack sudo[101102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:41 devstack sudo[101101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2 Aug 28 09:44:41 devstack sudo[101101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:41 devstack sudo[101099]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c16e69db-bbb3-44dc-ba32-96a132dfc156 tempest-CreateVolumesFromImageTest-617874580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3571150e-b829-480c-98d7-63244f74e20e" returned: 0 in 0.354s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:41 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c16e69db-bbb3-44dc-ba32-96a132dfc156 tempest-CreateVolumesFromImageTest-617874580 None] Lock "cinder-quobyte-3571150e-b829-480c-98d7-63244f74e20e" released by "delete_volume" :: held 0.922s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:44:41 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-c16e69db-bbb3-44dc-ba32-96a132dfc156 tempest-CreateVolumesFromImageTest-617874580 None] Created reservations ['aeb47930-1b70-4a6b-98d3-a440d45b4730', 'a3436793-a554-4b3f-b8c0-2401f62c61b8', 'c4cf2646-6272-401a-8b0f-9c86e96e73bd', '481a4489-4663-4ef3-9981-a707f5da647b'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:44:41 devstack sudo[101102]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d9d0b5da-f27d-4fcd-b884-b01aa70ef3fe tempest-CreateVolumesFromSnapshotTest-1214825562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.297s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:41 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-d9d0b5da-f27d-4fcd-b884-b01aa70ef3fe tempest-CreateVolumesFromSnapshotTest-1214825562 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:44:41 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-d9d0b5da-f27d-4fcd-b884-b01aa70ef3fe tempest-CreateVolumesFromSnapshotTest-1214825562 None] Deleted volume successfully. Aug 28 09:44:41 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-d9d0b5da-f27d-4fcd-b884-b01aa70ef3fe tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "cinder-b87abecf-e162-4b61-8131-cd8d5e7c54cd-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:44:41 devstack sudo[101101]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2" returned: 0 in 0.480s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2.91074eee-c1ec-4432-8b15-8b4c17b2ed73 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-c16e69db-bbb3-44dc-ba32-96a132dfc156 tempest-CreateVolumesFromImageTest-617874580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-c16e69db-bbb3-44dc-ba32-96a132dfc156 tempest-CreateVolumesFromImageTest-617874580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:41 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-c16e69db-bbb3-44dc-ba32-96a132dfc156 tempest-CreateVolumesFromImageTest-617874580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:44:41 devstack sudo[101110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2.91074eee-c1ec-4432-8b15-8b4c17b2ed73 1G Aug 28 09:44:41 devstack sudo[101110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:41 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-c16e69db-bbb3-44dc-ba32-96a132dfc156 tempest-CreateVolumesFromImageTest-617874580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:44:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-c16e69db-bbb3-44dc-ba32-96a132dfc156 tempest-CreateVolumesFromImageTest-617874580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c16e69db-bbb3-44dc-ba32-96a132dfc156 tempest-CreateVolumesFromImageTest-617874580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:41 devstack sudo[101112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:44:41 devstack sudo[101112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:41 devstack sudo[101112]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c16e69db-bbb3-44dc-ba32-96a132dfc156 tempest-CreateVolumesFromImageTest-617874580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.256s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:41 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-c16e69db-bbb3-44dc-ba32-96a132dfc156 tempest-CreateVolumesFromImageTest-617874580 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:44:41 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-c16e69db-bbb3-44dc-ba32-96a132dfc156 tempest-CreateVolumesFromImageTest-617874580 None] Deleted volume successfully. Aug 28 09:44:41 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c16e69db-bbb3-44dc-ba32-96a132dfc156 tempest-CreateVolumesFromImageTest-617874580 None] Lock "cinder-3571150e-b829-480c-98d7-63244f74e20e-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:44:41 devstack sudo[101110]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2.91074eee-c1ec-4432-8b15-8b4c17b2ed73 1G" returned: 0 in 0.472s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2.91074eee-c1ec-4432-8b15-8b4c17b2ed73 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:41 devstack sudo[101118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2.91074eee-c1ec-4432-8b15-8b4c17b2ed73 Aug 28 09:44:41 devstack sudo[101118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:42 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ce691ffb-3f0a-404b-8dc5-737e804afa46 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Acquiring lock "cinder-3d68a2d6-0495-4af8-92b2-044344107dcf-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:44:42 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ce691ffb-3f0a-404b-8dc5-737e804afa46 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "cinder-3d68a2d6-0495-4af8-92b2-044344107dcf-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:44:42 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ce691ffb-3f0a-404b-8dc5-737e804afa46 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Acquiring lock "cinder-quobyte-3d68a2d6-0495-4af8-92b2-044344107dcf" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:44:42 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ce691ffb-3f0a-404b-8dc5-737e804afa46 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "cinder-quobyte-3d68a2d6-0495-4af8-92b2-044344107dcf" acquired by "delete_volume" :: waited 0.020s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:44:42 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[79212379-6f49-48a9-a12b-1771f8d9f7be]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:44:42 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ce691ffb-3f0a-404b-8dc5-737e804afa46 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3d68a2d6-0495-4af8-92b2-044344107dcf {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:42 devstack sudo[101118]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:42 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2.91074eee-c1ec-4432-8b15-8b4c17b2ed73" returned: 0 in 0.346s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:42 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2.91074eee-c1ec-4432-8b15-8b4c17b2ed73 is being set with open permissions: ugo+rw Aug 28 09:44:42 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2.91074eee-c1ec-4432-8b15-8b4c17b2ed73 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:42 devstack sudo[101124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2.91074eee-c1ec-4432-8b15-8b4c17b2ed73 Aug 28 09:44:42 devstack sudo[101124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:42 devstack sudo[101123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3d68a2d6-0495-4af8-92b2-044344107dcf Aug 28 09:44:42 devstack sudo[101123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:42 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-91d89406-0bb6-49c0-bef7-68ac2e45d2d7 tempest-CreateVolumesFromImageTest-617874580 None] Acquiring lock "cinder-94ed7042-ddad-4b2a-81dd-624cb01e3e59-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:44:42 devstack sudo[101124]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:42 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2.91074eee-c1ec-4432-8b15-8b4c17b2ed73" returned: 0 in 0.350s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:42 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-91d89406-0bb6-49c0-bef7-68ac2e45d2d7 tempest-CreateVolumesFromImageTest-617874580 None] Lock "cinder-94ed7042-ddad-4b2a-81dd-624cb01e3e59-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:44:42 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:42 devstack sudo[101131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2.info Aug 28 09:44:42 devstack sudo[101131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:42 devstack sudo[101123]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:42 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ce691ffb-3f0a-404b-8dc5-737e804afa46 tempest-CreateVolumesFromSnapshotTest-1214825562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3d68a2d6-0495-4af8-92b2-044344107dcf" returned: 0 in 0.487s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:42 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ce691ffb-3f0a-404b-8dc5-737e804afa46 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3d68a2d6-0495-4af8-92b2-044344107dcf {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:42 devstack sudo[101134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3d68a2d6-0495-4af8-92b2-044344107dcf Aug 28 09:44:42 devstack sudo[101134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:42 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-91d89406-0bb6-49c0-bef7-68ac2e45d2d7 tempest-CreateVolumesFromImageTest-617874580 None] Acquiring lock "cinder-quobyte-94ed7042-ddad-4b2a-81dd-624cb01e3e59" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:44:42 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-91d89406-0bb6-49c0-bef7-68ac2e45d2d7 tempest-CreateVolumesFromImageTest-617874580 None] Lock "cinder-quobyte-94ed7042-ddad-4b2a-81dd-624cb01e3e59" acquired by "delete_volume" :: waited 0.033s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:44:42 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7559d87-748e-4bd8-9fe4-749622b23d85]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:44:42 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-91d89406-0bb6-49c0-bef7-68ac2e45d2d7 tempest-CreateVolumesFromImageTest-617874580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-94ed7042-ddad-4b2a-81dd-624cb01e3e59 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:42 devstack sudo[101136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-94ed7042-ddad-4b2a-81dd-624cb01e3e59 Aug 28 09:44:42 devstack sudo[101136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:43 devstack sudo[101134]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ce691ffb-3f0a-404b-8dc5-737e804afa46 tempest-CreateVolumesFromSnapshotTest-1214825562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3d68a2d6-0495-4af8-92b2-044344107dcf" returned: 0 in 0.387s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:43 devstack sudo[101131]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:43 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ce691ffb-3f0a-404b-8dc5-737e804afa46 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "cinder-quobyte-3d68a2d6-0495-4af8-92b2-044344107dcf" released by "delete_volume" :: held 0.930s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:44:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2.info" returned: 0 in 0.470s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:43 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2.info is being set with open permissions: ugo+rw Aug 28 09:44:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:43 devstack sudo[101140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2.info Aug 28 09:44:43 devstack sudo[101140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:43 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-ce691ffb-3f0a-404b-8dc5-737e804afa46 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Created reservations ['ab348b51-9181-4787-b5f8-fbe487bf22c7', '1596009f-a09c-4fe4-bc76-6a7af52a4908', 'bbda4f68-f874-4413-91a0-4fbe03116d16', '867da6eb-a827-4b25-b3c7-2a6be7dabf1f'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:44:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ce691ffb-3f0a-404b-8dc5-737e804afa46 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ce691ffb-3f0a-404b-8dc5-737e804afa46 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:43 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ce691ffb-3f0a-404b-8dc5-737e804afa46 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:44:43 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ce691ffb-3f0a-404b-8dc5-737e804afa46 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:44:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ce691ffb-3f0a-404b-8dc5-737e804afa46 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ce691ffb-3f0a-404b-8dc5-737e804afa46 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:43 devstack sudo[101145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:44:43 devstack sudo[101145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:43 devstack sudo[101136]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-91d89406-0bb6-49c0-bef7-68ac2e45d2d7 tempest-CreateVolumesFromImageTest-617874580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-94ed7042-ddad-4b2a-81dd-624cb01e3e59" returned: 0 in 0.556s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-91d89406-0bb6-49c0-bef7-68ac2e45d2d7 tempest-CreateVolumesFromImageTest-617874580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-94ed7042-ddad-4b2a-81dd-624cb01e3e59 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:43 devstack sudo[101148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-94ed7042-ddad-4b2a-81dd-624cb01e3e59 Aug 28 09:44:43 devstack sudo[101148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:43 devstack sudo[101140]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2.info" returned: 0 in 0.333s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:43 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] Acquiring lock "cinder-quobyte-6a77e461-d1f8-4f42-9e91-2c2d1d091f9e" by "_copy_volume_from_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:44:43 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] Lock "cinder-quobyte-6a77e461-d1f8-4f42-9e91-2c2d1d091f9e" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:44:43 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] snapshot: 91074eee-c1ec-4432-8b15-8b4c17b2ed73, volume: 6a77e461-d1f8-4f42-9e91-2c2d1d091f9e, {{(pid=86081) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 28 09:44:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:43 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:44:43 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:44:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:43 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[88718469-558c-45ba-a3f6-163064d3293c]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:44:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2.91074eee-c1ec-4432-8b15-8b4c17b2ed73 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:43 devstack sudo[101145]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ce691ffb-3f0a-404b-8dc5-737e804afa46 tempest-CreateVolumesFromSnapshotTest-1214825562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.288s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:43 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-ce691ffb-3f0a-404b-8dc5-737e804afa46 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:44:43 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-ce691ffb-3f0a-404b-8dc5-737e804afa46 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Deleted volume successfully. Aug 28 09:44:43 devstack sudo[101148]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:43 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ce691ffb-3f0a-404b-8dc5-737e804afa46 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "cinder-3d68a2d6-0495-4af8-92b2-044344107dcf-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:44:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-91d89406-0bb6-49c0-bef7-68ac2e45d2d7 tempest-CreateVolumesFromImageTest-617874580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-94ed7042-ddad-4b2a-81dd-624cb01e3e59" returned: 0 in 0.275s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:43 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-91d89406-0bb6-49c0-bef7-68ac2e45d2d7 tempest-CreateVolumesFromImageTest-617874580 None] Lock "cinder-quobyte-94ed7042-ddad-4b2a-81dd-624cb01e3e59" released by "delete_volume" :: held 0.891s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:44:43 devstack sudo[101150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2.91074eee-c1ec-4432-8b15-8b4c17b2ed73 Aug 28 09:44:43 devstack sudo[101150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:43 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-91d89406-0bb6-49c0-bef7-68ac2e45d2d7 tempest-CreateVolumesFromImageTest-617874580 None] Created reservations ['c43ffbd2-a66b-436d-9929-616a620eb2cc', '4f23e7e2-78f6-4a75-9a3a-879489746943', '406ee2eb-83a0-4a9c-b557-a716ef650252', 'f265c4c3-d4b8-436a-a12b-73d9b6f306f7'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:44:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-91d89406-0bb6-49c0-bef7-68ac2e45d2d7 tempest-CreateVolumesFromImageTest-617874580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-91d89406-0bb6-49c0-bef7-68ac2e45d2d7 tempest-CreateVolumesFromImageTest-617874580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:43 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-91d89406-0bb6-49c0-bef7-68ac2e45d2d7 tempest-CreateVolumesFromImageTest-617874580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:44:43 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-91d89406-0bb6-49c0-bef7-68ac2e45d2d7 tempest-CreateVolumesFromImageTest-617874580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:44:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-91d89406-0bb6-49c0-bef7-68ac2e45d2d7 tempest-CreateVolumesFromImageTest-617874580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-91d89406-0bb6-49c0-bef7-68ac2e45d2d7 tempest-CreateVolumesFromImageTest-617874580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:43 devstack sudo[101154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:44:43 devstack sudo[101154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:43 devstack sudo[101150]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2.91074eee-c1ec-4432-8b15-8b4c17b2ed73" returned: 0 in 0.421s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:43 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:44:43 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffaa444a-90dd-40c0-b98c-49253b4f78ee]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:44:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:44 devstack sudo[101159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2 Aug 28 09:44:44 devstack sudo[101159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:44 devstack sudo[101154]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-91d89406-0bb6-49c0-bef7-68ac2e45d2d7 tempest-CreateVolumesFromImageTest-617874580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.265s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:44 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-91d89406-0bb6-49c0-bef7-68ac2e45d2d7 tempest-CreateVolumesFromImageTest-617874580 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:44:44 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-91d89406-0bb6-49c0-bef7-68ac2e45d2d7 tempest-CreateVolumesFromImageTest-617874580 None] Deleted volume successfully. Aug 28 09:44:44 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-91d89406-0bb6-49c0-bef7-68ac2e45d2d7 tempest-CreateVolumesFromImageTest-617874580 None] Lock "cinder-94ed7042-ddad-4b2a-81dd-624cb01e3e59-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:44:44 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-b9b7d2d4-ae62-40b9-a2a6-a71aef21345e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Acquiring lock "cinder-a825f91b-0004-4296-a42f-0c853658e1ee-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:44:44 devstack sudo[101159]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2" returned: 0 in 0.422s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:44 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] will copy from snapshot at /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2 {{(pid=86081) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 28 09:44:44 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] Creating direct copy from snapshot {{(pid=86081) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 28 09:44:44 devstack cinder-volume[86081]: DEBUG cinder.utils [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] Path /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a77e461-d1f8-4f42-9e91-2c2d1d091f9e not found in is_blk_device check {{(pid=86081) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 28 09:44:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a77e461-d1f8-4f42-9e91-2c2d1d091f9e {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:44 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-b9b7d2d4-ae62-40b9-a2a6-a71aef21345e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "cinder-a825f91b-0004-4296-a42f-0c853658e1ee-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:44:44 devstack sudo[101165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a77e461-d1f8-4f42-9e91-2c2d1d091f9e Aug 28 09:44:44 devstack sudo[101165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:44 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-b9b7d2d4-ae62-40b9-a2a6-a71aef21345e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Acquiring lock "cinder-quobyte-a825f91b-0004-4296-a42f-0c853658e1ee" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:44:44 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-b9b7d2d4-ae62-40b9-a2a6-a71aef21345e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "cinder-quobyte-a825f91b-0004-4296-a42f-0c853658e1ee" acquired by "delete_volume" :: waited 0.015s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:44:44 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[251b08be-3df2-4fd4-bd28-e3caf887ab87]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:44:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b9b7d2d4-ae62-40b9-a2a6-a71aef21345e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a825f91b-0004-4296-a42f-0c853658e1ee {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:44 devstack sudo[101167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a825f91b-0004-4296-a42f-0c853658e1ee Aug 28 09:44:44 devstack sudo[101167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:44 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-42091f82-226e-42af-9fdd-d3c00a9390ef tempest-CreateVolumesFromImageTest-617874580 None] Acquiring lock "cinder-67ce92ae-cf79-4585-ae42-a8a16fa3f62a-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:44:44 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-42091f82-226e-42af-9fdd-d3c00a9390ef tempest-CreateVolumesFromImageTest-617874580 None] Lock "cinder-67ce92ae-cf79-4585-ae42-a8a16fa3f62a-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:44:45 devstack sudo[101167]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b9b7d2d4-ae62-40b9-a2a6-a71aef21345e tempest-CreateVolumesFromSnapshotTest-1214825562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a825f91b-0004-4296-a42f-0c853658e1ee" returned: 0 in 0.574s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b9b7d2d4-ae62-40b9-a2a6-a71aef21345e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a825f91b-0004-4296-a42f-0c853658e1ee {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:45 devstack sudo[101182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a825f91b-0004-4296-a42f-0c853658e1ee Aug 28 09:44:45 devstack sudo[101182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:45 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-42091f82-226e-42af-9fdd-d3c00a9390ef tempest-CreateVolumesFromImageTest-617874580 None] Acquiring lock "cinder-quobyte-67ce92ae-cf79-4585-ae42-a8a16fa3f62a" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:44:45 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-42091f82-226e-42af-9fdd-d3c00a9390ef tempest-CreateVolumesFromImageTest-617874580 None] Lock "cinder-quobyte-67ce92ae-cf79-4585-ae42-a8a16fa3f62a" acquired by "delete_volume" :: waited 0.055s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:44:45 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c458ea-39ae-49c6-b541-ad0f38dbb936]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:44:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-42091f82-226e-42af-9fdd-d3c00a9390ef tempest-CreateVolumesFromImageTest-617874580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-67ce92ae-cf79-4585-ae42-a8a16fa3f62a {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:45 devstack sudo[101184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-67ce92ae-cf79-4585-ae42-a8a16fa3f62a Aug 28 09:44:45 devstack sudo[101184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:45 devstack sudo[101182]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b9b7d2d4-ae62-40b9-a2a6-a71aef21345e tempest-CreateVolumesFromSnapshotTest-1214825562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a825f91b-0004-4296-a42f-0c853658e1ee" returned: 0 in 0.751s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:45 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-b9b7d2d4-ae62-40b9-a2a6-a71aef21345e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "cinder-quobyte-a825f91b-0004-4296-a42f-0c853658e1ee" released by "delete_volume" :: held 1.403s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:44:46 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-b9b7d2d4-ae62-40b9-a2a6-a71aef21345e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Created reservations ['20d506db-c262-4d44-a541-3831706a365f', 'f3d0e10e-0f23-4452-8869-596323c76eec', '098efcf5-3cde-4857-be1b-1594b96fdf08', '228506fa-f47b-40db-9af6-26d4b08685cc'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:44:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b9b7d2d4-ae62-40b9-a2a6-a71aef21345e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b9b7d2d4-ae62-40b9-a2a6-a71aef21345e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:46 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-b9b7d2d4-ae62-40b9-a2a6-a71aef21345e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:44:46 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-b9b7d2d4-ae62-40b9-a2a6-a71aef21345e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:44:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b9b7d2d4-ae62-40b9-a2a6-a71aef21345e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b9b7d2d4-ae62-40b9-a2a6-a71aef21345e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:46 devstack sudo[101191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:44:46 devstack sudo[101191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:46 devstack sudo[101184]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-42091f82-226e-42af-9fdd-d3c00a9390ef tempest-CreateVolumesFromImageTest-617874580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-67ce92ae-cf79-4585-ae42-a8a16fa3f62a" returned: 0 in 1.178s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-42091f82-226e-42af-9fdd-d3c00a9390ef tempest-CreateVolumesFromImageTest-617874580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-67ce92ae-cf79-4585-ae42-a8a16fa3f62a {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:46 devstack sudo[101194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-67ce92ae-cf79-4585-ae42-a8a16fa3f62a Aug 28 09:44:46 devstack sudo[101194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:46 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-d55c2910-8da0-47c7-9b3e-944c7e5255c1 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Acquiring lock "cinder-99466e34-1f55-4726-92d0-aa978a197c25-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:44:46 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-d55c2910-8da0-47c7-9b3e-944c7e5255c1 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "cinder-99466e34-1f55-4726-92d0-aa978a197c25-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:44:47 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-d55c2910-8da0-47c7-9b3e-944c7e5255c1 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Acquiring lock "cinder-quobyte-99466e34-1f55-4726-92d0-aa978a197c25" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:44:47 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-d55c2910-8da0-47c7-9b3e-944c7e5255c1 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "cinder-quobyte-99466e34-1f55-4726-92d0-aa978a197c25" acquired by "delete_volume" :: waited 0.045s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:44:47 devstack sudo[101191]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b9b7d2d4-ae62-40b9-a2a6-a71aef21345e tempest-CreateVolumesFromSnapshotTest-1214825562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.922s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:47 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-b9b7d2d4-ae62-40b9-a2a6-a71aef21345e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:44:47 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-b9b7d2d4-ae62-40b9-a2a6-a71aef21345e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Deleted volume successfully. Aug 28 09:44:47 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[172b3906-2b27-4a82-8c66-d38221fdd1f6]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:44:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d55c2910-8da0-47c7-9b3e-944c7e5255c1 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-99466e34-1f55-4726-92d0-aa978a197c25 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:47 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-b9b7d2d4-ae62-40b9-a2a6-a71aef21345e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "cinder-a825f91b-0004-4296-a42f-0c853658e1ee-delete_volume" released by "delete_volume" :: held 2.978s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:44:47 devstack sudo[101194]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-42091f82-226e-42af-9fdd-d3c00a9390ef tempest-CreateVolumesFromImageTest-617874580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-67ce92ae-cf79-4585-ae42-a8a16fa3f62a" returned: 0 in 0.843s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:47 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-42091f82-226e-42af-9fdd-d3c00a9390ef tempest-CreateVolumesFromImageTest-617874580 None] Lock "cinder-quobyte-67ce92ae-cf79-4585-ae42-a8a16fa3f62a" released by "delete_volume" :: held 2.152s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:44:47 devstack sudo[101198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-99466e34-1f55-4726-92d0-aa978a197c25 Aug 28 09:44:47 devstack sudo[101198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:47 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-42091f82-226e-42af-9fdd-d3c00a9390ef tempest-CreateVolumesFromImageTest-617874580 None] Created reservations ['e373752e-f80e-432f-a632-91d0d82f2769', 'dee198bb-b9fc-4622-a6c7-1b713eb17a70', 'd2a3a2d4-eab6-4a69-b15f-70b83f206fa0', '76883898-f7eb-44e3-8340-6609bd02123f'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:44:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-42091f82-226e-42af-9fdd-d3c00a9390ef tempest-CreateVolumesFromImageTest-617874580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-42091f82-226e-42af-9fdd-d3c00a9390ef tempest-CreateVolumesFromImageTest-617874580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:47 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-42091f82-226e-42af-9fdd-d3c00a9390ef tempest-CreateVolumesFromImageTest-617874580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:44:47 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-42091f82-226e-42af-9fdd-d3c00a9390ef tempest-CreateVolumesFromImageTest-617874580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:44:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-42091f82-226e-42af-9fdd-d3c00a9390ef tempest-CreateVolumesFromImageTest-617874580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-42091f82-226e-42af-9fdd-d3c00a9390ef tempest-CreateVolumesFromImageTest-617874580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:48 devstack sudo[101198]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d55c2910-8da0-47c7-9b3e-944c7e5255c1 tempest-CreateVolumesFromSnapshotTest-1214825562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-99466e34-1f55-4726-92d0-aa978a197c25" returned: 0 in 0.798s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d55c2910-8da0-47c7-9b3e-944c7e5255c1 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-99466e34-1f55-4726-92d0-aa978a197c25 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:48 devstack sudo[101203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:44:48 devstack sudo[101203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:48 devstack sudo[101205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-99466e34-1f55-4726-92d0-aa978a197c25 Aug 28 09:44:48 devstack sudo[101205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:48 devstack sudo[101203]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-42091f82-226e-42af-9fdd-d3c00a9390ef tempest-CreateVolumesFromImageTest-617874580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.747s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:48 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-42091f82-226e-42af-9fdd-d3c00a9390ef tempest-CreateVolumesFromImageTest-617874580 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:44:48 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-42091f82-226e-42af-9fdd-d3c00a9390ef tempest-CreateVolumesFromImageTest-617874580 None] Deleted volume successfully. Aug 28 09:44:48 devstack sudo[101205]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d55c2910-8da0-47c7-9b3e-944c7e5255c1 tempest-CreateVolumesFromSnapshotTest-1214825562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-99466e34-1f55-4726-92d0-aa978a197c25" returned: 0 in 0.703s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:48 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-d55c2910-8da0-47c7-9b3e-944c7e5255c1 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "cinder-quobyte-99466e34-1f55-4726-92d0-aa978a197c25" released by "delete_volume" :: held 1.676s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:44:48 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-42091f82-226e-42af-9fdd-d3c00a9390ef tempest-CreateVolumesFromImageTest-617874580 None] Lock "cinder-67ce92ae-cf79-4585-ae42-a8a16fa3f62a-delete_volume" released by "delete_volume" :: held 3.848s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:44:48 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-d55c2910-8da0-47c7-9b3e-944c7e5255c1 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Created reservations ['602b74f5-4652-4886-a36e-98b72cc49144', '22350a06-b3f4-48fa-ba65-c0ba80a1cc06', '7af96e28-b298-4f36-b293-fb2620069fdf', 'e6d3f90c-d923-4e5d-9f3c-a154f0a9724d'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:44:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-d55c2910-8da0-47c7-9b3e-944c7e5255c1 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-d55c2910-8da0-47c7-9b3e-944c7e5255c1 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:49 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-d55c2910-8da0-47c7-9b3e-944c7e5255c1 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:44:49 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-d55c2910-8da0-47c7-9b3e-944c7e5255c1 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:44:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-d55c2910-8da0-47c7-9b3e-944c7e5255c1 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d55c2910-8da0-47c7-9b3e-944c7e5255c1 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:49 devstack sudo[101210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:44:49 devstack sudo[101210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:49 devstack sudo[101210]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d55c2910-8da0-47c7-9b3e-944c7e5255c1 tempest-CreateVolumesFromSnapshotTest-1214825562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.383s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:49 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-d55c2910-8da0-47c7-9b3e-944c7e5255c1 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:44:49 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-d55c2910-8da0-47c7-9b3e-944c7e5255c1 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Deleted volume successfully. Aug 28 09:44:49 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-d55c2910-8da0-47c7-9b3e-944c7e5255c1 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "cinder-99466e34-1f55-4726-92d0-aa978a197c25-delete_volume" released by "delete_volume" :: held 2.647s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:44:49 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-bb31de61-4973-42cb-9c98-8fbd58a54b7e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Acquiring lock "cinder-1e3dd741-45d0-44ba-9e71-722eb5247881-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:44:49 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-bb31de61-4973-42cb-9c98-8fbd58a54b7e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "cinder-1e3dd741-45d0-44ba-9e71-722eb5247881-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:44:49 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-bb31de61-4973-42cb-9c98-8fbd58a54b7e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Acquiring lock "cinder-quobyte-1e3dd741-45d0-44ba-9e71-722eb5247881" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:44:49 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-bb31de61-4973-42cb-9c98-8fbd58a54b7e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "cinder-quobyte-1e3dd741-45d0-44ba-9e71-722eb5247881" acquired by "delete_volume" :: waited 0.042s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:44:49 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d286081-ef46-4b7f-bd6d-3eb156ffee82]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:44:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bb31de61-4973-42cb-9c98-8fbd58a54b7e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1e3dd741-45d0-44ba-9e71-722eb5247881 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:50 devstack sudo[101213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1e3dd741-45d0-44ba-9e71-722eb5247881 Aug 28 09:44:50 devstack sudo[101213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:50 devstack sudo[101165]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a77e461-d1f8-4f42-9e91-2c2d1d091f9e" returned: 0 in 6.045s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:50 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] Image conversion details: src /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2, size 1024.00 MB, duration 6.05 sec, destination /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a77e461-d1f8-4f42-9e91-2c2d1d091f9e {{(pid=86081) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 09:44:50 devstack cinder-volume[86081]: INFO cinder.image.image_utils [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] Converted 1024.00 MB image at 169.36 MB/s Aug 28 09:44:50 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a77e461-d1f8-4f42-9e91-2c2d1d091f9e is being set with open permissions: ugo+rw Aug 28 09:44:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a77e461-d1f8-4f42-9e91-2c2d1d091f9e {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:50 devstack sudo[101215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a77e461-d1f8-4f42-9e91-2c2d1d091f9e Aug 28 09:44:50 devstack sudo[101215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:50 devstack sudo[101215]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a77e461-d1f8-4f42-9e91-2c2d1d091f9e" returned: 0 in 0.288s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:50 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] Lock "cinder-quobyte-6a77e461-d1f8-4f42-9e91-2c2d1d091f9e" released by "_copy_volume_from_snapshot" :: held 7.284s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:44:50 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] Acquiring lock "cinder-quobyte-91074eee-c1ec-4432-8b15-8b4c17b2ed73" by "_delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:44:50 devstack sudo[101213]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bb31de61-4973-42cb-9c98-8fbd58a54b7e tempest-CreateVolumesFromSnapshotTest-1214825562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1e3dd741-45d0-44ba-9e71-722eb5247881" returned: 0 in 0.808s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bb31de61-4973-42cb-9c98-8fbd58a54b7e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1e3dd741-45d0-44ba-9e71-722eb5247881 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:50 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] Lock "cinder-quobyte-91074eee-c1ec-4432-8b15-8b4c17b2ed73" acquired by "_delete_snapshot" :: waited 0.055s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:44:50 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] Deleting offline snapshot 91074eee-c1ec-4432-8b15-8b4c17b2ed73 of volume a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:44:50 devstack sudo[101222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1e3dd741-45d0-44ba-9e71-722eb5247881 Aug 28 09:44:50 devstack sudo[101222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:50 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] snapshot_file for this snap is: volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2.91074eee-c1ec-4432-8b15-8b4c17b2ed73 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:44:50 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[61984760-2cdd-4a38-9b55-e5751810b93e]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:44:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2.91074eee-c1ec-4432-8b15-8b4c17b2ed73 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:51 devstack sudo[101224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2.91074eee-c1ec-4432-8b15-8b4c17b2ed73 Aug 28 09:44:51 devstack sudo[101224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:51 devstack sudo[101222]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bb31de61-4973-42cb-9c98-8fbd58a54b7e tempest-CreateVolumesFromSnapshotTest-1214825562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1e3dd741-45d0-44ba-9e71-722eb5247881" returned: 0 in 0.395s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:51 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-bb31de61-4973-42cb-9c98-8fbd58a54b7e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "cinder-quobyte-1e3dd741-45d0-44ba-9e71-722eb5247881" released by "delete_volume" :: held 1.304s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:44:51 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-bb31de61-4973-42cb-9c98-8fbd58a54b7e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Created reservations ['47707478-7478-48fb-871b-9b4a233880a6', 'b8b9ff3a-080b-4748-888d-e9caf30634df', 'acf96720-beea-4288-9395-da5312ed056e', 'fbcfdac0-2c7b-4262-bbdc-58f62d66aa28'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:44:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-bb31de61-4973-42cb-9c98-8fbd58a54b7e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-bb31de61-4973-42cb-9c98-8fbd58a54b7e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:51 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-bb31de61-4973-42cb-9c98-8fbd58a54b7e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:44:51 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-bb31de61-4973-42cb-9c98-8fbd58a54b7e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:44:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-bb31de61-4973-42cb-9c98-8fbd58a54b7e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bb31de61-4973-42cb-9c98-8fbd58a54b7e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:51 devstack sudo[101232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:44:51 devstack sudo[101232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:51 devstack sudo[101224]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2.91074eee-c1ec-4432-8b15-8b4c17b2ed73" returned: 0 in 0.539s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:51 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:44:51 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[9076cab3-ac27-43c3-82ab-944b50609811]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:44:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:51 devstack sudo[101235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2 Aug 28 09:44:51 devstack sudo[101235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:51 devstack sudo[101232]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bb31de61-4973-42cb-9c98-8fbd58a54b7e tempest-CreateVolumesFromSnapshotTest-1214825562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.320s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:51 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-bb31de61-4973-42cb-9c98-8fbd58a54b7e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:44:51 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-bb31de61-4973-42cb-9c98-8fbd58a54b7e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Deleted volume successfully. Aug 28 09:44:51 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-bb31de61-4973-42cb-9c98-8fbd58a54b7e tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "cinder-1e3dd741-45d0-44ba-9e71-722eb5247881-delete_volume" released by "delete_volume" :: held 2.057s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:44:52 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-04916517-20d4-457c-822a-c21558f2ae5a tempest-CreateVolumesFromSnapshotTest-1214825562 None] Acquiring lock "cinder-4cd2f30d-eba6-4aad-ab66-afd3ea3ef93f-delete_snapshot" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:44:52 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-04916517-20d4-457c-822a-c21558f2ae5a tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "cinder-4cd2f30d-eba6-4aad-ab66-afd3ea3ef93f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:44:52 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-04916517-20d4-457c-822a-c21558f2ae5a tempest-CreateVolumesFromSnapshotTest-1214825562 None] Acquiring lock "cinder-quobyte-8a104067-ee68-418b-a455-bd97674e4f7d" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:44:52 devstack sudo[101235]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2" returned: 0 in 0.666s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2.91074eee-c1ec-4432-8b15-8b4c17b2ed73 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:52 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-04916517-20d4-457c-822a-c21558f2ae5a tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "cinder-quobyte-8a104067-ee68-418b-a455-bd97674e4f7d" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:44:52 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-04916517-20d4-457c-822a-c21558f2ae5a tempest-CreateVolumesFromSnapshotTest-1214825562 None] Acquiring lock "cinder-quobyte-4cd2f30d-eba6-4aad-ab66-afd3ea3ef93f" by "_delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:44:52 devstack sudo[101243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2.91074eee-c1ec-4432-8b15-8b4c17b2ed73 Aug 28 09:44:52 devstack sudo[101243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:52 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-04916517-20d4-457c-822a-c21558f2ae5a tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "cinder-quobyte-4cd2f30d-eba6-4aad-ab66-afd3ea3ef93f" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:44:52 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-04916517-20d4-457c-822a-c21558f2ae5a tempest-CreateVolumesFromSnapshotTest-1214825562 None] Deleting offline snapshot 4cd2f30d-eba6-4aad-ab66-afd3ea3ef93f of volume 8a104067-ee68-418b-a455-bd97674e4f7d {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:44:52 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-04916517-20d4-457c-822a-c21558f2ae5a tempest-CreateVolumesFromSnapshotTest-1214825562 None] snapshot_file for this snap is: volume-8a104067-ee68-418b-a455-bd97674e4f7d.4cd2f30d-eba6-4aad-ab66-afd3ea3ef93f {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:44:52 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[49945f9e-c557-497a-a009-c6207c35df42]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:44:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-04916517-20d4-457c-822a-c21558f2ae5a tempest-CreateVolumesFromSnapshotTest-1214825562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8a104067-ee68-418b-a455-bd97674e4f7d.4cd2f30d-eba6-4aad-ab66-afd3ea3ef93f {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:52 devstack sudo[101245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8a104067-ee68-418b-a455-bd97674e4f7d.4cd2f30d-eba6-4aad-ab66-afd3ea3ef93f Aug 28 09:44:52 devstack sudo[101245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:52 devstack sudo[101243]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2.91074eee-c1ec-4432-8b15-8b4c17b2ed73" returned: 0 in 0.552s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2.91074eee-c1ec-4432-8b15-8b4c17b2ed73 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:52 devstack sudo[101254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2.91074eee-c1ec-4432-8b15-8b4c17b2ed73 Aug 28 09:44:52 devstack sudo[101254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:52 devstack sudo[101245]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-04916517-20d4-457c-822a-c21558f2ae5a tempest-CreateVolumesFromSnapshotTest-1214825562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8a104067-ee68-418b-a455-bd97674e4f7d.4cd2f30d-eba6-4aad-ab66-afd3ea3ef93f" returned: 0 in 0.482s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:52 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-04916517-20d4-457c-822a-c21558f2ae5a tempest-CreateVolumesFromSnapshotTest-1214825562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a104067-ee68-418b-a455-bd97674e4f7d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:44:52 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[72673929-f8f0-4b03-a686-2c7fc5d1262e]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:44:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-04916517-20d4-457c-822a-c21558f2ae5a tempest-CreateVolumesFromSnapshotTest-1214825562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8a104067-ee68-418b-a455-bd97674e4f7d {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:53 devstack sudo[101256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8a104067-ee68-418b-a455-bd97674e4f7d Aug 28 09:44:53 devstack sudo[101256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:53 devstack sudo[101254]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2.91074eee-c1ec-4432-8b15-8b4c17b2ed73" returned: 0 in 0.347s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:53 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] Lock "cinder-quobyte-91074eee-c1ec-4432-8b15-8b4c17b2ed73" released by "_delete_snapshot" :: held 2.309s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:44:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.415s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:53 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f268672-422b-4523-a629-b34012c600f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a77e461-d1f8-4f42-9e91-2c2d1d091f9e', 'volume_size': 2, 'source_volid': 'a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2', 'source_volstatus': 'available'}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:53 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9b5bed0-df70-4ddc-9c22-1da81a96eea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:53 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] Volume volume-6a77e461-d1f8-4f42-9e91-2c2d1d091f9e (6a77e461-d1f8-4f42-9e91-2c2d1d091f9e): created successfully Aug 28 09:44:53 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9b5bed0-df70-4ddc-9c22-1da81a96eea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:53 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] Flow 'volume_create_manager' (51644436-416f-4ca0-bb24-612468afecd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:44:53 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-67d21e90-eede-4586-b66a-119e8d03714b tempest-VolumesCloneTest-1631533682 None] Created volume successfully. Aug 28 09:44:53 devstack sudo[101256]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-04916517-20d4-457c-822a-c21558f2ae5a tempest-CreateVolumesFromSnapshotTest-1214825562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8a104067-ee68-418b-a455-bd97674e4f7d" returned: 0 in 0.679s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-04916517-20d4-457c-822a-c21558f2ae5a tempest-CreateVolumesFromSnapshotTest-1214825562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8a104067-ee68-418b-a455-bd97674e4f7d.4cd2f30d-eba6-4aad-ab66-afd3ea3ef93f {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:53 devstack sudo[101262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8a104067-ee68-418b-a455-bd97674e4f7d.4cd2f30d-eba6-4aad-ab66-afd3ea3ef93f Aug 28 09:44:53 devstack sudo[101262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:54 devstack sudo[101262]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-04916517-20d4-457c-822a-c21558f2ae5a tempest-CreateVolumesFromSnapshotTest-1214825562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8a104067-ee68-418b-a455-bd97674e4f7d.4cd2f30d-eba6-4aad-ab66-afd3ea3ef93f" returned: 0 in 0.547s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-04916517-20d4-457c-822a-c21558f2ae5a tempest-CreateVolumesFromSnapshotTest-1214825562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8a104067-ee68-418b-a455-bd97674e4f7d.4cd2f30d-eba6-4aad-ab66-afd3ea3ef93f {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:54 devstack sudo[101271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8a104067-ee68-418b-a455-bd97674e4f7d.4cd2f30d-eba6-4aad-ab66-afd3ea3ef93f Aug 28 09:44:54 devstack sudo[101271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:54 devstack sudo[101271]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-04916517-20d4-457c-822a-c21558f2ae5a tempest-CreateVolumesFromSnapshotTest-1214825562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8a104067-ee68-418b-a455-bd97674e4f7d.4cd2f30d-eba6-4aad-ab66-afd3ea3ef93f" returned: 0 in 0.387s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:54 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-04916517-20d4-457c-822a-c21558f2ae5a tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "cinder-quobyte-4cd2f30d-eba6-4aad-ab66-afd3ea3ef93f" released by "_delete_snapshot" :: held 2.286s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:44:54 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-71f68826-2049-4e9c-b1cf-5ff7eb3772d8 tempest-VolumesCloneTest-1631533682 None] Acquiring lock "cinder-6a77e461-d1f8-4f42-9e91-2c2d1d091f9e-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:44:54 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-04916517-20d4-457c-822a-c21558f2ae5a tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "cinder-quobyte-8a104067-ee68-418b-a455-bd97674e4f7d" released by "delete_snapshot" :: held 2.333s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:44:54 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-71f68826-2049-4e9c-b1cf-5ff7eb3772d8 tempest-VolumesCloneTest-1631533682 None] Lock "cinder-6a77e461-d1f8-4f42-9e91-2c2d1d091f9e-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:44:54 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-71f68826-2049-4e9c-b1cf-5ff7eb3772d8 tempest-VolumesCloneTest-1631533682 None] Acquiring lock "cinder-quobyte-6a77e461-d1f8-4f42-9e91-2c2d1d091f9e" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:44:54 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-04916517-20d4-457c-822a-c21558f2ae5a tempest-CreateVolumesFromSnapshotTest-1214825562 None] Created reservations ['b2734989-b11f-46d4-95d8-ea6458cd7032', 'b584b2a6-6891-4b0f-92f3-ca88bfa582ff', 'db8b7f1b-9ae1-462c-adfd-4d4f7bef3821', 'fccf8a29-61bd-439a-9223-53af5b828b97'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:44:54 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fa4e086-f33a-4b9f-8e98-4375bef72721 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:44:54 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5fa4e086-f33a-4b9f-8e98-4375bef72721 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Flow 'volume_create_manager' (2bb51fc7-a4d1-4b7f-b22f-7032e515cff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:44:54 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5fa4e086-f33a-4b9f-8e98-4375bef72721 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76440b71-0869-4130-b530-a92e7f439390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:54 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-71f68826-2049-4e9c-b1cf-5ff7eb3772d8 tempest-VolumesCloneTest-1631533682 None] Lock "cinder-quobyte-6a77e461-d1f8-4f42-9e91-2c2d1d091f9e" acquired by "delete_volume" :: waited 0.089s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:44:54 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[826aa7c9-647a-4ab1-b449-07efb5093bf9]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:44:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-71f68826-2049-4e9c-b1cf-5ff7eb3772d8 tempest-VolumesCloneTest-1631533682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a77e461-d1f8-4f42-9e91-2c2d1d091f9e {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:54 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5fa4e086-f33a-4b9f-8e98-4375bef72721 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76440b71-0869-4130-b530-a92e7f439390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:44:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2080411946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e1f3a27-8338-4807-b117-302447a3cee0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b21d1119177f4fdbbdedc7dcc88b3fff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:44:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:44:55Z,use_quota=True,user_id='9f92b08a9ae54085a8f17b8636db963e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:54 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5fa4e086-f33a-4b9f-8e98-4375bef72721 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb2afb01-35ac-45fc-b61e-389a41f18014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:54 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5fa4e086-f33a-4b9f-8e98-4375bef72721 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb2afb01-35ac-45fc-b61e-389a41f18014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:54 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5fa4e086-f33a-4b9f-8e98-4375bef72721 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af0c8d76-b3d8-401d-90bf-46eba679a83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:54 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5fa4e086-f33a-4b9f-8e98-4375bef72721 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af0c8d76-b3d8-401d-90bf-46eba679a83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e1f3a27-8338-4807-b117-302447a3cee0', 'volume_name': 'volume-4e1f3a27-8338-4807-b117-302447a3cee0', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:54 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5fa4e086-f33a-4b9f-8e98-4375bef72721 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e45c6edf-74db-4216-aca4-c290de3d9ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:54 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5fa4e086-f33a-4b9f-8e98-4375bef72721 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e45c6edf-74db-4216-aca4-c290de3d9ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:54 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5fa4e086-f33a-4b9f-8e98-4375bef72721 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c7a3c0f-b9e0-4405-a998-58340f21beef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:54 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-5fa4e086-f33a-4b9f-8e98-4375bef72721 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Volume 4e1f3a27-8338-4807-b117-302447a3cee0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e1f3a27-8338-4807-b117-302447a3cee0', 'volume_size': 1} Aug 28 09:44:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-5fa4e086-f33a-4b9f-8e98-4375bef72721 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-5fa4e086-f33a-4b9f-8e98-4375bef72721 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:54 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-5fa4e086-f33a-4b9f-8e98-4375bef72721 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:44:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2080411946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e1f3a27-8338-4807-b117-302447a3cee0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b21d1119177f4fdbbdedc7dcc88b3fff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:44:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:44:55Z,use_quota=True,user_id='9f92b08a9ae54085a8f17b8636db963e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:44:54 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-5fa4e086-f33a-4b9f-8e98-4375bef72721 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Creating volume 4e1f3a27-8338-4807-b117-302447a3cee0 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:44:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-5fa4e086-f33a-4b9f-8e98-4375bef72721 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-5fa4e086-f33a-4b9f-8e98-4375bef72721 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:54 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-5fa4e086-f33a-4b9f-8e98-4375bef72721 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:44:54 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-5fa4e086-f33a-4b9f-8e98-4375bef72721 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:44:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-5fa4e086-f33a-4b9f-8e98-4375bef72721 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:54 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-5fa4e086-f33a-4b9f-8e98-4375bef72721 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:44:54 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-5fa4e086-f33a-4b9f-8e98-4375bef72721 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:44:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5fa4e086-f33a-4b9f-8e98-4375bef72721 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4e1f3a27-8338-4807-b117-302447a3cee0 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:54 devstack sudo[101293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a77e461-d1f8-4f42-9e91-2c2d1d091f9e Aug 28 09:44:54 devstack sudo[101293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:54 devstack sudo[101294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4e1f3a27-8338-4807-b117-302447a3cee0 1073741824 Aug 28 09:44:54 devstack sudo[101294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:54 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-04916517-20d4-457c-822a-c21558f2ae5a tempest-CreateVolumesFromSnapshotTest-1214825562 None] Delete snapshot completed successfully. Aug 28 09:44:55 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-04916517-20d4-457c-822a-c21558f2ae5a tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "cinder-4cd2f30d-eba6-4aad-ab66-afd3ea3ef93f-delete_snapshot" released by "delete_snapshot" :: held 2.862s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:44:55 devstack sudo[101293]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-71f68826-2049-4e9c-b1cf-5ff7eb3772d8 tempest-VolumesCloneTest-1631533682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a77e461-d1f8-4f42-9e91-2c2d1d091f9e" returned: 0 in 0.464s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-71f68826-2049-4e9c-b1cf-5ff7eb3772d8 tempest-VolumesCloneTest-1631533682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a77e461-d1f8-4f42-9e91-2c2d1d091f9e {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:55 devstack sudo[101315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a77e461-d1f8-4f42-9e91-2c2d1d091f9e Aug 28 09:44:55 devstack sudo[101315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:55 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e9c67590-f094-4abd-b831-2f136a9129e8 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Acquiring lock "cinder-8a104067-ee68-418b-a455-bd97674e4f7d-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:44:55 devstack sudo[101294]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5fa4e086-f33a-4b9f-8e98-4375bef72721 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4e1f3a27-8338-4807-b117-302447a3cee0 1073741824" returned: 0 in 0.661s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:55 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e9c67590-f094-4abd-b831-2f136a9129e8 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "cinder-8a104067-ee68-418b-a455-bd97674e4f7d-delete_volume" acquired by "delete_volume" :: waited 0.103s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:44:55 devstack sudo[101315]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-71f68826-2049-4e9c-b1cf-5ff7eb3772d8 tempest-VolumesCloneTest-1631533682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-6a77e461-d1f8-4f42-9e91-2c2d1d091f9e" returned: 0 in 0.345s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:55 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-71f68826-2049-4e9c-b1cf-5ff7eb3772d8 tempest-VolumesCloneTest-1631533682 None] Lock "cinder-quobyte-6a77e461-d1f8-4f42-9e91-2c2d1d091f9e" released by "delete_volume" :: held 0.870s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:44:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5fa4e086-f33a-4b9f-8e98-4375bef72721 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4e1f3a27-8338-4807-b117-302447a3cee0 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:55 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e9c67590-f094-4abd-b831-2f136a9129e8 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Acquiring lock "cinder-quobyte-8a104067-ee68-418b-a455-bd97674e4f7d" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:44:55 devstack sudo[101322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4e1f3a27-8338-4807-b117-302447a3cee0 Aug 28 09:44:55 devstack sudo[101322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:55 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e9c67590-f094-4abd-b831-2f136a9129e8 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "cinder-quobyte-8a104067-ee68-418b-a455-bd97674e4f7d" acquired by "delete_volume" :: waited 0.022s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:44:55 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[a490610e-982a-4b7e-aaa8-3884cb22270b]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:44:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e9c67590-f094-4abd-b831-2f136a9129e8 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8a104067-ee68-418b-a455-bd97674e4f7d {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:55 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-71f68826-2049-4e9c-b1cf-5ff7eb3772d8 tempest-VolumesCloneTest-1631533682 None] Created reservations ['dcc82ff8-aee3-4928-afa2-b68fa1ad6842', 'a0ca6921-1ea9-446a-9fb5-cd1b2443b1d7', '7b854855-1bdd-4759-9229-cf6647d32692', '6e31d7db-bf73-492e-ad43-9bb840245148'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:44:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-71f68826-2049-4e9c-b1cf-5ff7eb3772d8 tempest-VolumesCloneTest-1631533682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-71f68826-2049-4e9c-b1cf-5ff7eb3772d8 tempest-VolumesCloneTest-1631533682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:55 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-71f68826-2049-4e9c-b1cf-5ff7eb3772d8 tempest-VolumesCloneTest-1631533682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:44:55 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-71f68826-2049-4e9c-b1cf-5ff7eb3772d8 tempest-VolumesCloneTest-1631533682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:44:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-71f68826-2049-4e9c-b1cf-5ff7eb3772d8 tempest-VolumesCloneTest-1631533682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-71f68826-2049-4e9c-b1cf-5ff7eb3772d8 tempest-VolumesCloneTest-1631533682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:55 devstack sudo[101324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8a104067-ee68-418b-a455-bd97674e4f7d Aug 28 09:44:55 devstack sudo[101324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:55 devstack sudo[101326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:44:55 devstack sudo[101326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:55 devstack sudo[101322]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5fa4e086-f33a-4b9f-8e98-4375bef72721 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4e1f3a27-8338-4807-b117-302447a3cee0" returned: 0 in 0.291s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:55 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-5fa4e086-f33a-4b9f-8e98-4375bef72721 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:44:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-5fa4e086-f33a-4b9f-8e98-4375bef72721 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:55 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5fa4e086-f33a-4b9f-8e98-4375bef72721 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c7a3c0f-b9e0-4405-a998-58340f21beef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e1f3a27-8338-4807-b117-302447a3cee0', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:55 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5fa4e086-f33a-4b9f-8e98-4375bef72721 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70ba93fa-9afb-419f-9f49-f968fa2aa22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:55 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-5fa4e086-f33a-4b9f-8e98-4375bef72721 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Volume volume-4e1f3a27-8338-4807-b117-302447a3cee0 (4e1f3a27-8338-4807-b117-302447a3cee0): created successfully Aug 28 09:44:55 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5fa4e086-f33a-4b9f-8e98-4375bef72721 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70ba93fa-9afb-419f-9f49-f968fa2aa22f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:55 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5fa4e086-f33a-4b9f-8e98-4375bef72721 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Flow 'volume_create_manager' (2bb51fc7-a4d1-4b7f-b22f-7032e515cff2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:44:55 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-5fa4e086-f33a-4b9f-8e98-4375bef72721 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Created volume successfully. Aug 28 09:44:56 devstack sudo[101324]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e9c67590-f094-4abd-b831-2f136a9129e8 tempest-CreateVolumesFromSnapshotTest-1214825562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8a104067-ee68-418b-a455-bd97674e4f7d" returned: 0 in 0.468s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e9c67590-f094-4abd-b831-2f136a9129e8 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8a104067-ee68-418b-a455-bd97674e4f7d {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:56 devstack sudo[101326]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-71f68826-2049-4e9c-b1cf-5ff7eb3772d8 tempest-VolumesCloneTest-1631533682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.342s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:56 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-71f68826-2049-4e9c-b1cf-5ff7eb3772d8 tempest-VolumesCloneTest-1631533682 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:44:56 devstack sudo[101333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8a104067-ee68-418b-a455-bd97674e4f7d Aug 28 09:44:56 devstack sudo[101333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:56 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-71f68826-2049-4e9c-b1cf-5ff7eb3772d8 tempest-VolumesCloneTest-1631533682 None] Deleted volume successfully. Aug 28 09:44:56 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-71f68826-2049-4e9c-b1cf-5ff7eb3772d8 tempest-VolumesCloneTest-1631533682 None] Lock "cinder-6a77e461-d1f8-4f42-9e91-2c2d1d091f9e-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:44:56 devstack sudo[101333]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e9c67590-f094-4abd-b831-2f136a9129e8 tempest-CreateVolumesFromSnapshotTest-1214825562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8a104067-ee68-418b-a455-bd97674e4f7d" returned: 0 in 0.284s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:56 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e9c67590-f094-4abd-b831-2f136a9129e8 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "cinder-quobyte-8a104067-ee68-418b-a455-bd97674e4f7d" released by "delete_volume" :: held 0.815s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:44:56 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-e9c67590-f094-4abd-b831-2f136a9129e8 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Created reservations ['086200a1-dd3e-4aba-a8a0-20daabd42bf2', 'd0f6f462-0281-45b8-860a-060688472b64', '435fa32b-d582-49cd-b9e0-75ba9e8bcdb8', '4324e361-4c44-42f7-b608-00dd500072b7'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:44:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e9c67590-f094-4abd-b831-2f136a9129e8 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e9c67590-f094-4abd-b831-2f136a9129e8 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:56 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e9c67590-f094-4abd-b831-2f136a9129e8 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:44:56 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e9c67590-f094-4abd-b831-2f136a9129e8 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:44:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e9c67590-f094-4abd-b831-2f136a9129e8 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e9c67590-f094-4abd-b831-2f136a9129e8 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:56 devstack sudo[101337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:44:56 devstack sudo[101337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:56 devstack sudo[101337]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e9c67590-f094-4abd-b831-2f136a9129e8 tempest-CreateVolumesFromSnapshotTest-1214825562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.329s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:56 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-e9c67590-f094-4abd-b831-2f136a9129e8 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:44:56 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-e9c67590-f094-4abd-b831-2f136a9129e8 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Deleted volume successfully. Aug 28 09:44:56 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e9c67590-f094-4abd-b831-2f136a9129e8 tempest-CreateVolumesFromSnapshotTest-1214825562 None] Lock "cinder-8a104067-ee68-418b-a455-bd97674e4f7d-delete_volume" released by "delete_volume" :: held 1.419s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:44:57 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-620abda4-5f20-4baa-b520-a8f0b96e717f tempest-VolumesCloneTest-1631533682 None] Acquiring lock "cinder-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:44:57 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-620abda4-5f20-4baa-b520-a8f0b96e717f tempest-VolumesCloneTest-1631533682 None] Lock "cinder-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:44:57 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-620abda4-5f20-4baa-b520-a8f0b96e717f tempest-VolumesCloneTest-1631533682 None] Acquiring lock "cinder-quobyte-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:44:57 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-620abda4-5f20-4baa-b520-a8f0b96e717f tempest-VolumesCloneTest-1631533682 None] Lock "cinder-quobyte-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2" acquired by "delete_volume" :: waited 0.044s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:44:57 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[8928c637-cfd4-4b07-ba9f-d3a51f0f8f32]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:44:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-620abda4-5f20-4baa-b520-a8f0b96e717f tempest-VolumesCloneTest-1631533682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:57 devstack sudo[101340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2 Aug 28 09:44:57 devstack sudo[101340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:57 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7405cbe-2efe-4fe8-b3b2-e6180f7d9997 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:44:57 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e7405cbe-2efe-4fe8-b3b2-e6180f7d9997 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Flow 'volume_create_manager' (3430bf13-413f-41a3-b922-09d8f661fc87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:44:57 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e7405cbe-2efe-4fe8-b3b2-e6180f7d9997 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20103205-f514-485e-977d-99cdc7b548eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:57 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e7405cbe-2efe-4fe8-b3b2-e6180f7d9997 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20103205-f514-485e-977d-99cdc7b548eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:44:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1417483497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f71b9274-a5fb-4d28-83c9-c5e335720933,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b21d1119177f4fdbbdedc7dcc88b3fff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:44:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:44:58Z,use_quota=True,user_id='9f92b08a9ae54085a8f17b8636db963e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:57 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e7405cbe-2efe-4fe8-b3b2-e6180f7d9997 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6786bf2a-1353-4fc7-82a0-f27f9494aa6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:57 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e7405cbe-2efe-4fe8-b3b2-e6180f7d9997 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6786bf2a-1353-4fc7-82a0-f27f9494aa6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:57 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e7405cbe-2efe-4fe8-b3b2-e6180f7d9997 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3231cbf2-4c7c-43d6-bd95-e9aa66598fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:57 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e7405cbe-2efe-4fe8-b3b2-e6180f7d9997 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3231cbf2-4c7c-43d6-bd95-e9aa66598fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f71b9274-a5fb-4d28-83c9-c5e335720933', 'volume_name': 'volume-f71b9274-a5fb-4d28-83c9-c5e335720933', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:57 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e7405cbe-2efe-4fe8-b3b2-e6180f7d9997 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cee14a0a-61ed-4501-9c3f-f2d03c42ef06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:57 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e7405cbe-2efe-4fe8-b3b2-e6180f7d9997 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cee14a0a-61ed-4501-9c3f-f2d03c42ef06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:57 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e7405cbe-2efe-4fe8-b3b2-e6180f7d9997 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d9526a5-db54-4d33-97b1-bde2afc3b11b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:57 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-e7405cbe-2efe-4fe8-b3b2-e6180f7d9997 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Volume f71b9274-a5fb-4d28-83c9-c5e335720933: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f71b9274-a5fb-4d28-83c9-c5e335720933', 'volume_size': 1} Aug 28 09:44:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e7405cbe-2efe-4fe8-b3b2-e6180f7d9997 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e7405cbe-2efe-4fe8-b3b2-e6180f7d9997 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:57 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e7405cbe-2efe-4fe8-b3b2-e6180f7d9997 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:44:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1417483497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f71b9274-a5fb-4d28-83c9-c5e335720933,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b21d1119177f4fdbbdedc7dcc88b3fff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:44:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:44:58Z,use_quota=True,user_id='9f92b08a9ae54085a8f17b8636db963e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:44:57 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-e7405cbe-2efe-4fe8-b3b2-e6180f7d9997 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Creating volume f71b9274-a5fb-4d28-83c9-c5e335720933 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:44:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e7405cbe-2efe-4fe8-b3b2-e6180f7d9997 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e7405cbe-2efe-4fe8-b3b2-e6180f7d9997 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:57 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e7405cbe-2efe-4fe8-b3b2-e6180f7d9997 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:44:57 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e7405cbe-2efe-4fe8-b3b2-e6180f7d9997 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:44:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e7405cbe-2efe-4fe8-b3b2-e6180f7d9997 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:57 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e7405cbe-2efe-4fe8-b3b2-e6180f7d9997 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:44:57 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-e7405cbe-2efe-4fe8-b3b2-e6180f7d9997 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:44:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e7405cbe-2efe-4fe8-b3b2-e6180f7d9997 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f71b9274-a5fb-4d28-83c9-c5e335720933 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:57 devstack sudo[101380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f71b9274-a5fb-4d28-83c9-c5e335720933 1073741824 Aug 28 09:44:57 devstack sudo[101380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:58 devstack sudo[101340]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-620abda4-5f20-4baa-b520-a8f0b96e717f tempest-VolumesCloneTest-1631533682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2" returned: 0 in 0.952s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-620abda4-5f20-4baa-b520-a8f0b96e717f tempest-VolumesCloneTest-1631533682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:58 devstack sudo[101398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2 Aug 28 09:44:58 devstack sudo[101398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:58 devstack sudo[101398]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-620abda4-5f20-4baa-b520-a8f0b96e717f tempest-VolumesCloneTest-1631533682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2" returned: 0 in 0.563s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:58 devstack sudo[101380]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e7405cbe-2efe-4fe8-b3b2-e6180f7d9997 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f71b9274-a5fb-4d28-83c9-c5e335720933 1073741824" returned: 0 in 1.006s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:58 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-620abda4-5f20-4baa-b520-a8f0b96e717f tempest-VolumesCloneTest-1631533682 None] Lock "cinder-quobyte-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2" released by "delete_volume" :: held 1.713s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:44:58 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-15839e30-de88-4849-a36a-89b07c48b595 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:44:59 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-15839e30-de88-4849-a36a-89b07c48b595 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Flow 'volume_create_manager' (f9b61c74-87a0-4d04-acbe-b0c75404d848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:44:59 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-15839e30-de88-4849-a36a-89b07c48b595 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (468b70a6-26d4-4ba1-af29-79a36444fc46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:59 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-15839e30-de88-4849-a36a-89b07c48b595 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (468b70a6-26d4-4ba1-af29-79a36444fc46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:44:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-294358419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e58d3c4-85ed-4010-a818-07713f614bf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b21d1119177f4fdbbdedc7dcc88b3fff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:44:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:44:59Z,use_quota=True,user_id='9f92b08a9ae54085a8f17b8636db963e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:59 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-15839e30-de88-4849-a36a-89b07c48b595 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e95c6cc-61b3-432a-9672-0cda4e5018c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:59 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-15839e30-de88-4849-a36a-89b07c48b595 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e95c6cc-61b3-432a-9672-0cda4e5018c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:59 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-15839e30-de88-4849-a36a-89b07c48b595 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b07f47e8-a9d3-492d-a029-f908fe84321c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:59 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-15839e30-de88-4849-a36a-89b07c48b595 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b07f47e8-a9d3-492d-a029-f908fe84321c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e58d3c4-85ed-4010-a818-07713f614bf6', 'volume_name': 'volume-1e58d3c4-85ed-4010-a818-07713f614bf6', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:59 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-15839e30-de88-4849-a36a-89b07c48b595 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d626eb1-f5ae-411e-88eb-80a51f4154b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:59 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-15839e30-de88-4849-a36a-89b07c48b595 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d626eb1-f5ae-411e-88eb-80a51f4154b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:59 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-15839e30-de88-4849-a36a-89b07c48b595 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd8817aa-6a1e-4f64-88b2-684388655321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:59 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-15839e30-de88-4849-a36a-89b07c48b595 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Volume 1e58d3c4-85ed-4010-a818-07713f614bf6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e58d3c4-85ed-4010-a818-07713f614bf6', 'volume_size': 1} Aug 28 09:44:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-15839e30-de88-4849-a36a-89b07c48b595 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e7405cbe-2efe-4fe8-b3b2-e6180f7d9997 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f71b9274-a5fb-4d28-83c9-c5e335720933 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:59 devstack sudo[101417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f71b9274-a5fb-4d28-83c9-c5e335720933 Aug 28 09:44:59 devstack sudo[101417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:59 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-620abda4-5f20-4baa-b520-a8f0b96e717f tempest-VolumesCloneTest-1631533682 None] Created reservations ['794e2180-402c-4028-b9ff-f8f537ab1b26', 'c5cddcef-8d0a-4242-8c78-4dd0fcd2e39d', '017e2074-abe2-4d81-ba96-95acf527783a', '74d1a5c8-1713-43e8-9170-d05c87452b58'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:44:59 devstack sudo[101417]: pam_unix(sudo:session): session closed for user root Aug 28 09:44:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e7405cbe-2efe-4fe8-b3b2-e6180f7d9997 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f71b9274-a5fb-4d28-83c9-c5e335720933" returned: 0 in 0.442s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:44:59 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e7405cbe-2efe-4fe8-b3b2-e6180f7d9997 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] <== create_volume: return (1799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:44:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e7405cbe-2efe-4fe8-b3b2-e6180f7d9997 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.802s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-15839e30-de88-4849-a36a-89b07c48b595 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.456s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:59 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-15839e30-de88-4849-a36a-89b07c48b595 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:44:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-294358419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e58d3c4-85ed-4010-a818-07713f614bf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b21d1119177f4fdbbdedc7dcc88b3fff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:44:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:44:59Z,use_quota=True,user_id='9f92b08a9ae54085a8f17b8636db963e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:44:59 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-15839e30-de88-4849-a36a-89b07c48b595 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Creating volume 1e58d3c4-85ed-4010-a818-07713f614bf6 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:44:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-15839e30-de88-4849-a36a-89b07c48b595 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-15839e30-de88-4849-a36a-89b07c48b595 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:59 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-15839e30-de88-4849-a36a-89b07c48b595 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:44:59 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-15839e30-de88-4849-a36a-89b07c48b595 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:44:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-15839e30-de88-4849-a36a-89b07c48b595 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:59 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-15839e30-de88-4849-a36a-89b07c48b595 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:44:59 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-15839e30-de88-4849-a36a-89b07c48b595 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:44:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-15839e30-de88-4849-a36a-89b07c48b595 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1e58d3c4-85ed-4010-a818-07713f614bf6 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-620abda4-5f20-4baa-b520-a8f0b96e717f tempest-VolumesCloneTest-1631533682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:44:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-620abda4-5f20-4baa-b520-a8f0b96e717f tempest-VolumesCloneTest-1631533682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:44:59 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-620abda4-5f20-4baa-b520-a8f0b96e717f tempest-VolumesCloneTest-1631533682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:44:59 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-620abda4-5f20-4baa-b520-a8f0b96e717f tempest-VolumesCloneTest-1631533682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:44:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-620abda4-5f20-4baa-b520-a8f0b96e717f tempest-VolumesCloneTest-1631533682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:44:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-620abda4-5f20-4baa-b520-a8f0b96e717f tempest-VolumesCloneTest-1631533682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:44:59 devstack sudo[101425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1e58d3c4-85ed-4010-a818-07713f614bf6 1073741824 Aug 28 09:44:59 devstack sudo[101425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:59 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e7405cbe-2efe-4fe8-b3b2-e6180f7d9997 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d9526a5-db54-4d33-97b1-bde2afc3b11b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f71b9274-a5fb-4d28-83c9-c5e335720933', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:59 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e7405cbe-2efe-4fe8-b3b2-e6180f7d9997 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e93552e6-63d2-443f-bd99-27ddd283655a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:44:59 devstack sudo[101426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:44:59 devstack sudo[101426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:44:59 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-e7405cbe-2efe-4fe8-b3b2-e6180f7d9997 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Volume volume-f71b9274-a5fb-4d28-83c9-c5e335720933 (f71b9274-a5fb-4d28-83c9-c5e335720933): created successfully Aug 28 09:44:59 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e7405cbe-2efe-4fe8-b3b2-e6180f7d9997 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e93552e6-63d2-443f-bd99-27ddd283655a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:44:59 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e7405cbe-2efe-4fe8-b3b2-e6180f7d9997 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Flow 'volume_create_manager' (3430bf13-413f-41a3-b922-09d8f661fc87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:45:00 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-e7405cbe-2efe-4fe8-b3b2-e6180f7d9997 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Created volume successfully. Aug 28 09:45:00 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-574efdc0-48ca-43ee-95eb-f0c45260cab7 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:45:00 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-574efdc0-48ca-43ee-95eb-f0c45260cab7 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Flow 'volume_create_manager' (161fbce6-5005-4318-9006-0b5a4e857342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:45:00 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-574efdc0-48ca-43ee-95eb-f0c45260cab7 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3ba0c57-046b-4025-a596-0787aa065ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:00 devstack sudo[101426]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:00 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-574efdc0-48ca-43ee-95eb-f0c45260cab7 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3ba0c57-046b-4025-a596-0787aa065ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:44:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-323336850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12285965-9d1b-4d15-bf74-947fbfa1eef3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b21d1119177f4fdbbdedc7dcc88b3fff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:45:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:45:00Z,use_quota=True,user_id='9f92b08a9ae54085a8f17b8636db963e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:00 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-574efdc0-48ca-43ee-95eb-f0c45260cab7 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00665a19-cd6c-4cf6-b7ff-99f857bf3a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:00 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-574efdc0-48ca-43ee-95eb-f0c45260cab7 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00665a19-cd6c-4cf6-b7ff-99f857bf3a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:00 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-574efdc0-48ca-43ee-95eb-f0c45260cab7 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2132e106-602a-449a-b88d-1a2bf644fa9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:00 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-574efdc0-48ca-43ee-95eb-f0c45260cab7 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2132e106-602a-449a-b88d-1a2bf644fa9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12285965-9d1b-4d15-bf74-947fbfa1eef3', 'volume_name': 'volume-12285965-9d1b-4d15-bf74-947fbfa1eef3', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:00 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-574efdc0-48ca-43ee-95eb-f0c45260cab7 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83d18027-54e2-4353-b211-54a065d8d056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:00 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-574efdc0-48ca-43ee-95eb-f0c45260cab7 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83d18027-54e2-4353-b211-54a065d8d056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:00 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-574efdc0-48ca-43ee-95eb-f0c45260cab7 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08feb102-37ee-426e-85b3-0c7df3039844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:00 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-574efdc0-48ca-43ee-95eb-f0c45260cab7 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Volume 12285965-9d1b-4d15-bf74-947fbfa1eef3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12285965-9d1b-4d15-bf74-947fbfa1eef3', 'volume_size': 1} Aug 28 09:45:00 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-574efdc0-48ca-43ee-95eb-f0c45260cab7 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:45:00 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-620abda4-5f20-4baa-b520-a8f0b96e717f tempest-VolumesCloneTest-1631533682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.704s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:00 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-620abda4-5f20-4baa-b520-a8f0b96e717f tempest-VolumesCloneTest-1631533682 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:45:00 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-620abda4-5f20-4baa-b520-a8f0b96e717f tempest-VolumesCloneTest-1631533682 None] Deleted volume successfully. Aug 28 09:45:00 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-620abda4-5f20-4baa-b520-a8f0b96e717f tempest-VolumesCloneTest-1631533682 None] Lock "cinder-a0058bf3-7ec2-4cdb-96fa-3e73ed5c8cc2-delete_volume" released by "delete_volume" :: held 3.467s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:45:00 devstack sudo[101425]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:00 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-15839e30-de88-4849-a36a-89b07c48b595 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1e58d3c4-85ed-4010-a818-07713f614bf6 1073741824" returned: 0 in 1.277s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-15839e30-de88-4849-a36a-89b07c48b595 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1e58d3c4-85ed-4010-a818-07713f614bf6 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:01 devstack sudo[101435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1e58d3c4-85ed-4010-a818-07713f614bf6 Aug 28 09:45:01 devstack sudo[101435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:01 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-e396b011-da21-49c2-a1ba-2d5481020cfb tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:45:01 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e396b011-da21-49c2-a1ba-2d5481020cfb tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Flow 'volume_create_manager' (378b42bb-a35c-4c82-9b09-bc192d074b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:45:01 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e396b011-da21-49c2-a1ba-2d5481020cfb tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2103da71-e66e-4ae9-9b5c-3dda775b5b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:01 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e396b011-da21-49c2-a1ba-2d5481020cfb tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2103da71-e66e-4ae9-9b5c-3dda775b5b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:45:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1277672702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39193ed0-b4e7-43c9-97e3-30ebeb4b61c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b21d1119177f4fdbbdedc7dcc88b3fff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:45:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:45:01Z,use_quota=True,user_id='9f92b08a9ae54085a8f17b8636db963e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:01 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e396b011-da21-49c2-a1ba-2d5481020cfb tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e460caf1-60e1-43d0-91ee-129853f5b0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:01 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e396b011-da21-49c2-a1ba-2d5481020cfb tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e460caf1-60e1-43d0-91ee-129853f5b0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:01 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e396b011-da21-49c2-a1ba-2d5481020cfb tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73ec8e68-a726-42ad-a635-1ebac8d3b3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:01 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e396b011-da21-49c2-a1ba-2d5481020cfb tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73ec8e68-a726-42ad-a635-1ebac8d3b3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39193ed0-b4e7-43c9-97e3-30ebeb4b61c6', 'volume_name': 'volume-39193ed0-b4e7-43c9-97e3-30ebeb4b61c6', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:01 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e396b011-da21-49c2-a1ba-2d5481020cfb tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8efaa8b6-ef0a-40de-907c-df37cfde33fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:01 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e396b011-da21-49c2-a1ba-2d5481020cfb tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8efaa8b6-ef0a-40de-907c-df37cfde33fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:01 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e396b011-da21-49c2-a1ba-2d5481020cfb tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d26cc87c-00b3-409d-badd-4aa7363fbc2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:01 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-e396b011-da21-49c2-a1ba-2d5481020cfb tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Volume 39193ed0-b4e7-43c9-97e3-30ebeb4b61c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39193ed0-b4e7-43c9-97e3-30ebeb4b61c6', 'volume_size': 1} Aug 28 09:45:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e396b011-da21-49c2-a1ba-2d5481020cfb tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:45:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-15839e30-de88-4849-a36a-89b07c48b595 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1e58d3c4-85ed-4010-a818-07713f614bf6" returned: 0 in 0.660s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:01 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-15839e30-de88-4849-a36a-89b07c48b595 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] <== create_volume: return (2068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:45:01 devstack sudo[101435]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-15839e30-de88-4849-a36a-89b07c48b595 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.072s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:45:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-574efdc0-48ca-43ee-95eb-f0c45260cab7 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.280s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:45:01 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-574efdc0-48ca-43ee-95eb-f0c45260cab7 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:44:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-323336850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12285965-9d1b-4d15-bf74-947fbfa1eef3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b21d1119177f4fdbbdedc7dcc88b3fff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:45:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:45:00Z,use_quota=True,user_id='9f92b08a9ae54085a8f17b8636db963e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:45:01 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-574efdc0-48ca-43ee-95eb-f0c45260cab7 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Creating volume 12285965-9d1b-4d15-bf74-947fbfa1eef3 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:45:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-574efdc0-48ca-43ee-95eb-f0c45260cab7 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:45:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-574efdc0-48ca-43ee-95eb-f0c45260cab7 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:45:01 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-574efdc0-48ca-43ee-95eb-f0c45260cab7 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:45:01 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-574efdc0-48ca-43ee-95eb-f0c45260cab7 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:45:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-574efdc0-48ca-43ee-95eb-f0c45260cab7 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:45:01 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-574efdc0-48ca-43ee-95eb-f0c45260cab7 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:45:01 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-574efdc0-48ca-43ee-95eb-f0c45260cab7 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:45:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-574efdc0-48ca-43ee-95eb-f0c45260cab7 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-12285965-9d1b-4d15-bf74-947fbfa1eef3 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:01 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-15839e30-de88-4849-a36a-89b07c48b595 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd8817aa-6a1e-4f64-88b2-684388655321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e58d3c4-85ed-4010-a818-07713f614bf6', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:01 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-15839e30-de88-4849-a36a-89b07c48b595 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfef34a7-ecbe-4d2e-816d-499a2409d887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:01 devstack sudo[101438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-12285965-9d1b-4d15-bf74-947fbfa1eef3 1073741824 Aug 28 09:45:01 devstack sudo[101438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:01 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-15839e30-de88-4849-a36a-89b07c48b595 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Volume volume-1e58d3c4-85ed-4010-a818-07713f614bf6 (1e58d3c4-85ed-4010-a818-07713f614bf6): created successfully Aug 28 09:45:01 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-15839e30-de88-4849-a36a-89b07c48b595 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfef34a7-ecbe-4d2e-816d-499a2409d887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:01 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-15839e30-de88-4849-a36a-89b07c48b595 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Flow 'volume_create_manager' (f9b61c74-87a0-4d04-acbe-b0c75404d848) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:45:01 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-15839e30-de88-4849-a36a-89b07c48b595 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Created volume successfully. Aug 28 09:45:02 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-55440406-b471-47ea-952b-c6b803cf6dce tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:45:02 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-55440406-b471-47ea-952b-c6b803cf6dce tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Flow 'volume_create_manager' (8c13d7f4-146e-4d28-b512-8f618163b349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:45:02 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-55440406-b471-47ea-952b-c6b803cf6dce tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b83fb800-0bb4-4b92-9de8-d0f39a90d9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:02 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-55440406-b471-47ea-952b-c6b803cf6dce tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b83fb800-0bb4-4b92-9de8-d0f39a90d9c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-852412993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59455b9a-7472-4787-b672-22ccc68e0a6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b21d1119177f4fdbbdedc7dcc88b3fff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:45:02Z,use_quota=True,user_id='9f92b08a9ae54085a8f17b8636db963e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:02 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-55440406-b471-47ea-952b-c6b803cf6dce tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02721be1-7743-419c-b134-796c4286ed12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:02 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-55440406-b471-47ea-952b-c6b803cf6dce tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02721be1-7743-419c-b134-796c4286ed12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:02 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-55440406-b471-47ea-952b-c6b803cf6dce tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58de4d78-e9e7-4366-8f36-cc8e32340909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:02 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-55440406-b471-47ea-952b-c6b803cf6dce tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58de4d78-e9e7-4366-8f36-cc8e32340909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59455b9a-7472-4787-b672-22ccc68e0a6a', 'volume_name': 'volume-59455b9a-7472-4787-b672-22ccc68e0a6a', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:02 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-55440406-b471-47ea-952b-c6b803cf6dce tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19cd5154-e969-4485-a20f-187100904538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:02 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-55440406-b471-47ea-952b-c6b803cf6dce tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19cd5154-e969-4485-a20f-187100904538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:02 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-55440406-b471-47ea-952b-c6b803cf6dce tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75e4c22f-793a-4ea4-bf9c-893a296c7653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:02 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-55440406-b471-47ea-952b-c6b803cf6dce tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Volume 59455b9a-7472-4787-b672-22ccc68e0a6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59455b9a-7472-4787-b672-22ccc68e0a6a', 'volume_size': 1} Aug 28 09:45:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-55440406-b471-47ea-952b-c6b803cf6dce tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:45:02 devstack sudo[101438]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-574efdc0-48ca-43ee-95eb-f0c45260cab7 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-12285965-9d1b-4d15-bf74-947fbfa1eef3 1073741824" returned: 0 in 0.885s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-574efdc0-48ca-43ee-95eb-f0c45260cab7 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-12285965-9d1b-4d15-bf74-947fbfa1eef3 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:02 devstack sudo[101447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-12285965-9d1b-4d15-bf74-947fbfa1eef3 Aug 28 09:45:02 devstack sudo[101447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:03 devstack sudo[101447]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-574efdc0-48ca-43ee-95eb-f0c45260cab7 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-12285965-9d1b-4d15-bf74-947fbfa1eef3" returned: 0 in 0.377s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:03 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-574efdc0-48ca-43ee-95eb-f0c45260cab7 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] <== create_volume: return (1319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:45:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-574efdc0-48ca-43ee-95eb-f0c45260cab7 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.323s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:45:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e396b011-da21-49c2-a1ba-2d5481020cfb tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.588s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:45:03 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e396b011-da21-49c2-a1ba-2d5481020cfb tempest-CreateVolumesFromSourceVolumeTest-931460019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:45:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1277672702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39193ed0-b4e7-43c9-97e3-30ebeb4b61c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b21d1119177f4fdbbdedc7dcc88b3fff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:45:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:45:01Z,use_quota=True,user_id='9f92b08a9ae54085a8f17b8636db963e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:45:03 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-e396b011-da21-49c2-a1ba-2d5481020cfb tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Creating volume 39193ed0-b4e7-43c9-97e3-30ebeb4b61c6 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:45:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e396b011-da21-49c2-a1ba-2d5481020cfb tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:45:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e396b011-da21-49c2-a1ba-2d5481020cfb tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:45:03 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e396b011-da21-49c2-a1ba-2d5481020cfb tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:45:03 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e396b011-da21-49c2-a1ba-2d5481020cfb tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:45:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e396b011-da21-49c2-a1ba-2d5481020cfb tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:45:03 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e396b011-da21-49c2-a1ba-2d5481020cfb tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:45:03 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-e396b011-da21-49c2-a1ba-2d5481020cfb tempest-CreateVolumesFromSourceVolumeTest-931460019 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:45:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e396b011-da21-49c2-a1ba-2d5481020cfb tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-39193ed0-b4e7-43c9-97e3-30ebeb4b61c6 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-574efdc0-48ca-43ee-95eb-f0c45260cab7 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08feb102-37ee-426e-85b3-0c7df3039844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12285965-9d1b-4d15-bf74-947fbfa1eef3', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-574efdc0-48ca-43ee-95eb-f0c45260cab7 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48f44353-e9bb-472a-9b4d-1598e1985810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:03 devstack sudo[101450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-39193ed0-b4e7-43c9-97e3-30ebeb4b61c6 1073741824 Aug 28 09:45:03 devstack sudo[101450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:03 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-574efdc0-48ca-43ee-95eb-f0c45260cab7 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Volume volume-12285965-9d1b-4d15-bf74-947fbfa1eef3 (12285965-9d1b-4d15-bf74-947fbfa1eef3): created successfully Aug 28 09:45:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-574efdc0-48ca-43ee-95eb-f0c45260cab7 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48f44353-e9bb-472a-9b4d-1598e1985810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-574efdc0-48ca-43ee-95eb-f0c45260cab7 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Flow 'volume_create_manager' (161fbce6-5005-4318-9006-0b5a4e857342) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:45:03 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-574efdc0-48ca-43ee-95eb-f0c45260cab7 tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Created volume successfully. Aug 28 09:45:03 devstack sudo[101450]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e396b011-da21-49c2-a1ba-2d5481020cfb tempest-CreateVolumesFromSourceVolumeTest-931460019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-39193ed0-b4e7-43c9-97e3-30ebeb4b61c6 1073741824" returned: 0 in 0.681s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e396b011-da21-49c2-a1ba-2d5481020cfb tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-39193ed0-b4e7-43c9-97e3-30ebeb4b61c6 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:03 devstack sudo[101456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-39193ed0-b4e7-43c9-97e3-30ebeb4b61c6 Aug 28 09:45:03 devstack sudo[101456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:04 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5642873-f82f-4944-b0f8-cfd2b175a747 tempest-TestMinimumBasicScenario-1075905623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:45:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e5642873-f82f-4944-b0f8-cfd2b175a747 tempest-TestMinimumBasicScenario-1075905623 None] Flow 'volume_create_manager' (abdeea98-4558-45b2-856b-023de581e526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:45:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e5642873-f82f-4944-b0f8-cfd2b175a747 tempest-TestMinimumBasicScenario-1075905623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75ad7902-68a4-423d-950d-e4c1fcc6c92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e5642873-f82f-4944-b0f8-cfd2b175a747 tempest-TestMinimumBasicScenario-1075905623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75ad7902-68a4-423d-950d-e4c1fcc6c92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:45:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1068822605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6d16b0a-c1a7-4c0b-8649-c9cf2c8729bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='070fdc264ff7405a8aa47f3324280214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:45:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:45:04Z,use_quota=True,user_id='31573792157c419a9959761bb6d98adf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e5642873-f82f-4944-b0f8-cfd2b175a747 tempest-TestMinimumBasicScenario-1075905623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28c91fdc-4a4a-4d42-bb16-7481f55819d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e5642873-f82f-4944-b0f8-cfd2b175a747 tempest-TestMinimumBasicScenario-1075905623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28c91fdc-4a4a-4d42-bb16-7481f55819d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e5642873-f82f-4944-b0f8-cfd2b175a747 tempest-TestMinimumBasicScenario-1075905623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bccca99-2a1f-40b8-a1ff-c6945afc54b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e5642873-f82f-4944-b0f8-cfd2b175a747 tempest-TestMinimumBasicScenario-1075905623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bccca99-2a1f-40b8-a1ff-c6945afc54b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6d16b0a-c1a7-4c0b-8649-c9cf2c8729bc', 'volume_name': 'volume-a6d16b0a-c1a7-4c0b-8649-c9cf2c8729bc', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:04 devstack sudo[101456]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e5642873-f82f-4944-b0f8-cfd2b175a747 tempest-TestMinimumBasicScenario-1075905623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4281f5fd-f214-47a3-8aac-ae514d72fa57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e5642873-f82f-4944-b0f8-cfd2b175a747 tempest-TestMinimumBasicScenario-1075905623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4281f5fd-f214-47a3-8aac-ae514d72fa57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e5642873-f82f-4944-b0f8-cfd2b175a747 tempest-TestMinimumBasicScenario-1075905623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f109707-6567-4e0e-b28c-02f83bda1d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:04 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-e5642873-f82f-4944-b0f8-cfd2b175a747 tempest-TestMinimumBasicScenario-1075905623 None] Volume a6d16b0a-c1a7-4c0b-8649-c9cf2c8729bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6d16b0a-c1a7-4c0b-8649-c9cf2c8729bc', 'volume_size': 1} Aug 28 09:45:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e5642873-f82f-4944-b0f8-cfd2b175a747 tempest-TestMinimumBasicScenario-1075905623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:45:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e396b011-da21-49c2-a1ba-2d5481020cfb tempest-CreateVolumesFromSourceVolumeTest-931460019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-39193ed0-b4e7-43c9-97e3-30ebeb4b61c6" returned: 0 in 0.345s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:04 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e396b011-da21-49c2-a1ba-2d5481020cfb tempest-CreateVolumesFromSourceVolumeTest-931460019 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:45:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e396b011-da21-49c2-a1ba-2d5481020cfb tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:45:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-55440406-b471-47ea-952b-c6b803cf6dce tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.888s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:45:04 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-55440406-b471-47ea-952b-c6b803cf6dce tempest-CreateVolumesFromSourceVolumeTest-931460019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-852412993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59455b9a-7472-4787-b672-22ccc68e0a6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b21d1119177f4fdbbdedc7dcc88b3fff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:45:02Z,use_quota=True,user_id='9f92b08a9ae54085a8f17b8636db963e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:45:04 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-55440406-b471-47ea-952b-c6b803cf6dce tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Creating volume 59455b9a-7472-4787-b672-22ccc68e0a6a {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:45:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-55440406-b471-47ea-952b-c6b803cf6dce tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:45:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-55440406-b471-47ea-952b-c6b803cf6dce tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:45:04 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-55440406-b471-47ea-952b-c6b803cf6dce tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:45:04 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-55440406-b471-47ea-952b-c6b803cf6dce tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:45:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-55440406-b471-47ea-952b-c6b803cf6dce tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:45:04 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-55440406-b471-47ea-952b-c6b803cf6dce tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:45:04 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-55440406-b471-47ea-952b-c6b803cf6dce tempest-CreateVolumesFromSourceVolumeTest-931460019 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:45:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-55440406-b471-47ea-952b-c6b803cf6dce tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-59455b9a-7472-4787-b672-22ccc68e0a6a 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e396b011-da21-49c2-a1ba-2d5481020cfb tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d26cc87c-00b3-409d-badd-4aa7363fbc2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39193ed0-b4e7-43c9-97e3-30ebeb4b61c6', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:04 devstack sudo[101465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-59455b9a-7472-4787-b672-22ccc68e0a6a 1073741824 Aug 28 09:45:04 devstack sudo[101465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e396b011-da21-49c2-a1ba-2d5481020cfb tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd27b458-9afe-49a2-bde2-45070a830460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:04 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-e396b011-da21-49c2-a1ba-2d5481020cfb tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Volume volume-39193ed0-b4e7-43c9-97e3-30ebeb4b61c6 (39193ed0-b4e7-43c9-97e3-30ebeb4b61c6): created successfully Aug 28 09:45:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e396b011-da21-49c2-a1ba-2d5481020cfb tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd27b458-9afe-49a2-bde2-45070a830460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e396b011-da21-49c2-a1ba-2d5481020cfb tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Flow 'volume_create_manager' (378b42bb-a35c-4c82-9b09-bc192d074b8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:45:04 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-e396b011-da21-49c2-a1ba-2d5481020cfb tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Created volume successfully. Aug 28 09:45:04 devstack sudo[101465]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-55440406-b471-47ea-952b-c6b803cf6dce tempest-CreateVolumesFromSourceVolumeTest-931460019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-59455b9a-7472-4787-b672-22ccc68e0a6a 1073741824" returned: 0 in 0.523s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-55440406-b471-47ea-952b-c6b803cf6dce tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-59455b9a-7472-4787-b672-22ccc68e0a6a {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:04 devstack sudo[101471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-59455b9a-7472-4787-b672-22ccc68e0a6a Aug 28 09:45:04 devstack sudo[101471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:04 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d2632df-155a-46c9-863c-132f193671a1 tempest-VolumesListTestJSON-1209204228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:45:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-9d2632df-155a-46c9-863c-132f193671a1 tempest-VolumesListTestJSON-1209204228 None] Flow 'volume_create_manager' (bfc6569e-f0c5-42b0-974f-a85fb4c06d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:45:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-9d2632df-155a-46c9-863c-132f193671a1 tempest-VolumesListTestJSON-1209204228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bf1d8e0-186d-45b5-99bf-bb531aeece09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-9d2632df-155a-46c9-863c-132f193671a1 tempest-VolumesListTestJSON-1209204228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bf1d8e0-186d-45b5-99bf-bb531aeece09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:45:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1239062910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=553b77bb-351e-41ec-afa4-0131309d9c20,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='055ecda835f74138bb881ae59d42f1a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:45:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:45:05Z,use_quota=True,user_id='1f92739a2964452789cde214c6f62750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-9d2632df-155a-46c9-863c-132f193671a1 tempest-VolumesListTestJSON-1209204228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25f020e3-cdfc-4e50-b66a-91e5c0e2fd2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-9d2632df-155a-46c9-863c-132f193671a1 tempest-VolumesListTestJSON-1209204228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25f020e3-cdfc-4e50-b66a-91e5c0e2fd2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-9d2632df-155a-46c9-863c-132f193671a1 tempest-VolumesListTestJSON-1209204228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac2f956b-2291-47ca-bbe0-084a9e51e4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-9d2632df-155a-46c9-863c-132f193671a1 tempest-VolumesListTestJSON-1209204228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac2f956b-2291-47ca-bbe0-084a9e51e4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '553b77bb-351e-41ec-afa4-0131309d9c20', 'volume_name': 'volume-553b77bb-351e-41ec-afa4-0131309d9c20', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-9d2632df-155a-46c9-863c-132f193671a1 tempest-VolumesListTestJSON-1209204228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20060d52-c22d-4a8a-8fa3-02171457a566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-9d2632df-155a-46c9-863c-132f193671a1 tempest-VolumesListTestJSON-1209204228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20060d52-c22d-4a8a-8fa3-02171457a566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-9d2632df-155a-46c9-863c-132f193671a1 tempest-VolumesListTestJSON-1209204228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70770240-6f75-4211-b9f9-1aaab3ea7f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:04 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-9d2632df-155a-46c9-863c-132f193671a1 tempest-VolumesListTestJSON-1209204228 None] Volume 553b77bb-351e-41ec-afa4-0131309d9c20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-553b77bb-351e-41ec-afa4-0131309d9c20', 'volume_size': 1} Aug 28 09:45:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-9d2632df-155a-46c9-863c-132f193671a1 tempest-VolumesListTestJSON-1209204228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:45:05 devstack sudo[101471]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-55440406-b471-47ea-952b-c6b803cf6dce tempest-CreateVolumesFromSourceVolumeTest-931460019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-59455b9a-7472-4787-b672-22ccc68e0a6a" returned: 0 in 0.320s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:05 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-55440406-b471-47ea-952b-c6b803cf6dce tempest-CreateVolumesFromSourceVolumeTest-931460019 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:45:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-55440406-b471-47ea-952b-c6b803cf6dce tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:45:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e5642873-f82f-4944-b0f8-cfd2b175a747 tempest-TestMinimumBasicScenario-1075905623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.923s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:45:05 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e5642873-f82f-4944-b0f8-cfd2b175a747 tempest-TestMinimumBasicScenario-1075905623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:45:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1068822605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6d16b0a-c1a7-4c0b-8649-c9cf2c8729bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='070fdc264ff7405a8aa47f3324280214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:45:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:45:04Z,use_quota=True,user_id='31573792157c419a9959761bb6d98adf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:45:05 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-e5642873-f82f-4944-b0f8-cfd2b175a747 tempest-TestMinimumBasicScenario-1075905623 None] Creating volume a6d16b0a-c1a7-4c0b-8649-c9cf2c8729bc {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:45:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e5642873-f82f-4944-b0f8-cfd2b175a747 tempest-TestMinimumBasicScenario-1075905623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:45:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e5642873-f82f-4944-b0f8-cfd2b175a747 tempest-TestMinimumBasicScenario-1075905623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:45:05 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e5642873-f82f-4944-b0f8-cfd2b175a747 tempest-TestMinimumBasicScenario-1075905623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:45:05 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e5642873-f82f-4944-b0f8-cfd2b175a747 tempest-TestMinimumBasicScenario-1075905623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:45:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e5642873-f82f-4944-b0f8-cfd2b175a747 tempest-TestMinimumBasicScenario-1075905623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:45:05 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e5642873-f82f-4944-b0f8-cfd2b175a747 tempest-TestMinimumBasicScenario-1075905623 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:45:05 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-e5642873-f82f-4944-b0f8-cfd2b175a747 tempest-TestMinimumBasicScenario-1075905623 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:45:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e5642873-f82f-4944-b0f8-cfd2b175a747 tempest-TestMinimumBasicScenario-1075905623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a6d16b0a-c1a7-4c0b-8649-c9cf2c8729bc 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:05 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-55440406-b471-47ea-952b-c6b803cf6dce tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75e4c22f-793a-4ea4-bf9c-893a296c7653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59455b9a-7472-4787-b672-22ccc68e0a6a', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:05 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-55440406-b471-47ea-952b-c6b803cf6dce tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e681493-bd93-4a95-a289-099cc709207a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:05 devstack sudo[101474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a6d16b0a-c1a7-4c0b-8649-c9cf2c8729bc 1073741824 Aug 28 09:45:05 devstack sudo[101474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:05 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-55440406-b471-47ea-952b-c6b803cf6dce tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Volume volume-59455b9a-7472-4787-b672-22ccc68e0a6a (59455b9a-7472-4787-b672-22ccc68e0a6a): created successfully Aug 28 09:45:05 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-55440406-b471-47ea-952b-c6b803cf6dce tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e681493-bd93-4a95-a289-099cc709207a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:05 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-55440406-b471-47ea-952b-c6b803cf6dce tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Flow 'volume_create_manager' (8c13d7f4-146e-4d28-b512-8f618163b349) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:45:05 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-55440406-b471-47ea-952b-c6b803cf6dce tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Created volume successfully. Aug 28 09:45:05 devstack sudo[101474]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e5642873-f82f-4944-b0f8-cfd2b175a747 tempest-TestMinimumBasicScenario-1075905623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a6d16b0a-c1a7-4c0b-8649-c9cf2c8729bc 1073741824" returned: 0 in 0.408s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e5642873-f82f-4944-b0f8-cfd2b175a747 tempest-TestMinimumBasicScenario-1075905623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a6d16b0a-c1a7-4c0b-8649-c9cf2c8729bc {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:05 devstack sudo[101479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a6d16b0a-c1a7-4c0b-8649-c9cf2c8729bc Aug 28 09:45:05 devstack sudo[101479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:05 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4bd12887-ada4-4a21-a2ce-e8eb8e4445af tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Acquiring lock "cinder-59455b9a-7472-4787-b672-22ccc68e0a6a-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:45:05 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4bd12887-ada4-4a21-a2ce-e8eb8e4445af tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "cinder-59455b9a-7472-4787-b672-22ccc68e0a6a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:45:05 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4bd12887-ada4-4a21-a2ce-e8eb8e4445af tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Acquiring lock "cinder-quobyte-59455b9a-7472-4787-b672-22ccc68e0a6a" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:45:05 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4bd12887-ada4-4a21-a2ce-e8eb8e4445af tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "cinder-quobyte-59455b9a-7472-4787-b672-22ccc68e0a6a" acquired by "delete_volume" :: waited 0.027s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:45:05 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72b0279-bce4-4c0c-88d1-74344a27b2bc]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:45:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4bd12887-ada4-4a21-a2ce-e8eb8e4445af tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-59455b9a-7472-4787-b672-22ccc68e0a6a {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:05 devstack sudo[101479]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e5642873-f82f-4944-b0f8-cfd2b175a747 tempest-TestMinimumBasicScenario-1075905623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a6d16b0a-c1a7-4c0b-8649-c9cf2c8729bc" returned: 0 in 0.316s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:05 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e5642873-f82f-4944-b0f8-cfd2b175a747 tempest-TestMinimumBasicScenario-1075905623 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:45:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e5642873-f82f-4944-b0f8-cfd2b175a747 tempest-TestMinimumBasicScenario-1075905623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:45:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-9d2632df-155a-46c9-863c-132f193671a1 tempest-VolumesListTestJSON-1209204228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.854s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:45:05 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-9d2632df-155a-46c9-863c-132f193671a1 tempest-VolumesListTestJSON-1209204228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:45:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1239062910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=553b77bb-351e-41ec-afa4-0131309d9c20,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='055ecda835f74138bb881ae59d42f1a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:45:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:45:05Z,use_quota=True,user_id='1f92739a2964452789cde214c6f62750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:45:05 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-9d2632df-155a-46c9-863c-132f193671a1 tempest-VolumesListTestJSON-1209204228 None] Creating volume 553b77bb-351e-41ec-afa4-0131309d9c20 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:45:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-9d2632df-155a-46c9-863c-132f193671a1 tempest-VolumesListTestJSON-1209204228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:45:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-9d2632df-155a-46c9-863c-132f193671a1 tempest-VolumesListTestJSON-1209204228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:45:05 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-9d2632df-155a-46c9-863c-132f193671a1 tempest-VolumesListTestJSON-1209204228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:45:05 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-9d2632df-155a-46c9-863c-132f193671a1 tempest-VolumesListTestJSON-1209204228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:45:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-9d2632df-155a-46c9-863c-132f193671a1 tempest-VolumesListTestJSON-1209204228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:45:05 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-9d2632df-155a-46c9-863c-132f193671a1 tempest-VolumesListTestJSON-1209204228 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:45:05 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-9d2632df-155a-46c9-863c-132f193671a1 tempest-VolumesListTestJSON-1209204228 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:45:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9d2632df-155a-46c9-863c-132f193671a1 tempest-VolumesListTestJSON-1209204228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-553b77bb-351e-41ec-afa4-0131309d9c20 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:05 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e5642873-f82f-4944-b0f8-cfd2b175a747 tempest-TestMinimumBasicScenario-1075905623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f109707-6567-4e0e-b28c-02f83bda1d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6d16b0a-c1a7-4c0b-8649-c9cf2c8729bc', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:05 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e5642873-f82f-4944-b0f8-cfd2b175a747 tempest-TestMinimumBasicScenario-1075905623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24019eb2-1597-48ce-a97f-c5ad5b5dcb84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:05 devstack sudo[101483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-553b77bb-351e-41ec-afa4-0131309d9c20 1073741824 Aug 28 09:45:05 devstack sudo[101483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:05 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-e5642873-f82f-4944-b0f8-cfd2b175a747 tempest-TestMinimumBasicScenario-1075905623 None] Volume volume-a6d16b0a-c1a7-4c0b-8649-c9cf2c8729bc (a6d16b0a-c1a7-4c0b-8649-c9cf2c8729bc): created successfully Aug 28 09:45:05 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e5642873-f82f-4944-b0f8-cfd2b175a747 tempest-TestMinimumBasicScenario-1075905623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24019eb2-1597-48ce-a97f-c5ad5b5dcb84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:05 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e5642873-f82f-4944-b0f8-cfd2b175a747 tempest-TestMinimumBasicScenario-1075905623 None] Flow 'volume_create_manager' (abdeea98-4558-45b2-856b-023de581e526) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:45:05 devstack sudo[101482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-59455b9a-7472-4787-b672-22ccc68e0a6a Aug 28 09:45:05 devstack sudo[101482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:05 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-e5642873-f82f-4944-b0f8-cfd2b175a747 tempest-TestMinimumBasicScenario-1075905623 None] Created volume successfully. Aug 28 09:45:06 devstack sudo[101482]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4bd12887-ada4-4a21-a2ce-e8eb8e4445af tempest-CreateVolumesFromSourceVolumeTest-931460019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-59455b9a-7472-4787-b672-22ccc68e0a6a" returned: 0 in 0.466s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4bd12887-ada4-4a21-a2ce-e8eb8e4445af tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-59455b9a-7472-4787-b672-22ccc68e0a6a {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:06 devstack sudo[101493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-59455b9a-7472-4787-b672-22ccc68e0a6a Aug 28 09:45:06 devstack sudo[101493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:06 devstack sudo[101483]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9d2632df-155a-46c9-863c-132f193671a1 tempest-VolumesListTestJSON-1209204228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-553b77bb-351e-41ec-afa4-0131309d9c20 1073741824" returned: 0 in 0.639s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9d2632df-155a-46c9-863c-132f193671a1 tempest-VolumesListTestJSON-1209204228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-553b77bb-351e-41ec-afa4-0131309d9c20 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:06 devstack sudo[101500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-553b77bb-351e-41ec-afa4-0131309d9c20 Aug 28 09:45:06 devstack sudo[101500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:06 devstack sudo[101493]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4bd12887-ada4-4a21-a2ce-e8eb8e4445af tempest-CreateVolumesFromSourceVolumeTest-931460019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-59455b9a-7472-4787-b672-22ccc68e0a6a" returned: 0 in 0.331s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:06 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4bd12887-ada4-4a21-a2ce-e8eb8e4445af tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "cinder-quobyte-59455b9a-7472-4787-b672-22ccc68e0a6a" released by "delete_volume" :: held 0.871s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:45:06 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-4bd12887-ada4-4a21-a2ce-e8eb8e4445af tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Created reservations ['8903e1ad-abdf-4416-90be-a0fb9691ddb7', '0a925a33-8a11-409c-965d-66888ad97c47', '99df549d-61dc-45c6-a73e-ac66e077a50c', '847d4b21-b9bf-489c-ae81-3652fede7d7a'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:45:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-4bd12887-ada4-4a21-a2ce-e8eb8e4445af tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:45:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-4bd12887-ada4-4a21-a2ce-e8eb8e4445af tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:45:06 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-4bd12887-ada4-4a21-a2ce-e8eb8e4445af tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:45:06 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-4bd12887-ada4-4a21-a2ce-e8eb8e4445af tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:45:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-4bd12887-ada4-4a21-a2ce-e8eb8e4445af tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:45:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4bd12887-ada4-4a21-a2ce-e8eb8e4445af tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:06 devstack sudo[101500]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9d2632df-155a-46c9-863c-132f193671a1 tempest-VolumesListTestJSON-1209204228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-553b77bb-351e-41ec-afa4-0131309d9c20" returned: 0 in 0.381s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:06 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-9d2632df-155a-46c9-863c-132f193671a1 tempest-VolumesListTestJSON-1209204228 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:45:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-9d2632df-155a-46c9-863c-132f193671a1 tempest-VolumesListTestJSON-1209204228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:45:06 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8cf4e890-2f29-45aa-8ee1-6e304124987a tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Acquiring lock "cinder-39193ed0-b4e7-43c9-97e3-30ebeb4b61c6-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:45:06 devstack sudo[101503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:45:06 devstack sudo[101503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:07 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-9d2632df-155a-46c9-863c-132f193671a1 tempest-VolumesListTestJSON-1209204228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70770240-6f75-4211-b9f9-1aaab3ea7f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-553b77bb-351e-41ec-afa4-0131309d9c20', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:07 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-9d2632df-155a-46c9-863c-132f193671a1 tempest-VolumesListTestJSON-1209204228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6df648d-49bf-40cd-9b7b-b18cb17807d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:07 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8cf4e890-2f29-45aa-8ee1-6e304124987a tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "cinder-39193ed0-b4e7-43c9-97e3-30ebeb4b61c6-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:45:07 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-9d2632df-155a-46c9-863c-132f193671a1 tempest-VolumesListTestJSON-1209204228 None] Volume volume-553b77bb-351e-41ec-afa4-0131309d9c20 (553b77bb-351e-41ec-afa4-0131309d9c20): created successfully Aug 28 09:45:07 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-9d2632df-155a-46c9-863c-132f193671a1 tempest-VolumesListTestJSON-1209204228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6df648d-49bf-40cd-9b7b-b18cb17807d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:07 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-9d2632df-155a-46c9-863c-132f193671a1 tempest-VolumesListTestJSON-1209204228 None] Flow 'volume_create_manager' (bfc6569e-f0c5-42b0-974f-a85fb4c06d39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:45:07 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-9d2632df-155a-46c9-863c-132f193671a1 tempest-VolumesListTestJSON-1209204228 None] Created volume successfully. Aug 28 09:45:07 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8cf4e890-2f29-45aa-8ee1-6e304124987a tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Acquiring lock "cinder-quobyte-39193ed0-b4e7-43c9-97e3-30ebeb4b61c6" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:45:07 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8cf4e890-2f29-45aa-8ee1-6e304124987a tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "cinder-quobyte-39193ed0-b4e7-43c9-97e3-30ebeb4b61c6" acquired by "delete_volume" :: waited 0.021s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:45:07 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[256f4624-9a2f-45f8-a8b9-40ac8713ed6a]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:45:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8cf4e890-2f29-45aa-8ee1-6e304124987a tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-39193ed0-b4e7-43c9-97e3-30ebeb4b61c6 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:07 devstack sudo[101503]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4bd12887-ada4-4a21-a2ce-e8eb8e4445af tempest-CreateVolumesFromSourceVolumeTest-931460019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.410s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:07 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-4bd12887-ada4-4a21-a2ce-e8eb8e4445af tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:45:07 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-4bd12887-ada4-4a21-a2ce-e8eb8e4445af tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Deleted volume successfully. Aug 28 09:45:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-9eaf401c-a3a6-4ac1-8aaa-c02694094263 req-aaae52bf-b54f-49a9-b9dd-438a0207ab42 tempest-TestMinimumBasicScenario-1075905623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:45:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-9eaf401c-a3a6-4ac1-8aaa-c02694094263 req-aaae52bf-b54f-49a9-b9dd-438a0207ab42 tempest-TestMinimumBasicScenario-1075905623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:45:07 devstack sudo[101513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-39193ed0-b4e7-43c9-97e3-30ebeb4b61c6 Aug 28 09:45:07 devstack sudo[101513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:07 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4bd12887-ada4-4a21-a2ce-e8eb8e4445af tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "cinder-59455b9a-7472-4787-b672-22ccc68e0a6a-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:45:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-9eaf401c-a3a6-4ac1-8aaa-c02694094263 req-aaae52bf-b54f-49a9-b9dd-438a0207ab42 tempest-TestMinimumBasicScenario-1075905623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:45:07 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-9eaf401c-a3a6-4ac1-8aaa-c02694094263 req-aaae52bf-b54f-49a9-b9dd-438a0207ab42 tempest-TestMinimumBasicScenario-1075905623 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b', 'name': 'volume-a6d16b0a-c1a7-4c0b-8649-c9cf2c8729bc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ddc934be-442b-4297-9676-2556b8473cc4', 'enforce_multipath': True} {{(pid=86081) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 09:45:07 devstack cinder-volume[86081]: INFO cinder.volume.manager [req-9eaf401c-a3a6-4ac1-8aaa-c02694094263 req-aaae52bf-b54f-49a9-b9dd-438a0207ab42 tempest-TestMinimumBasicScenario-1075905623 None] attachment_update completed successfully. Aug 28 09:45:07 devstack sudo[101513]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8cf4e890-2f29-45aa-8ee1-6e304124987a tempest-CreateVolumesFromSourceVolumeTest-931460019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-39193ed0-b4e7-43c9-97e3-30ebeb4b61c6" returned: 0 in 0.453s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8cf4e890-2f29-45aa-8ee1-6e304124987a tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-39193ed0-b4e7-43c9-97e3-30ebeb4b61c6 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:07 devstack sudo[101565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-39193ed0-b4e7-43c9-97e3-30ebeb4b61c6 Aug 28 09:45:07 devstack sudo[101565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:08 devstack sudo[101565]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8cf4e890-2f29-45aa-8ee1-6e304124987a tempest-CreateVolumesFromSourceVolumeTest-931460019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-39193ed0-b4e7-43c9-97e3-30ebeb4b61c6" returned: 0 in 0.365s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:08 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8cf4e890-2f29-45aa-8ee1-6e304124987a tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "cinder-quobyte-39193ed0-b4e7-43c9-97e3-30ebeb4b61c6" released by "delete_volume" :: held 0.872s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:45:08 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-8cf4e890-2f29-45aa-8ee1-6e304124987a tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Created reservations ['584f13ea-b284-4733-b225-9429f9f08ebc', '01d5e8c1-5d7d-41b5-96ec-0376bfcb5603', '9b6f0fce-66c8-4bfc-903c-3557af6242c3', '42855e2e-648a-45e4-9f58-cc5ce005b08a'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:45:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8cf4e890-2f29-45aa-8ee1-6e304124987a tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:45:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8cf4e890-2f29-45aa-8ee1-6e304124987a tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:45:08 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-8cf4e890-2f29-45aa-8ee1-6e304124987a tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:45:08 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-8cf4e890-2f29-45aa-8ee1-6e304124987a tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:45:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8cf4e890-2f29-45aa-8ee1-6e304124987a tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:45:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8cf4e890-2f29-45aa-8ee1-6e304124987a tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:08 devstack sudo[101905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:45:08 devstack sudo[101905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:08 devstack sudo[101905]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8cf4e890-2f29-45aa-8ee1-6e304124987a tempest-CreateVolumesFromSourceVolumeTest-931460019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.401s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:08 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-8cf4e890-2f29-45aa-8ee1-6e304124987a tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:45:08 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-8cf4e890-2f29-45aa-8ee1-6e304124987a tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Deleted volume successfully. Aug 28 09:45:08 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8cf4e890-2f29-45aa-8ee1-6e304124987a tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "cinder-39193ed0-b4e7-43c9-97e3-30ebeb4b61c6-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:45:08 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-394474e0-60f9-4617-b23e-552420461f2c tempest-VolumesListTestJSON-1209204228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:45:08 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-394474e0-60f9-4617-b23e-552420461f2c tempest-VolumesListTestJSON-1209204228 None] Flow 'volume_create_manager' (4eb0a10c-a3ae-4e55-9f41-720dfc8bc153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:45:08 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-394474e0-60f9-4617-b23e-552420461f2c tempest-VolumesListTestJSON-1209204228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d79c5d7a-fc7d-4fd4-9564-6b1c37f30e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:08 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-394474e0-60f9-4617-b23e-552420461f2c tempest-VolumesListTestJSON-1209204228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d79c5d7a-fc7d-4fd4-9564-6b1c37f30e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:45:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-20259391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=469fb80e-a629-456e-8ee5-372f5857c79a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='055ecda835f74138bb881ae59d42f1a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:45:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:45:09Z,use_quota=True,user_id='1f92739a2964452789cde214c6f62750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:08 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-394474e0-60f9-4617-b23e-552420461f2c tempest-VolumesListTestJSON-1209204228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d02637f-b205-437d-8c05-afbb8a2afd12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:08 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-394474e0-60f9-4617-b23e-552420461f2c tempest-VolumesListTestJSON-1209204228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d02637f-b205-437d-8c05-afbb8a2afd12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:08 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-394474e0-60f9-4617-b23e-552420461f2c tempest-VolumesListTestJSON-1209204228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d1337f0-f1a0-4e8c-9bc1-2d85cf908f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:08 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-394474e0-60f9-4617-b23e-552420461f2c tempest-VolumesListTestJSON-1209204228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d1337f0-f1a0-4e8c-9bc1-2d85cf908f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '469fb80e-a629-456e-8ee5-372f5857c79a', 'volume_name': 'volume-469fb80e-a629-456e-8ee5-372f5857c79a', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:08 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-394474e0-60f9-4617-b23e-552420461f2c tempest-VolumesListTestJSON-1209204228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c18676e-b20f-44ef-b8d5-73ef35e9ad72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:08 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-394474e0-60f9-4617-b23e-552420461f2c tempest-VolumesListTestJSON-1209204228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c18676e-b20f-44ef-b8d5-73ef35e9ad72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:08 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-394474e0-60f9-4617-b23e-552420461f2c tempest-VolumesListTestJSON-1209204228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83666b1c-8c18-420a-85d8-82d44dc1b5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:08 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-394474e0-60f9-4617-b23e-552420461f2c tempest-VolumesListTestJSON-1209204228 None] Volume 469fb80e-a629-456e-8ee5-372f5857c79a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-469fb80e-a629-456e-8ee5-372f5857c79a', 'volume_size': 1} Aug 28 09:45:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-394474e0-60f9-4617-b23e-552420461f2c tempest-VolumesListTestJSON-1209204228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:45:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-394474e0-60f9-4617-b23e-552420461f2c tempest-VolumesListTestJSON-1209204228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:45:08 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-394474e0-60f9-4617-b23e-552420461f2c tempest-VolumesListTestJSON-1209204228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:45:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-20259391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=469fb80e-a629-456e-8ee5-372f5857c79a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='055ecda835f74138bb881ae59d42f1a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:45:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:45:09Z,use_quota=True,user_id='1f92739a2964452789cde214c6f62750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:45:08 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-394474e0-60f9-4617-b23e-552420461f2c tempest-VolumesListTestJSON-1209204228 None] Creating volume 469fb80e-a629-456e-8ee5-372f5857c79a {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:45:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-394474e0-60f9-4617-b23e-552420461f2c tempest-VolumesListTestJSON-1209204228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:45:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-394474e0-60f9-4617-b23e-552420461f2c tempest-VolumesListTestJSON-1209204228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:45:08 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-394474e0-60f9-4617-b23e-552420461f2c tempest-VolumesListTestJSON-1209204228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:45:08 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-394474e0-60f9-4617-b23e-552420461f2c tempest-VolumesListTestJSON-1209204228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:45:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-394474e0-60f9-4617-b23e-552420461f2c tempest-VolumesListTestJSON-1209204228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:45:08 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-394474e0-60f9-4617-b23e-552420461f2c tempest-VolumesListTestJSON-1209204228 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:45:08 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-394474e0-60f9-4617-b23e-552420461f2c tempest-VolumesListTestJSON-1209204228 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:45:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-394474e0-60f9-4617-b23e-552420461f2c tempest-VolumesListTestJSON-1209204228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-469fb80e-a629-456e-8ee5-372f5857c79a 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:08 devstack sudo[101908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-469fb80e-a629-456e-8ee5-372f5857c79a 1073741824 Aug 28 09:45:08 devstack sudo[101908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:09 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4cdc9b57-569d-4337-831e-4cd4e63202ab tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Acquiring lock "cinder-12285965-9d1b-4d15-bf74-947fbfa1eef3-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:45:09 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4cdc9b57-569d-4337-831e-4cd4e63202ab tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "cinder-12285965-9d1b-4d15-bf74-947fbfa1eef3-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:45:09 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4cdc9b57-569d-4337-831e-4cd4e63202ab tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Acquiring lock "cinder-quobyte-12285965-9d1b-4d15-bf74-947fbfa1eef3" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:45:09 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4cdc9b57-569d-4337-831e-4cd4e63202ab tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "cinder-quobyte-12285965-9d1b-4d15-bf74-947fbfa1eef3" acquired by "delete_volume" :: waited 0.025s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:45:09 devstack sudo[101908]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-394474e0-60f9-4617-b23e-552420461f2c tempest-VolumesListTestJSON-1209204228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-469fb80e-a629-456e-8ee5-372f5857c79a 1073741824" returned: 0 in 0.536s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:09 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[38057614-323a-402a-b3fe-3458f996431b]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:45:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4cdc9b57-569d-4337-831e-4cd4e63202ab tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-12285965-9d1b-4d15-bf74-947fbfa1eef3 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-394474e0-60f9-4617-b23e-552420461f2c tempest-VolumesListTestJSON-1209204228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-469fb80e-a629-456e-8ee5-372f5857c79a {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:09 devstack sudo[101916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-469fb80e-a629-456e-8ee5-372f5857c79a Aug 28 09:45:09 devstack sudo[101916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:09 devstack sudo[101915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-12285965-9d1b-4d15-bf74-947fbfa1eef3 Aug 28 09:45:09 devstack sudo[101915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:09 devstack sudo[101916]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-394474e0-60f9-4617-b23e-552420461f2c tempest-VolumesListTestJSON-1209204228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-469fb80e-a629-456e-8ee5-372f5857c79a" returned: 0 in 0.375s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:09 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-394474e0-60f9-4617-b23e-552420461f2c tempest-VolumesListTestJSON-1209204228 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:45:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-394474e0-60f9-4617-b23e-552420461f2c tempest-VolumesListTestJSON-1209204228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:45:09 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-394474e0-60f9-4617-b23e-552420461f2c tempest-VolumesListTestJSON-1209204228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83666b1c-8c18-420a-85d8-82d44dc1b5d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-469fb80e-a629-456e-8ee5-372f5857c79a', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:09 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-394474e0-60f9-4617-b23e-552420461f2c tempest-VolumesListTestJSON-1209204228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e25053ac-04ae-4771-bcfe-3fbbf3b1fa92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:09 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-394474e0-60f9-4617-b23e-552420461f2c tempest-VolumesListTestJSON-1209204228 None] Volume volume-469fb80e-a629-456e-8ee5-372f5857c79a (469fb80e-a629-456e-8ee5-372f5857c79a): created successfully Aug 28 09:45:09 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-394474e0-60f9-4617-b23e-552420461f2c tempest-VolumesListTestJSON-1209204228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e25053ac-04ae-4771-bcfe-3fbbf3b1fa92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:09 devstack sudo[101915]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:09 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-394474e0-60f9-4617-b23e-552420461f2c tempest-VolumesListTestJSON-1209204228 None] Flow 'volume_create_manager' (4eb0a10c-a3ae-4e55-9f41-720dfc8bc153) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:45:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4cdc9b57-569d-4337-831e-4cd4e63202ab tempest-CreateVolumesFromSourceVolumeTest-931460019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-12285965-9d1b-4d15-bf74-947fbfa1eef3" returned: 0 in 0.488s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4cdc9b57-569d-4337-831e-4cd4e63202ab tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-12285965-9d1b-4d15-bf74-947fbfa1eef3 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:09 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-394474e0-60f9-4617-b23e-552420461f2c tempest-VolumesListTestJSON-1209204228 None] Created volume successfully. Aug 28 09:45:09 devstack sudo[101923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-12285965-9d1b-4d15-bf74-947fbfa1eef3 Aug 28 09:45:09 devstack sudo[101923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:10 devstack sudo[101923]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4cdc9b57-569d-4337-831e-4cd4e63202ab tempest-CreateVolumesFromSourceVolumeTest-931460019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-12285965-9d1b-4d15-bf74-947fbfa1eef3" returned: 0 in 0.290s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:10 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4cdc9b57-569d-4337-831e-4cd4e63202ab tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "cinder-quobyte-12285965-9d1b-4d15-bf74-947fbfa1eef3" released by "delete_volume" :: held 0.835s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:45:10 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-4cdc9b57-569d-4337-831e-4cd4e63202ab tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Created reservations ['0a9c8b54-8b5b-45fc-a434-3504570367db', 'c0e003d2-af57-4cdf-8ed0-f4226eb3a099', 'b73c30fe-0e09-454f-8c9f-5e7a752603a8', '63c5ddc1-fcf7-4861-b526-a35f19531db2'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:45:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-4cdc9b57-569d-4337-831e-4cd4e63202ab tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:45:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-4cdc9b57-569d-4337-831e-4cd4e63202ab tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:45:10 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-4cdc9b57-569d-4337-831e-4cd4e63202ab tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:45:10 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-4cdc9b57-569d-4337-831e-4cd4e63202ab tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:45:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-4cdc9b57-569d-4337-831e-4cd4e63202ab tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:45:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4cdc9b57-569d-4337-831e-4cd4e63202ab tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:10 devstack sudo[101926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:45:10 devstack sudo[101926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:10 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-541ab813-9bca-47e0-835c-32a2034afb9e tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Acquiring lock "cinder-1e58d3c4-85ed-4010-a818-07713f614bf6-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:45:10 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-541ab813-9bca-47e0-835c-32a2034afb9e tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "cinder-1e58d3c4-85ed-4010-a818-07713f614bf6-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:45:10 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-541ab813-9bca-47e0-835c-32a2034afb9e tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Acquiring lock "cinder-quobyte-1e58d3c4-85ed-4010-a818-07713f614bf6" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:45:10 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-541ab813-9bca-47e0-835c-32a2034afb9e tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "cinder-quobyte-1e58d3c4-85ed-4010-a818-07713f614bf6" acquired by "delete_volume" :: waited 0.021s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:45:10 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35b8ef4-aa7e-4407-b40b-856aa4cff781]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:45:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-541ab813-9bca-47e0-835c-32a2034afb9e tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1e58d3c4-85ed-4010-a818-07713f614bf6 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:10 devstack sudo[101928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1e58d3c4-85ed-4010-a818-07713f614bf6 Aug 28 09:45:10 devstack sudo[101928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:10 devstack sudo[101926]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4cdc9b57-569d-4337-831e-4cd4e63202ab tempest-CreateVolumesFromSourceVolumeTest-931460019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.516s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:10 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-4cdc9b57-569d-4337-831e-4cd4e63202ab tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:45:10 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-4cdc9b57-569d-4337-831e-4cd4e63202ab tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Deleted volume successfully. Aug 28 09:45:11 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4cdc9b57-569d-4337-831e-4cd4e63202ab tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "cinder-12285965-9d1b-4d15-bf74-947fbfa1eef3-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:45:11 devstack sudo[101928]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-541ab813-9bca-47e0-835c-32a2034afb9e tempest-CreateVolumesFromSourceVolumeTest-931460019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1e58d3c4-85ed-4010-a818-07713f614bf6" returned: 0 in 0.583s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-541ab813-9bca-47e0-835c-32a2034afb9e tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1e58d3c4-85ed-4010-a818-07713f614bf6 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:11 devstack sudo[101934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1e58d3c4-85ed-4010-a818-07713f614bf6 Aug 28 09:45:11 devstack sudo[101934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:11 devstack sudo[101934]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-541ab813-9bca-47e0-835c-32a2034afb9e tempest-CreateVolumesFromSourceVolumeTest-931460019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1e58d3c4-85ed-4010-a818-07713f614bf6" returned: 0 in 0.374s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:11 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-541ab813-9bca-47e0-835c-32a2034afb9e tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "cinder-quobyte-1e58d3c4-85ed-4010-a818-07713f614bf6" released by "delete_volume" :: held 1.028s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:45:11 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-541ab813-9bca-47e0-835c-32a2034afb9e tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Created reservations ['0ce2afac-afa8-47ce-bd89-799420f13dee', 'd98d626f-0c96-48cb-8e21-78503abce6b5', '64480881-df0f-43bf-b565-46630eae4968', '8a15b246-926a-4d23-b2ee-fa5bed3c4fdb'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:45:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-541ab813-9bca-47e0-835c-32a2034afb9e tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:45:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-541ab813-9bca-47e0-835c-32a2034afb9e tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:45:11 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-541ab813-9bca-47e0-835c-32a2034afb9e tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:45:11 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-541ab813-9bca-47e0-835c-32a2034afb9e tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:45:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-541ab813-9bca-47e0-835c-32a2034afb9e tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:45:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-541ab813-9bca-47e0-835c-32a2034afb9e tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:11 devstack sudo[101937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:45:11 devstack sudo[101937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:11 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-a422c426-859f-45f4-80bf-9b119ecca0fd tempest-VolumesListTestJSON-1209204228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:45:11 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a422c426-859f-45f4-80bf-9b119ecca0fd tempest-VolumesListTestJSON-1209204228 None] Flow 'volume_create_manager' (f5df0851-fcde-405f-86bc-2e3340ea6274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:45:11 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a422c426-859f-45f4-80bf-9b119ecca0fd tempest-VolumesListTestJSON-1209204228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9874fba8-87a5-4a11-a80f-eea1796465ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:11 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a422c426-859f-45f4-80bf-9b119ecca0fd tempest-VolumesListTestJSON-1209204228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9874fba8-87a5-4a11-a80f-eea1796465ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1762296324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d153298f-2c62-4286-92e3-6534cc45007f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='055ecda835f74138bb881ae59d42f1a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:45:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:45:12Z,use_quota=True,user_id='1f92739a2964452789cde214c6f62750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:11 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a422c426-859f-45f4-80bf-9b119ecca0fd tempest-VolumesListTestJSON-1209204228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a065cd95-f476-46e8-9d50-d42594519870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:11 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a422c426-859f-45f4-80bf-9b119ecca0fd tempest-VolumesListTestJSON-1209204228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a065cd95-f476-46e8-9d50-d42594519870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:11 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a422c426-859f-45f4-80bf-9b119ecca0fd tempest-VolumesListTestJSON-1209204228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c8f7181-488e-4de7-b6db-c03d64d0e3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:11 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a422c426-859f-45f4-80bf-9b119ecca0fd tempest-VolumesListTestJSON-1209204228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c8f7181-488e-4de7-b6db-c03d64d0e3cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd153298f-2c62-4286-92e3-6534cc45007f', 'volume_name': 'volume-d153298f-2c62-4286-92e3-6534cc45007f', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:11 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a422c426-859f-45f4-80bf-9b119ecca0fd tempest-VolumesListTestJSON-1209204228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c2ec2ca-0b16-407e-b2d0-c0f4cb8b1db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:11 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a422c426-859f-45f4-80bf-9b119ecca0fd tempest-VolumesListTestJSON-1209204228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c2ec2ca-0b16-407e-b2d0-c0f4cb8b1db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:11 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a422c426-859f-45f4-80bf-9b119ecca0fd tempest-VolumesListTestJSON-1209204228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f9ee565-5322-46d4-963f-367a02922c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:12 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-a422c426-859f-45f4-80bf-9b119ecca0fd tempest-VolumesListTestJSON-1209204228 None] Volume d153298f-2c62-4286-92e3-6534cc45007f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d153298f-2c62-4286-92e3-6534cc45007f', 'volume_size': 1} Aug 28 09:45:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a422c426-859f-45f4-80bf-9b119ecca0fd tempest-VolumesListTestJSON-1209204228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:45:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a422c426-859f-45f4-80bf-9b119ecca0fd tempest-VolumesListTestJSON-1209204228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:45:12 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-a422c426-859f-45f4-80bf-9b119ecca0fd tempest-VolumesListTestJSON-1209204228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1762296324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d153298f-2c62-4286-92e3-6534cc45007f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='055ecda835f74138bb881ae59d42f1a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:45:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:45:12Z,use_quota=True,user_id='1f92739a2964452789cde214c6f62750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:45:12 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-a422c426-859f-45f4-80bf-9b119ecca0fd tempest-VolumesListTestJSON-1209204228 None] Creating volume d153298f-2c62-4286-92e3-6534cc45007f {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:45:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a422c426-859f-45f4-80bf-9b119ecca0fd tempest-VolumesListTestJSON-1209204228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:45:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a422c426-859f-45f4-80bf-9b119ecca0fd tempest-VolumesListTestJSON-1209204228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:45:12 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-a422c426-859f-45f4-80bf-9b119ecca0fd tempest-VolumesListTestJSON-1209204228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:45:12 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-a422c426-859f-45f4-80bf-9b119ecca0fd tempest-VolumesListTestJSON-1209204228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:45:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a422c426-859f-45f4-80bf-9b119ecca0fd tempest-VolumesListTestJSON-1209204228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:45:12 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-a422c426-859f-45f4-80bf-9b119ecca0fd tempest-VolumesListTestJSON-1209204228 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:45:12 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-a422c426-859f-45f4-80bf-9b119ecca0fd tempest-VolumesListTestJSON-1209204228 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:45:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a422c426-859f-45f4-80bf-9b119ecca0fd tempest-VolumesListTestJSON-1209204228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d153298f-2c62-4286-92e3-6534cc45007f 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:12 devstack sudo[101939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d153298f-2c62-4286-92e3-6534cc45007f 1073741824 Aug 28 09:45:12 devstack sudo[101939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:12 devstack sudo[101937]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-541ab813-9bca-47e0-835c-32a2034afb9e tempest-CreateVolumesFromSourceVolumeTest-931460019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.310s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:12 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-541ab813-9bca-47e0-835c-32a2034afb9e tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:45:12 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-541ab813-9bca-47e0-835c-32a2034afb9e tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Deleted volume successfully. Aug 28 09:45:12 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-541ab813-9bca-47e0-835c-32a2034afb9e tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "cinder-1e58d3c4-85ed-4010-a818-07713f614bf6-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:45:12 devstack sudo[101939]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a422c426-859f-45f4-80bf-9b119ecca0fd tempest-VolumesListTestJSON-1209204228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d153298f-2c62-4286-92e3-6534cc45007f 1073741824" returned: 0 in 0.565s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a422c426-859f-45f4-80bf-9b119ecca0fd tempest-VolumesListTestJSON-1209204228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d153298f-2c62-4286-92e3-6534cc45007f {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:12 devstack sudo[102007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d153298f-2c62-4286-92e3-6534cc45007f Aug 28 09:45:12 devstack sudo[102007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:12 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ef82cd49-7345-42f1-8057-183ff87b42df tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Acquiring lock "cinder-f71b9274-a5fb-4d28-83c9-c5e335720933-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:45:12 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ef82cd49-7345-42f1-8057-183ff87b42df tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "cinder-f71b9274-a5fb-4d28-83c9-c5e335720933-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:45:13 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ef82cd49-7345-42f1-8057-183ff87b42df tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Acquiring lock "cinder-quobyte-f71b9274-a5fb-4d28-83c9-c5e335720933" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:45:13 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ef82cd49-7345-42f1-8057-183ff87b42df tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "cinder-quobyte-f71b9274-a5fb-4d28-83c9-c5e335720933" acquired by "delete_volume" :: waited 0.020s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:45:13 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49c32e8-e29b-4d63-a6e7-c7e7d27942bd]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:45:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ef82cd49-7345-42f1-8057-183ff87b42df tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f71b9274-a5fb-4d28-83c9-c5e335720933 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:13 devstack sudo[102007]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a422c426-859f-45f4-80bf-9b119ecca0fd tempest-VolumesListTestJSON-1209204228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d153298f-2c62-4286-92e3-6534cc45007f" returned: 0 in 0.544s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:13 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-a422c426-859f-45f4-80bf-9b119ecca0fd tempest-VolumesListTestJSON-1209204228 None] <== create_volume: return (1197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:45:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a422c426-859f-45f4-80bf-9b119ecca0fd tempest-VolumesListTestJSON-1209204228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:45:13 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a422c426-859f-45f4-80bf-9b119ecca0fd tempest-VolumesListTestJSON-1209204228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f9ee565-5322-46d4-963f-367a02922c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d153298f-2c62-4286-92e3-6534cc45007f', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:13 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a422c426-859f-45f4-80bf-9b119ecca0fd tempest-VolumesListTestJSON-1209204228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d6bd24b-cf90-46e8-b29d-6feba5cfd748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:13 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-a422c426-859f-45f4-80bf-9b119ecca0fd tempest-VolumesListTestJSON-1209204228 None] Volume volume-d153298f-2c62-4286-92e3-6534cc45007f (d153298f-2c62-4286-92e3-6534cc45007f): created successfully Aug 28 09:45:13 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a422c426-859f-45f4-80bf-9b119ecca0fd tempest-VolumesListTestJSON-1209204228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d6bd24b-cf90-46e8-b29d-6feba5cfd748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:13 devstack sudo[102014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f71b9274-a5fb-4d28-83c9-c5e335720933 Aug 28 09:45:13 devstack sudo[102014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:13 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a422c426-859f-45f4-80bf-9b119ecca0fd tempest-VolumesListTestJSON-1209204228 None] Flow 'volume_create_manager' (f5df0851-fcde-405f-86bc-2e3340ea6274) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:45:13 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-a422c426-859f-45f4-80bf-9b119ecca0fd tempest-VolumesListTestJSON-1209204228 None] Created volume successfully. Aug 28 09:45:13 devstack sudo[102014]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ef82cd49-7345-42f1-8057-183ff87b42df tempest-CreateVolumesFromSourceVolumeTest-931460019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f71b9274-a5fb-4d28-83c9-c5e335720933" returned: 0 in 0.534s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ef82cd49-7345-42f1-8057-183ff87b42df tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f71b9274-a5fb-4d28-83c9-c5e335720933 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:13 devstack sudo[102021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f71b9274-a5fb-4d28-83c9-c5e335720933 Aug 28 09:45:13 devstack sudo[102021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:13 devstack sudo[102021]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ef82cd49-7345-42f1-8057-183ff87b42df tempest-CreateVolumesFromSourceVolumeTest-931460019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f71b9274-a5fb-4d28-83c9-c5e335720933" returned: 0 in 0.304s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:13 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ef82cd49-7345-42f1-8057-183ff87b42df tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "cinder-quobyte-f71b9274-a5fb-4d28-83c9-c5e335720933" released by "delete_volume" :: held 0.897s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:45:14 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-ef82cd49-7345-42f1-8057-183ff87b42df tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Created reservations ['35d8f71f-522c-47ea-aa04-298b6c4f4dfd', '03ed5c5b-559f-42b5-9cd5-017dacddb9a3', 'd4a1f397-cbb3-49c6-9d18-e367a1baf00c', '7aabcbb1-9f78-456b-8416-33e5787cba6b'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:45:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ef82cd49-7345-42f1-8057-183ff87b42df tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:45:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ef82cd49-7345-42f1-8057-183ff87b42df tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:45:14 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ef82cd49-7345-42f1-8057-183ff87b42df tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:45:14 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ef82cd49-7345-42f1-8057-183ff87b42df tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:45:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ef82cd49-7345-42f1-8057-183ff87b42df tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:45:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ef82cd49-7345-42f1-8057-183ff87b42df tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:14 devstack sudo[102024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:45:14 devstack sudo[102024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:14 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-55538161-5288-4349-a9a0-2e131096067c tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Acquiring lock "cinder-4e1f3a27-8338-4807-b117-302447a3cee0-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:45:14 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-55538161-5288-4349-a9a0-2e131096067c tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "cinder-4e1f3a27-8338-4807-b117-302447a3cee0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:45:14 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-55538161-5288-4349-a9a0-2e131096067c tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Acquiring lock "cinder-quobyte-4e1f3a27-8338-4807-b117-302447a3cee0" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:45:14 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-55538161-5288-4349-a9a0-2e131096067c tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "cinder-quobyte-4e1f3a27-8338-4807-b117-302447a3cee0" acquired by "delete_volume" :: waited 0.020s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:45:14 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b88eabb-a475-4632-b301-841a4d804a04]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:45:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-55538161-5288-4349-a9a0-2e131096067c tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4e1f3a27-8338-4807-b117-302447a3cee0 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:14 devstack sudo[102024]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ef82cd49-7345-42f1-8057-183ff87b42df tempest-CreateVolumesFromSourceVolumeTest-931460019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.342s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:14 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-ef82cd49-7345-42f1-8057-183ff87b42df tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:45:14 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-ef82cd49-7345-42f1-8057-183ff87b42df tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Deleted volume successfully. Aug 28 09:45:14 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ef82cd49-7345-42f1-8057-183ff87b42df tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "cinder-f71b9274-a5fb-4d28-83c9-c5e335720933-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:45:14 devstack sudo[102026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4e1f3a27-8338-4807-b117-302447a3cee0 Aug 28 09:45:14 devstack sudo[102026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:14 devstack sudo[102026]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-55538161-5288-4349-a9a0-2e131096067c tempest-CreateVolumesFromSourceVolumeTest-931460019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4e1f3a27-8338-4807-b117-302447a3cee0" returned: 0 in 0.479s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-55538161-5288-4349-a9a0-2e131096067c tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4e1f3a27-8338-4807-b117-302447a3cee0 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:14 devstack sudo[102032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4e1f3a27-8338-4807-b117-302447a3cee0 Aug 28 09:45:14 devstack sudo[102032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:15 devstack sudo[102032]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-55538161-5288-4349-a9a0-2e131096067c tempest-CreateVolumesFromSourceVolumeTest-931460019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4e1f3a27-8338-4807-b117-302447a3cee0" returned: 0 in 0.304s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:15 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-55538161-5288-4349-a9a0-2e131096067c tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "cinder-quobyte-4e1f3a27-8338-4807-b117-302447a3cee0" released by "delete_volume" :: held 0.851s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:45:15 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-55538161-5288-4349-a9a0-2e131096067c tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Created reservations ['9d877ff6-c4ab-48cb-b8a6-8ea73337c6ca', '3383ac25-0d18-4601-8d46-06502e543565', '7f48c8c1-9c5c-4f17-ad2b-af618eeadaab', 'de53c731-477e-4dea-86c5-490be70931b6'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:45:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-55538161-5288-4349-a9a0-2e131096067c tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:45:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-55538161-5288-4349-a9a0-2e131096067c tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:45:15 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-55538161-5288-4349-a9a0-2e131096067c tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:45:15 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-55538161-5288-4349-a9a0-2e131096067c tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:45:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-55538161-5288-4349-a9a0-2e131096067c tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:45:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-55538161-5288-4349-a9a0-2e131096067c tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:15 devstack sudo[102035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:45:15 devstack sudo[102035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:15 devstack sudo[102035]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-55538161-5288-4349-a9a0-2e131096067c tempest-CreateVolumesFromSourceVolumeTest-931460019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.334s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:15 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-55538161-5288-4349-a9a0-2e131096067c tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:45:15 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-55538161-5288-4349-a9a0-2e131096067c tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Deleted volume successfully. Aug 28 09:45:15 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-55538161-5288-4349-a9a0-2e131096067c tempest-CreateVolumesFromSourceVolumeTest-931460019 None] Lock "cinder-4e1f3a27-8338-4807-b117-302447a3cee0-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:45:16 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e2b88e35-e3af-4a45-82d6-239b3353b986 tempest-VolumesListTestJSON-1209204228 None] Acquiring lock "cinder-d153298f-2c62-4286-92e3-6534cc45007f-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:45:16 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e2b88e35-e3af-4a45-82d6-239b3353b986 tempest-VolumesListTestJSON-1209204228 None] Lock "cinder-d153298f-2c62-4286-92e3-6534cc45007f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:45:16 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e2b88e35-e3af-4a45-82d6-239b3353b986 tempest-VolumesListTestJSON-1209204228 None] Acquiring lock "cinder-quobyte-d153298f-2c62-4286-92e3-6534cc45007f" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:45:16 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e2b88e35-e3af-4a45-82d6-239b3353b986 tempest-VolumesListTestJSON-1209204228 None] Lock "cinder-quobyte-d153298f-2c62-4286-92e3-6534cc45007f" acquired by "delete_volume" :: waited 0.017s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:45:16 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8e48e0-4f92-4574-8137-f7fe1bfb943e]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:45:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e2b88e35-e3af-4a45-82d6-239b3353b986 tempest-VolumesListTestJSON-1209204228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d153298f-2c62-4286-92e3-6534cc45007f {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:16 devstack sudo[102039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d153298f-2c62-4286-92e3-6534cc45007f Aug 28 09:45:16 devstack sudo[102039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:16 devstack sudo[102039]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e2b88e35-e3af-4a45-82d6-239b3353b986 tempest-VolumesListTestJSON-1209204228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d153298f-2c62-4286-92e3-6534cc45007f" returned: 0 in 0.407s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e2b88e35-e3af-4a45-82d6-239b3353b986 tempest-VolumesListTestJSON-1209204228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d153298f-2c62-4286-92e3-6534cc45007f {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:17 devstack sudo[102044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d153298f-2c62-4286-92e3-6534cc45007f Aug 28 09:45:17 devstack sudo[102044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:17 devstack sudo[102044]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e2b88e35-e3af-4a45-82d6-239b3353b986 tempest-VolumesListTestJSON-1209204228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d153298f-2c62-4286-92e3-6534cc45007f" returned: 0 in 0.278s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:17 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e2b88e35-e3af-4a45-82d6-239b3353b986 tempest-VolumesListTestJSON-1209204228 None] Lock "cinder-quobyte-d153298f-2c62-4286-92e3-6534cc45007f" released by "delete_volume" :: held 0.743s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:45:17 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-e2b88e35-e3af-4a45-82d6-239b3353b986 tempest-VolumesListTestJSON-1209204228 None] Created reservations ['50e2cc49-aef4-432f-b6f5-0447fa66f79b', 'aa6dc070-e041-4222-9655-07e9651af67e', '5d152a78-966d-4b39-b9a1-ea71ce5606fc', '3dac9394-cffb-4164-96b9-ef17e491ebea'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:45:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e2b88e35-e3af-4a45-82d6-239b3353b986 tempest-VolumesListTestJSON-1209204228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:45:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e2b88e35-e3af-4a45-82d6-239b3353b986 tempest-VolumesListTestJSON-1209204228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:45:17 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e2b88e35-e3af-4a45-82d6-239b3353b986 tempest-VolumesListTestJSON-1209204228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:45:17 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e2b88e35-e3af-4a45-82d6-239b3353b986 tempest-VolumesListTestJSON-1209204228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:45:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e2b88e35-e3af-4a45-82d6-239b3353b986 tempest-VolumesListTestJSON-1209204228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:45:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e2b88e35-e3af-4a45-82d6-239b3353b986 tempest-VolumesListTestJSON-1209204228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:17 devstack sudo[102048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:45:17 devstack sudo[102048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:17 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-0a0d0597-b960-4158-9abc-989221bd3f7b tempest-VolumesListTestJSON-1209204228 None] Acquiring lock "cinder-469fb80e-a629-456e-8ee5-372f5857c79a-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:45:17 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-0a0d0597-b960-4158-9abc-989221bd3f7b tempest-VolumesListTestJSON-1209204228 None] Lock "cinder-469fb80e-a629-456e-8ee5-372f5857c79a-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:45:17 devstack sudo[102048]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e2b88e35-e3af-4a45-82d6-239b3353b986 tempest-VolumesListTestJSON-1209204228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.356s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:17 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-e2b88e35-e3af-4a45-82d6-239b3353b986 tempest-VolumesListTestJSON-1209204228 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:45:17 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-e2b88e35-e3af-4a45-82d6-239b3353b986 tempest-VolumesListTestJSON-1209204228 None] Deleted volume successfully. Aug 28 09:45:17 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-0a0d0597-b960-4158-9abc-989221bd3f7b tempest-VolumesListTestJSON-1209204228 None] Acquiring lock "cinder-quobyte-469fb80e-a629-456e-8ee5-372f5857c79a" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:45:17 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e2b88e35-e3af-4a45-82d6-239b3353b986 tempest-VolumesListTestJSON-1209204228 None] Lock "cinder-d153298f-2c62-4286-92e3-6534cc45007f-delete_volume" released by "delete_volume" :: held 1.404s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:45:17 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-0a0d0597-b960-4158-9abc-989221bd3f7b tempest-VolumesListTestJSON-1209204228 None] Lock "cinder-quobyte-469fb80e-a629-456e-8ee5-372f5857c79a" acquired by "delete_volume" :: waited 0.023s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:45:17 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e27a35-a0f9-48f0-8cec-124a8ea1ff0b]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:45:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0a0d0597-b960-4158-9abc-989221bd3f7b tempest-VolumesListTestJSON-1209204228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-469fb80e-a629-456e-8ee5-372f5857c79a {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:18 devstack sudo[102051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-469fb80e-a629-456e-8ee5-372f5857c79a Aug 28 09:45:18 devstack sudo[102051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:18 devstack sudo[102051]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0a0d0597-b960-4158-9abc-989221bd3f7b tempest-VolumesListTestJSON-1209204228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-469fb80e-a629-456e-8ee5-372f5857c79a" returned: 0 in 0.393s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0a0d0597-b960-4158-9abc-989221bd3f7b tempest-VolumesListTestJSON-1209204228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-469fb80e-a629-456e-8ee5-372f5857c79a {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:18 devstack sudo[102056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-469fb80e-a629-456e-8ee5-372f5857c79a Aug 28 09:45:18 devstack sudo[102056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:18 devstack sudo[102056]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0a0d0597-b960-4158-9abc-989221bd3f7b tempest-VolumesListTestJSON-1209204228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-469fb80e-a629-456e-8ee5-372f5857c79a" returned: 0 in 0.261s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:18 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-0a0d0597-b960-4158-9abc-989221bd3f7b tempest-VolumesListTestJSON-1209204228 None] Lock "cinder-quobyte-469fb80e-a629-456e-8ee5-372f5857c79a" released by "delete_volume" :: held 0.709s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:45:18 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-0a0d0597-b960-4158-9abc-989221bd3f7b tempest-VolumesListTestJSON-1209204228 None] Created reservations ['e9858848-b34e-47d9-9671-13ff7ed4870e', '2d29e92e-a115-4abb-ac84-d64f4e467951', 'f4860449-54f1-4c67-9e7c-791e9391d15b', '82a9dc06-81c5-44fa-af74-768b5b45ff6d'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:45:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0a0d0597-b960-4158-9abc-989221bd3f7b tempest-VolumesListTestJSON-1209204228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:45:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0a0d0597-b960-4158-9abc-989221bd3f7b tempest-VolumesListTestJSON-1209204228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:45:18 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0a0d0597-b960-4158-9abc-989221bd3f7b tempest-VolumesListTestJSON-1209204228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:45:18 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0a0d0597-b960-4158-9abc-989221bd3f7b tempest-VolumesListTestJSON-1209204228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:45:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0a0d0597-b960-4158-9abc-989221bd3f7b tempest-VolumesListTestJSON-1209204228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:45:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0a0d0597-b960-4158-9abc-989221bd3f7b tempest-VolumesListTestJSON-1209204228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:18 devstack sudo[102059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:45:18 devstack sudo[102059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:18 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-e65350dc-ad7b-4c46-b395-8ccd84c0e8e7 tempest-VolumeDependencyTests-633559914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:45:18 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e65350dc-ad7b-4c46-b395-8ccd84c0e8e7 tempest-VolumeDependencyTests-633559914 None] Flow 'volume_create_manager' (fb94f65a-b0ad-4de3-b885-b80b64e71cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:45:18 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e65350dc-ad7b-4c46-b395-8ccd84c0e8e7 tempest-VolumeDependencyTests-633559914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce93167b-d3b2-4985-a91d-7286959413f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:18 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e65350dc-ad7b-4c46-b395-8ccd84c0e8e7 tempest-VolumeDependencyTests-633559914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce93167b-d3b2-4985-a91d-7286959413f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:45:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1746379516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec5f5d0c-5607-4088-89fe-f3f6c836613c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6b906741d2b45a1bbd816ef172dfb6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:45:19Z,use_quota=True,user_id='dbdcdee6b9764753931fecab14bed5c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:18 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e65350dc-ad7b-4c46-b395-8ccd84c0e8e7 tempest-VolumeDependencyTests-633559914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d26eb56-b17a-48c9-accc-aba1159a8e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:18 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e65350dc-ad7b-4c46-b395-8ccd84c0e8e7 tempest-VolumeDependencyTests-633559914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d26eb56-b17a-48c9-accc-aba1159a8e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:18 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e65350dc-ad7b-4c46-b395-8ccd84c0e8e7 tempest-VolumeDependencyTests-633559914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07bce084-3dc7-40e2-ae8f-8ceb5cb60aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:18 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e65350dc-ad7b-4c46-b395-8ccd84c0e8e7 tempest-VolumeDependencyTests-633559914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07bce084-3dc7-40e2-ae8f-8ceb5cb60aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec5f5d0c-5607-4088-89fe-f3f6c836613c', 'volume_name': 'volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:18 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e65350dc-ad7b-4c46-b395-8ccd84c0e8e7 tempest-VolumeDependencyTests-633559914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a99b9f7-77de-4042-b643-6565a229ab57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:18 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e65350dc-ad7b-4c46-b395-8ccd84c0e8e7 tempest-VolumeDependencyTests-633559914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a99b9f7-77de-4042-b643-6565a229ab57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:18 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e65350dc-ad7b-4c46-b395-8ccd84c0e8e7 tempest-VolumeDependencyTests-633559914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4f8b3ac-1232-4814-a8ba-d22fe2fb9cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:18 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-e65350dc-ad7b-4c46-b395-8ccd84c0e8e7 tempest-VolumeDependencyTests-633559914 None] Volume ec5f5d0c-5607-4088-89fe-f3f6c836613c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c', 'volume_size': 1} Aug 28 09:45:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e65350dc-ad7b-4c46-b395-8ccd84c0e8e7 tempest-VolumeDependencyTests-633559914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:45:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e65350dc-ad7b-4c46-b395-8ccd84c0e8e7 tempest-VolumeDependencyTests-633559914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:45:18 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e65350dc-ad7b-4c46-b395-8ccd84c0e8e7 tempest-VolumeDependencyTests-633559914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:45:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1746379516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec5f5d0c-5607-4088-89fe-f3f6c836613c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6b906741d2b45a1bbd816ef172dfb6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:45:19Z,use_quota=True,user_id='dbdcdee6b9764753931fecab14bed5c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:45:18 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-e65350dc-ad7b-4c46-b395-8ccd84c0e8e7 tempest-VolumeDependencyTests-633559914 None] Creating volume ec5f5d0c-5607-4088-89fe-f3f6c836613c {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:45:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e65350dc-ad7b-4c46-b395-8ccd84c0e8e7 tempest-VolumeDependencyTests-633559914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:45:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e65350dc-ad7b-4c46-b395-8ccd84c0e8e7 tempest-VolumeDependencyTests-633559914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:45:18 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e65350dc-ad7b-4c46-b395-8ccd84c0e8e7 tempest-VolumeDependencyTests-633559914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:45:18 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e65350dc-ad7b-4c46-b395-8ccd84c0e8e7 tempest-VolumeDependencyTests-633559914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:45:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e65350dc-ad7b-4c46-b395-8ccd84c0e8e7 tempest-VolumeDependencyTests-633559914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:45:18 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e65350dc-ad7b-4c46-b395-8ccd84c0e8e7 tempest-VolumeDependencyTests-633559914 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:45:18 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-e65350dc-ad7b-4c46-b395-8ccd84c0e8e7 tempest-VolumeDependencyTests-633559914 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:45:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e65350dc-ad7b-4c46-b395-8ccd84c0e8e7 tempest-VolumeDependencyTests-633559914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:18 devstack sudo[102061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c 1073741824 Aug 28 09:45:18 devstack sudo[102061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:18 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-86bc2167-a764-41cb-ab90-6fdb121ac435 tempest-VolumesListTestJSON-1209204228 None] Acquiring lock "cinder-553b77bb-351e-41ec-afa4-0131309d9c20-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:45:18 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-86bc2167-a764-41cb-ab90-6fdb121ac435 tempest-VolumesListTestJSON-1209204228 None] Lock "cinder-553b77bb-351e-41ec-afa4-0131309d9c20-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:45:19 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-86bc2167-a764-41cb-ab90-6fdb121ac435 tempest-VolumesListTestJSON-1209204228 None] Acquiring lock "cinder-quobyte-553b77bb-351e-41ec-afa4-0131309d9c20" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:45:19 devstack sudo[102059]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0a0d0597-b960-4158-9abc-989221bd3f7b tempest-VolumesListTestJSON-1209204228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.306s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:19 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-0a0d0597-b960-4158-9abc-989221bd3f7b tempest-VolumesListTestJSON-1209204228 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:45:19 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-0a0d0597-b960-4158-9abc-989221bd3f7b tempest-VolumesListTestJSON-1209204228 None] Deleted volume successfully. Aug 28 09:45:19 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-86bc2167-a764-41cb-ab90-6fdb121ac435 tempest-VolumesListTestJSON-1209204228 None] Lock "cinder-quobyte-553b77bb-351e-41ec-afa4-0131309d9c20" acquired by "delete_volume" :: waited 0.023s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:45:19 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b664575-3d3b-4406-81f5-4a35f4b8ce7b]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:45:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-86bc2167-a764-41cb-ab90-6fdb121ac435 tempest-VolumesListTestJSON-1209204228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-553b77bb-351e-41ec-afa4-0131309d9c20 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:19 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-0a0d0597-b960-4158-9abc-989221bd3f7b tempest-VolumesListTestJSON-1209204228 None] Lock "cinder-469fb80e-a629-456e-8ee5-372f5857c79a-delete_volume" released by "delete_volume" :: held 1.314s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:45:19 devstack sudo[102066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-553b77bb-351e-41ec-afa4-0131309d9c20 Aug 28 09:45:19 devstack sudo[102066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:19 devstack sudo[102061]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e65350dc-ad7b-4c46-b395-8ccd84c0e8e7 tempest-VolumeDependencyTests-633559914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c 1073741824" returned: 0 in 0.488s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e65350dc-ad7b-4c46-b395-8ccd84c0e8e7 tempest-VolumeDependencyTests-633559914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:19 devstack sudo[102066]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:19 devstack sudo[102075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c Aug 28 09:45:19 devstack sudo[102075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-86bc2167-a764-41cb-ab90-6fdb121ac435 tempest-VolumesListTestJSON-1209204228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-553b77bb-351e-41ec-afa4-0131309d9c20" returned: 0 in 0.395s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-86bc2167-a764-41cb-ab90-6fdb121ac435 tempest-VolumesListTestJSON-1209204228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-553b77bb-351e-41ec-afa4-0131309d9c20 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:19 devstack sudo[102077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-553b77bb-351e-41ec-afa4-0131309d9c20 Aug 28 09:45:19 devstack sudo[102077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:19 devstack sudo[102075]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e65350dc-ad7b-4c46-b395-8ccd84c0e8e7 tempest-VolumeDependencyTests-633559914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c" returned: 0 in 0.294s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:19 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e65350dc-ad7b-4c46-b395-8ccd84c0e8e7 tempest-VolumeDependencyTests-633559914 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:45:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e65350dc-ad7b-4c46-b395-8ccd84c0e8e7 tempest-VolumeDependencyTests-633559914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:45:19 devstack sudo[102077]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-86bc2167-a764-41cb-ab90-6fdb121ac435 tempest-VolumesListTestJSON-1209204228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-553b77bb-351e-41ec-afa4-0131309d9c20" returned: 0 in 0.279s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e65350dc-ad7b-4c46-b395-8ccd84c0e8e7 tempest-VolumeDependencyTests-633559914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4f8b3ac-1232-4814-a8ba-d22fe2fb9cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e65350dc-ad7b-4c46-b395-8ccd84c0e8e7 tempest-VolumeDependencyTests-633559914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bd2584b-8625-46b1-9168-666384d84b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:19 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-86bc2167-a764-41cb-ab90-6fdb121ac435 tempest-VolumesListTestJSON-1209204228 None] Lock "cinder-quobyte-553b77bb-351e-41ec-afa4-0131309d9c20" released by "delete_volume" :: held 0.728s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:45:19 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-e65350dc-ad7b-4c46-b395-8ccd84c0e8e7 tempest-VolumeDependencyTests-633559914 None] Volume volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c (ec5f5d0c-5607-4088-89fe-f3f6c836613c): created successfully Aug 28 09:45:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e65350dc-ad7b-4c46-b395-8ccd84c0e8e7 tempest-VolumeDependencyTests-633559914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bd2584b-8625-46b1-9168-666384d84b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e65350dc-ad7b-4c46-b395-8ccd84c0e8e7 tempest-VolumeDependencyTests-633559914 None] Flow 'volume_create_manager' (fb94f65a-b0ad-4de3-b885-b80b64e71cea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:45:19 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-e65350dc-ad7b-4c46-b395-8ccd84c0e8e7 tempest-VolumeDependencyTests-633559914 None] Created volume successfully. Aug 28 09:45:19 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-86bc2167-a764-41cb-ab90-6fdb121ac435 tempest-VolumesListTestJSON-1209204228 None] Created reservations ['82ccc72b-ace3-497f-8fdc-6f2cac256511', '03aa9eb1-1468-4728-ab7d-e5c8c94bc6a9', 'bd1c39ff-c275-4fcb-9489-911d842ecfc8', '5a6c8bc1-fb26-4575-9bf9-72b5efbc65c4'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:45:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-86bc2167-a764-41cb-ab90-6fdb121ac435 tempest-VolumesListTestJSON-1209204228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:45:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-86bc2167-a764-41cb-ab90-6fdb121ac435 tempest-VolumesListTestJSON-1209204228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:45:19 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-86bc2167-a764-41cb-ab90-6fdb121ac435 tempest-VolumesListTestJSON-1209204228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:45:19 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-86bc2167-a764-41cb-ab90-6fdb121ac435 tempest-VolumesListTestJSON-1209204228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:45:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-86bc2167-a764-41cb-ab90-6fdb121ac435 tempest-VolumesListTestJSON-1209204228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:45:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-86bc2167-a764-41cb-ab90-6fdb121ac435 tempest-VolumesListTestJSON-1209204228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:19 devstack sudo[102081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:45:19 devstack sudo[102081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:20 devstack sudo[102081]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-86bc2167-a764-41cb-ab90-6fdb121ac435 tempest-VolumesListTestJSON-1209204228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.267s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:20 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-86bc2167-a764-41cb-ab90-6fdb121ac435 tempest-VolumesListTestJSON-1209204228 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:45:20 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-86bc2167-a764-41cb-ab90-6fdb121ac435 tempest-VolumesListTestJSON-1209204228 None] Deleted volume successfully. Aug 28 09:45:20 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-86bc2167-a764-41cb-ab90-6fdb121ac435 tempest-VolumesListTestJSON-1209204228 None] Lock "cinder-553b77bb-351e-41ec-afa4-0131309d9c20-delete_volume" released by "delete_volume" :: held 1.252s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:45:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-64ec41a8-3213-4e3c-9780-b1bd9730e05d tempest-VolumeDependencyTests-633559914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:45:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-64ec41a8-3213-4e3c-9780-b1bd9730e05d tempest-VolumeDependencyTests-633559914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:45:21 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-64ec41a8-3213-4e3c-9780-b1bd9730e05d tempest-VolumeDependencyTests-633559914 None] Creating offline snapshot 66614125-e916-48e4-9198-557235bebbe7 of volume ec5f5d0c-5607-4088-89fe-f3f6c836613c {{(pid=86081) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:45:21 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f67d1fe-b0e4-4807-9e5e-ed9161c613c6]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:45:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-64ec41a8-3213-4e3c-9780-b1bd9730e05d tempest-VolumeDependencyTests-633559914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:21 devstack sudo[102084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c Aug 28 09:45:21 devstack sudo[102084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:21 devstack sudo[102084]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-64ec41a8-3213-4e3c-9780-b1bd9730e05d tempest-VolumeDependencyTests-633559914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c" returned: 0 in 0.449s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-64ec41a8-3213-4e3c-9780-b1bd9730e05d tempest-VolumeDependencyTests-633559914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c.66614125-e916-48e4-9198-557235bebbe7 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:21 devstack sudo[102090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c.66614125-e916-48e4-9198-557235bebbe7 1G Aug 28 09:45:21 devstack sudo[102090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:22 devstack sudo[102090]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-64ec41a8-3213-4e3c-9780-b1bd9730e05d tempest-VolumeDependencyTests-633559914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c.66614125-e916-48e4-9198-557235bebbe7 1G" returned: 0 in 0.471s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-64ec41a8-3213-4e3c-9780-b1bd9730e05d tempest-VolumeDependencyTests-633559914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c.66614125-e916-48e4-9198-557235bebbe7 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:22 devstack sudo[102096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c.66614125-e916-48e4-9198-557235bebbe7 Aug 28 09:45:22 devstack sudo[102096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:22 devstack sudo[102096]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-64ec41a8-3213-4e3c-9780-b1bd9730e05d tempest-VolumeDependencyTests-633559914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c.66614125-e916-48e4-9198-557235bebbe7" returned: 0 in 0.321s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:22 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-64ec41a8-3213-4e3c-9780-b1bd9730e05d tempest-VolumeDependencyTests-633559914 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c.66614125-e916-48e4-9198-557235bebbe7 is being set with open permissions: ugo+rw Aug 28 09:45:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-64ec41a8-3213-4e3c-9780-b1bd9730e05d tempest-VolumeDependencyTests-633559914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c.66614125-e916-48e4-9198-557235bebbe7 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:22 devstack sudo[102101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c.66614125-e916-48e4-9198-557235bebbe7 Aug 28 09:45:22 devstack sudo[102101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:22 devstack sudo[102101]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-64ec41a8-3213-4e3c-9780-b1bd9730e05d tempest-VolumeDependencyTests-633559914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c.66614125-e916-48e4-9198-557235bebbe7" returned: 0 in 0.287s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-64ec41a8-3213-4e3c-9780-b1bd9730e05d tempest-VolumeDependencyTests-633559914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:22 devstack sudo[102106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c.info Aug 28 09:45:22 devstack sudo[102106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:23 devstack sudo[102106]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-64ec41a8-3213-4e3c-9780-b1bd9730e05d tempest-VolumeDependencyTests-633559914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c.info" returned: 0 in 0.348s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:23 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-64ec41a8-3213-4e3c-9780-b1bd9730e05d tempest-VolumeDependencyTests-633559914 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c.info is being set with open permissions: ugo+rw Aug 28 09:45:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-64ec41a8-3213-4e3c-9780-b1bd9730e05d tempest-VolumeDependencyTests-633559914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:23 devstack sudo[102109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c.info Aug 28 09:45:23 devstack sudo[102109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:23 devstack sudo[102109]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-64ec41a8-3213-4e3c-9780-b1bd9730e05d tempest-VolumeDependencyTests-633559914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c.info" returned: 0 in 0.274s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-64ec41a8-3213-4e3c-9780-b1bd9730e05d tempest-VolumeDependencyTests-633559914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.275s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:45:23 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-64ec41a8-3213-4e3c-9780-b1bd9730e05d tempest-VolumeDependencyTests-633559914 None] Create snapshot completed successfully Aug 28 09:45:24 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa4cb5f6-15c9-4393-bece-aa60f101200f tempest-VolumeDependencyTests-633559914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:45:24 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-aa4cb5f6-15c9-4393-bece-aa60f101200f tempest-VolumeDependencyTests-633559914 None] Flow 'volume_create_manager' (f49d4667-1b01-40c7-8f31-47a8a01db9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:45:24 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-aa4cb5f6-15c9-4393-bece-aa60f101200f tempest-VolumeDependencyTests-633559914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c25e70a-4bbb-486c-a093-a6209b29eaa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:24 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-aa4cb5f6-15c9-4393-bece-aa60f101200f tempest-VolumeDependencyTests-633559914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c25e70a-4bbb-486c-a093-a6209b29eaa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:45:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-268750416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2aaa922-67fd-44cf-80c4-fa772fd74993,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6b906741d2b45a1bbd816ef172dfb6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:45:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=66614125-e916-48e4-9198-557235bebbe7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:45:25Z,use_quota=True,user_id='dbdcdee6b9764753931fecab14bed5c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:24 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-aa4cb5f6-15c9-4393-bece-aa60f101200f tempest-VolumeDependencyTests-633559914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e01bd36-bfc7-4114-879a-d83467adbe94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:24 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-aa4cb5f6-15c9-4393-bece-aa60f101200f tempest-VolumeDependencyTests-633559914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e01bd36-bfc7-4114-879a-d83467adbe94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:24 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-aa4cb5f6-15c9-4393-bece-aa60f101200f tempest-VolumeDependencyTests-633559914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (951ad0ab-608a-4da0-b3c0-cb313541c7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:24 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-aa4cb5f6-15c9-4393-bece-aa60f101200f tempest-VolumeDependencyTests-633559914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (951ad0ab-608a-4da0-b3c0-cb313541c7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f2aaa922-67fd-44cf-80c4-fa772fd74993', 'volume_name': 'volume-f2aaa922-67fd-44cf-80c4-fa772fd74993', 'volume_size': 1, 'snapshot_id': '66614125-e916-48e4-9198-557235bebbe7'}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:24 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-aa4cb5f6-15c9-4393-bece-aa60f101200f tempest-VolumeDependencyTests-633559914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9fabab8-34bd-4b4c-a99d-2179d6a88bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:24 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-aa4cb5f6-15c9-4393-bece-aa60f101200f tempest-VolumeDependencyTests-633559914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9fabab8-34bd-4b4c-a99d-2179d6a88bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:24 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-aa4cb5f6-15c9-4393-bece-aa60f101200f tempest-VolumeDependencyTests-633559914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11c0d88d-28a4-426c-bd76-63ab14b5d879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:24 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-aa4cb5f6-15c9-4393-bece-aa60f101200f tempest-VolumeDependencyTests-633559914 None] Volume f2aaa922-67fd-44cf-80c4-fa772fd74993: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f2aaa922-67fd-44cf-80c4-fa772fd74993', 'volume_size': 1, 'snapshot_id': '66614125-e916-48e4-9198-557235bebbe7'} Aug 28 09:45:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-aa4cb5f6-15c9-4393-bece-aa60f101200f tempest-VolumeDependencyTests-633559914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:45:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-aa4cb5f6-15c9-4393-bece-aa60f101200f tempest-VolumeDependencyTests-633559914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:45:24 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-aa4cb5f6-15c9-4393-bece-aa60f101200f tempest-VolumeDependencyTests-633559914 None] Acquiring lock "cinder-quobyte-66614125-e916-48e4-9198-557235bebbe7-f2aaa922-67fd-44cf-80c4-fa772fd74993" by "_create_volume_from_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:45:24 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-aa4cb5f6-15c9-4393-bece-aa60f101200f tempest-VolumeDependencyTests-633559914 None] Lock "cinder-quobyte-66614125-e916-48e4-9198-557235bebbe7-f2aaa922-67fd-44cf-80c4-fa772fd74993" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:45:24 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-aa4cb5f6-15c9-4393-bece-aa60f101200f tempest-VolumeDependencyTests-633559914 None] Creating volume f2aaa922-67fd-44cf-80c4-fa772fd74993 from snapshot 66614125-e916-48e4-9198-557235bebbe7 {{(pid=86081) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 28 09:45:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-aa4cb5f6-15c9-4393-bece-aa60f101200f tempest-VolumeDependencyTests-633559914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:45:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-aa4cb5f6-15c9-4393-bece-aa60f101200f tempest-VolumeDependencyTests-633559914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:45:24 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-aa4cb5f6-15c9-4393-bece-aa60f101200f tempest-VolumeDependencyTests-633559914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:45:24 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-aa4cb5f6-15c9-4393-bece-aa60f101200f tempest-VolumeDependencyTests-633559914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:45:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-aa4cb5f6-15c9-4393-bece-aa60f101200f tempest-VolumeDependencyTests-633559914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:45:24 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-aa4cb5f6-15c9-4393-bece-aa60f101200f tempest-VolumeDependencyTests-633559914 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:45:24 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-aa4cb5f6-15c9-4393-bece-aa60f101200f tempest-VolumeDependencyTests-633559914 None] Acquiring lock "cinder-quobyte-f2aaa922-67fd-44cf-80c4-fa772fd74993" by "_copy_volume_from_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:45:25 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-aa4cb5f6-15c9-4393-bece-aa60f101200f tempest-VolumeDependencyTests-633559914 None] Lock "cinder-quobyte-f2aaa922-67fd-44cf-80c4-fa772fd74993" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:45:25 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-aa4cb5f6-15c9-4393-bece-aa60f101200f tempest-VolumeDependencyTests-633559914 None] snapshot: 66614125-e916-48e4-9198-557235bebbe7, volume: f2aaa922-67fd-44cf-80c4-fa772fd74993, {{(pid=86081) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 28 09:45:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-aa4cb5f6-15c9-4393-bece-aa60f101200f tempest-VolumeDependencyTests-633559914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:45:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-aa4cb5f6-15c9-4393-bece-aa60f101200f tempest-VolumeDependencyTests-633559914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:45:25 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-aa4cb5f6-15c9-4393-bece-aa60f101200f tempest-VolumeDependencyTests-633559914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:45:25 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-aa4cb5f6-15c9-4393-bece-aa60f101200f tempest-VolumeDependencyTests-633559914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:45:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-aa4cb5f6-15c9-4393-bece-aa60f101200f tempest-VolumeDependencyTests-633559914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:45:25 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd630861-5f3a-46a4-90e7-6406f8e5a7b8]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:45:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-aa4cb5f6-15c9-4393-bece-aa60f101200f tempest-VolumeDependencyTests-633559914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c.66614125-e916-48e4-9198-557235bebbe7 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:25 devstack sudo[102112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c.66614125-e916-48e4-9198-557235bebbe7 Aug 28 09:45:25 devstack sudo[102112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:25 devstack sudo[102112]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-aa4cb5f6-15c9-4393-bece-aa60f101200f tempest-VolumeDependencyTests-633559914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c.66614125-e916-48e4-9198-557235bebbe7" returned: 0 in 0.396s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:25 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-aa4cb5f6-15c9-4393-bece-aa60f101200f tempest-VolumeDependencyTests-633559914 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:45:25 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87348e3-a072-4525-8817-cf5dc52ccb3f]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:45:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-aa4cb5f6-15c9-4393-bece-aa60f101200f tempest-VolumeDependencyTests-633559914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:25 devstack sudo[102117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c Aug 28 09:45:25 devstack sudo[102117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:25 devstack sudo[102117]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-aa4cb5f6-15c9-4393-bece-aa60f101200f tempest-VolumeDependencyTests-633559914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c" returned: 0 in 0.407s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:25 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-aa4cb5f6-15c9-4393-bece-aa60f101200f tempest-VolumeDependencyTests-633559914 None] will copy from snapshot at /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c {{(pid=86081) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 28 09:45:25 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-aa4cb5f6-15c9-4393-bece-aa60f101200f tempest-VolumeDependencyTests-633559914 None] Creating direct copy from snapshot {{(pid=86081) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 28 09:45:25 devstack cinder-volume[86081]: DEBUG cinder.utils [None req-aa4cb5f6-15c9-4393-bece-aa60f101200f tempest-VolumeDependencyTests-633559914 None] Path /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f2aaa922-67fd-44cf-80c4-fa772fd74993 not found in is_blk_device check {{(pid=86081) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 28 09:45:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-aa4cb5f6-15c9-4393-bece-aa60f101200f tempest-VolumeDependencyTests-633559914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f2aaa922-67fd-44cf-80c4-fa772fd74993 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:25 devstack sudo[102123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f2aaa922-67fd-44cf-80c4-fa772fd74993 Aug 28 09:45:25 devstack sudo[102123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:32 devstack sudo[102123]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-aa4cb5f6-15c9-4393-bece-aa60f101200f tempest-VolumeDependencyTests-633559914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f2aaa922-67fd-44cf-80c4-fa772fd74993" returned: 0 in 6.820s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:32 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-aa4cb5f6-15c9-4393-bece-aa60f101200f tempest-VolumeDependencyTests-633559914 None] Image conversion details: src /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c, size 1024.00 MB, duration 6.82 sec, destination /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f2aaa922-67fd-44cf-80c4-fa772fd74993 {{(pid=86081) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 09:45:32 devstack cinder-volume[86081]: INFO cinder.image.image_utils [None req-aa4cb5f6-15c9-4393-bece-aa60f101200f tempest-VolumeDependencyTests-633559914 None] Converted 1024.00 MB image at 150.11 MB/s Aug 28 09:45:32 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-aa4cb5f6-15c9-4393-bece-aa60f101200f tempest-VolumeDependencyTests-633559914 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f2aaa922-67fd-44cf-80c4-fa772fd74993 is being set with open permissions: ugo+rw Aug 28 09:45:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-aa4cb5f6-15c9-4393-bece-aa60f101200f tempest-VolumeDependencyTests-633559914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f2aaa922-67fd-44cf-80c4-fa772fd74993 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:32 devstack sudo[102191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f2aaa922-67fd-44cf-80c4-fa772fd74993 Aug 28 09:45:32 devstack sudo[102191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:33 devstack sudo[102191]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-aa4cb5f6-15c9-4393-bece-aa60f101200f tempest-VolumeDependencyTests-633559914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f2aaa922-67fd-44cf-80c4-fa772fd74993" returned: 0 in 0.326s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:33 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-aa4cb5f6-15c9-4393-bece-aa60f101200f tempest-VolumeDependencyTests-633559914 None] Lock "cinder-quobyte-f2aaa922-67fd-44cf-80c4-fa772fd74993" released by "_copy_volume_from_snapshot" :: held 8.035s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:45:33 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-aa4cb5f6-15c9-4393-bece-aa60f101200f tempest-VolumeDependencyTests-633559914 None] Lock "cinder-quobyte-66614125-e916-48e4-9198-557235bebbe7-f2aaa922-67fd-44cf-80c4-fa772fd74993" released by "_create_volume_from_snapshot" :: held 8.114s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:45:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-aa4cb5f6-15c9-4393-bece-aa60f101200f tempest-VolumeDependencyTests-633559914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.138s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:45:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-aa4cb5f6-15c9-4393-bece-aa60f101200f tempest-VolumeDependencyTests-633559914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11c0d88d-28a4-426c-bd76-63ab14b5d879) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2aaa922-67fd-44cf-80c4-fa772fd74993', 'volume_size': 1, 'snapshot_id': '66614125-e916-48e4-9198-557235bebbe7'}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-aa4cb5f6-15c9-4393-bece-aa60f101200f tempest-VolumeDependencyTests-633559914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64f8eac1-3a9d-4799-90a6-860c223f7239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:33 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-aa4cb5f6-15c9-4393-bece-aa60f101200f tempest-VolumeDependencyTests-633559914 None] Volume volume-f2aaa922-67fd-44cf-80c4-fa772fd74993 (f2aaa922-67fd-44cf-80c4-fa772fd74993): created successfully Aug 28 09:45:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-aa4cb5f6-15c9-4393-bece-aa60f101200f tempest-VolumeDependencyTests-633559914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64f8eac1-3a9d-4799-90a6-860c223f7239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-aa4cb5f6-15c9-4393-bece-aa60f101200f tempest-VolumeDependencyTests-633559914 None] Flow 'volume_create_manager' (f49d4667-1b01-40c7-8f31-47a8a01db9d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:45:33 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-aa4cb5f6-15c9-4393-bece-aa60f101200f tempest-VolumeDependencyTests-633559914 None] Created volume successfully. Aug 28 09:45:33 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4d31bcd9-a13b-42c2-b2d4-87cf8112c383 tempest-VolumeDependencyTests-633559914 None] Acquiring lock "cinder-66614125-e916-48e4-9198-557235bebbe7-delete_snapshot" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:45:33 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4d31bcd9-a13b-42c2-b2d4-87cf8112c383 tempest-VolumeDependencyTests-633559914 None] Lock "cinder-66614125-e916-48e4-9198-557235bebbe7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:45:33 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4d31bcd9-a13b-42c2-b2d4-87cf8112c383 tempest-VolumeDependencyTests-633559914 None] Acquiring lock "cinder-quobyte-ec5f5d0c-5607-4088-89fe-f3f6c836613c" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:45:33 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4d31bcd9-a13b-42c2-b2d4-87cf8112c383 tempest-VolumeDependencyTests-633559914 None] Lock "cinder-quobyte-ec5f5d0c-5607-4088-89fe-f3f6c836613c" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:45:33 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4d31bcd9-a13b-42c2-b2d4-87cf8112c383 tempest-VolumeDependencyTests-633559914 None] Acquiring lock "cinder-quobyte-66614125-e916-48e4-9198-557235bebbe7" by "_delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:45:33 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4d31bcd9-a13b-42c2-b2d4-87cf8112c383 tempest-VolumeDependencyTests-633559914 None] Lock "cinder-quobyte-66614125-e916-48e4-9198-557235bebbe7" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:45:33 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-4d31bcd9-a13b-42c2-b2d4-87cf8112c383 tempest-VolumeDependencyTests-633559914 None] Deleting offline snapshot 66614125-e916-48e4-9198-557235bebbe7 of volume ec5f5d0c-5607-4088-89fe-f3f6c836613c {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:45:33 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-4d31bcd9-a13b-42c2-b2d4-87cf8112c383 tempest-VolumeDependencyTests-633559914 None] snapshot_file for this snap is: volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c.66614125-e916-48e4-9198-557235bebbe7 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:45:33 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[8170d9d5-135b-4029-b7c1-7741a69a3ce0]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:45:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4d31bcd9-a13b-42c2-b2d4-87cf8112c383 tempest-VolumeDependencyTests-633559914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c.66614125-e916-48e4-9198-557235bebbe7 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:33 devstack sudo[102194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c.66614125-e916-48e4-9198-557235bebbe7 Aug 28 09:45:33 devstack sudo[102194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:34 devstack sudo[102194]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4d31bcd9-a13b-42c2-b2d4-87cf8112c383 tempest-VolumeDependencyTests-633559914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c.66614125-e916-48e4-9198-557235bebbe7" returned: 0 in 0.584s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:34 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-4d31bcd9-a13b-42c2-b2d4-87cf8112c383 tempest-VolumeDependencyTests-633559914 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:45:34 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a33c26-b2cb-435d-a7ec-fc79df4a193e]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:45:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4d31bcd9-a13b-42c2-b2d4-87cf8112c383 tempest-VolumeDependencyTests-633559914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:34 devstack sudo[102199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c Aug 28 09:45:34 devstack sudo[102199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:34 devstack sudo[102199]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4d31bcd9-a13b-42c2-b2d4-87cf8112c383 tempest-VolumeDependencyTests-633559914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c" returned: 0 in 0.709s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4d31bcd9-a13b-42c2-b2d4-87cf8112c383 tempest-VolumeDependencyTests-633559914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c.66614125-e916-48e4-9198-557235bebbe7 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:34 devstack sudo[102204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c.66614125-e916-48e4-9198-557235bebbe7 Aug 28 09:45:34 devstack sudo[102204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:35 devstack sudo[102204]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4d31bcd9-a13b-42c2-b2d4-87cf8112c383 tempest-VolumeDependencyTests-633559914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c.66614125-e916-48e4-9198-557235bebbe7" returned: 0 in 0.370s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4d31bcd9-a13b-42c2-b2d4-87cf8112c383 tempest-VolumeDependencyTests-633559914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c.66614125-e916-48e4-9198-557235bebbe7 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:35 devstack sudo[102211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c.66614125-e916-48e4-9198-557235bebbe7 Aug 28 09:45:35 devstack sudo[102211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:35 devstack sudo[102211]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4d31bcd9-a13b-42c2-b2d4-87cf8112c383 tempest-VolumeDependencyTests-633559914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c.66614125-e916-48e4-9198-557235bebbe7" returned: 0 in 0.298s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:35 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4d31bcd9-a13b-42c2-b2d4-87cf8112c383 tempest-VolumeDependencyTests-633559914 None] Lock "cinder-quobyte-66614125-e916-48e4-9198-557235bebbe7" released by "_delete_snapshot" :: held 2.111s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:45:35 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4d31bcd9-a13b-42c2-b2d4-87cf8112c383 tempest-VolumeDependencyTests-633559914 None] Lock "cinder-quobyte-ec5f5d0c-5607-4088-89fe-f3f6c836613c" released by "delete_snapshot" :: held 2.139s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:45:35 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-4d31bcd9-a13b-42c2-b2d4-87cf8112c383 tempest-VolumeDependencyTests-633559914 None] Created reservations ['84ce95ac-de13-4276-84c1-99a2bf840952', '386b3592-2897-4b74-87c4-794dd4f57713', '6b8327d3-f042-430f-8638-da43849810fa', '305eb4c7-eb0d-4776-83dd-badc353ea99b'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:45:35 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-4d31bcd9-a13b-42c2-b2d4-87cf8112c383 tempest-VolumeDependencyTests-633559914 None] Delete snapshot completed successfully. Aug 28 09:45:35 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4d31bcd9-a13b-42c2-b2d4-87cf8112c383 tempest-VolumeDependencyTests-633559914 None] Lock "cinder-66614125-e916-48e4-9198-557235bebbe7-delete_snapshot" released by "delete_snapshot" :: held 2.344s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:45:36 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-f1558165-5227-4672-8fc7-22676aa58c56 tempest-VolumeDependencyTests-633559914 None] Acquiring lock "cinder-ec5f5d0c-5607-4088-89fe-f3f6c836613c-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:45:36 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-f1558165-5227-4672-8fc7-22676aa58c56 tempest-VolumeDependencyTests-633559914 None] Lock "cinder-ec5f5d0c-5607-4088-89fe-f3f6c836613c-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:45:37 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-f1558165-5227-4672-8fc7-22676aa58c56 tempest-VolumeDependencyTests-633559914 None] Acquiring lock "cinder-quobyte-ec5f5d0c-5607-4088-89fe-f3f6c836613c" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:45:37 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-f1558165-5227-4672-8fc7-22676aa58c56 tempest-VolumeDependencyTests-633559914 None] Lock "cinder-quobyte-ec5f5d0c-5607-4088-89fe-f3f6c836613c" acquired by "delete_volume" :: waited 0.062s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:45:37 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2d0532-51de-4f60-aecf-11c0d015f434]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:45:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f1558165-5227-4672-8fc7-22676aa58c56 tempest-VolumeDependencyTests-633559914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:37 devstack sudo[102216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c Aug 28 09:45:37 devstack sudo[102216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:37 devstack sudo[102216]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f1558165-5227-4672-8fc7-22676aa58c56 tempest-VolumeDependencyTests-633559914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c" returned: 0 in 0.559s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f1558165-5227-4672-8fc7-22676aa58c56 tempest-VolumeDependencyTests-633559914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:37 devstack sudo[102228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c Aug 28 09:45:37 devstack sudo[102228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:38 devstack cinder-volume[86081]: DEBUG oslo_service.periodic_task [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running periodic task VolumeManager._thread_info {{(pid=86081) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:45:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] thread count: 28 {{(pid=86081) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 09:45:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] thread info: [<_MainThread(MainThread, started 129914189705344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86081) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 09:45:38 devstack sudo[102228]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f1558165-5227-4672-8fc7-22676aa58c56 tempest-VolumeDependencyTests-633559914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ec5f5d0c-5607-4088-89fe-f3f6c836613c" returned: 0 in 0.349s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:38 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-7df75dc0-136e-4548-822c-d6c647c03f06 tempest-VolumesSnapshotTestJSON-1121770850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:45:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7df75dc0-136e-4548-822c-d6c647c03f06 tempest-VolumesSnapshotTestJSON-1121770850 None] Flow 'volume_create_manager' (4defb64c-f95f-41c1-9657-052fe61f0b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:45:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7df75dc0-136e-4548-822c-d6c647c03f06 tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83686fe7-05a1-4bc9-a2ad-3cea89055363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:38 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-f1558165-5227-4672-8fc7-22676aa58c56 tempest-VolumeDependencyTests-633559914 None] Lock "cinder-quobyte-ec5f5d0c-5607-4088-89fe-f3f6c836613c" released by "delete_volume" :: held 1.061s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:45:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7df75dc0-136e-4548-822c-d6c647c03f06 tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83686fe7-05a1-4bc9-a2ad-3cea89055363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:45:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1322551170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4874bfb-7e3f-4da6-8374-ef485a4e27a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4f333bae244877b27a5526908ef20f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:45:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:45:38Z,use_quota=True,user_id='1bf321707b67460792c7aedc2503bedc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7df75dc0-136e-4548-822c-d6c647c03f06 tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eaadef7-b401-46f2-a3b0-019ec7970813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7df75dc0-136e-4548-822c-d6c647c03f06 tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eaadef7-b401-46f2-a3b0-019ec7970813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7df75dc0-136e-4548-822c-d6c647c03f06 tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0bf59eb-7a99-4341-93cf-b0e8b6355d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7df75dc0-136e-4548-822c-d6c647c03f06 tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0bf59eb-7a99-4341-93cf-b0e8b6355d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4874bfb-7e3f-4da6-8374-ef485a4e27a0', 'volume_name': 'volume-e4874bfb-7e3f-4da6-8374-ef485a4e27a0', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7df75dc0-136e-4548-822c-d6c647c03f06 tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bcca281-9a03-4c5f-8195-c9cadf6c363f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7df75dc0-136e-4548-822c-d6c647c03f06 tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bcca281-9a03-4c5f-8195-c9cadf6c363f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7df75dc0-136e-4548-822c-d6c647c03f06 tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2573d49-24f0-4702-8f22-ef48b0376313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:38 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-7df75dc0-136e-4548-822c-d6c647c03f06 tempest-VolumesSnapshotTestJSON-1121770850 None] Volume e4874bfb-7e3f-4da6-8374-ef485a4e27a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4874bfb-7e3f-4da6-8374-ef485a4e27a0', 'volume_size': 1} Aug 28 09:45:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-7df75dc0-136e-4548-822c-d6c647c03f06 tempest-VolumesSnapshotTestJSON-1121770850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:45:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-7df75dc0-136e-4548-822c-d6c647c03f06 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:45:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-7df75dc0-136e-4548-822c-d6c647c03f06 tempest-VolumesSnapshotTestJSON-1121770850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:45:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1322551170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4874bfb-7e3f-4da6-8374-ef485a4e27a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4f333bae244877b27a5526908ef20f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:45:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:45:38Z,use_quota=True,user_id='1bf321707b67460792c7aedc2503bedc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:45:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-7df75dc0-136e-4548-822c-d6c647c03f06 tempest-VolumesSnapshotTestJSON-1121770850 None] Creating volume e4874bfb-7e3f-4da6-8374-ef485a4e27a0 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:45:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-7df75dc0-136e-4548-822c-d6c647c03f06 tempest-VolumesSnapshotTestJSON-1121770850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:45:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-7df75dc0-136e-4548-822c-d6c647c03f06 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:45:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-7df75dc0-136e-4548-822c-d6c647c03f06 tempest-VolumesSnapshotTestJSON-1121770850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:45:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-7df75dc0-136e-4548-822c-d6c647c03f06 tempest-VolumesSnapshotTestJSON-1121770850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:45:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-7df75dc0-136e-4548-822c-d6c647c03f06 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:45:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-7df75dc0-136e-4548-822c-d6c647c03f06 tempest-VolumesSnapshotTestJSON-1121770850 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:45:38 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-7df75dc0-136e-4548-822c-d6c647c03f06 tempest-VolumesSnapshotTestJSON-1121770850 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:45:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7df75dc0-136e-4548-822c-d6c647c03f06 tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e4874bfb-7e3f-4da6-8374-ef485a4e27a0 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:38 devstack sudo[102231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e4874bfb-7e3f-4da6-8374-ef485a4e27a0 1073741824 Aug 28 09:45:38 devstack sudo[102231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:38 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-f1558165-5227-4672-8fc7-22676aa58c56 tempest-VolumeDependencyTests-633559914 None] Created reservations ['169a818e-36cc-48d5-880e-b2a3c56aeed2', '83a3e83f-6374-4a06-8ba0-0ab235fcba00', '0ccec875-7208-4d92-a692-20683caf3d38', 'c93c13a0-def7-4338-9898-fc73d233eba4'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:45:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f1558165-5227-4672-8fc7-22676aa58c56 tempest-VolumeDependencyTests-633559914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:45:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f1558165-5227-4672-8fc7-22676aa58c56 tempest-VolumeDependencyTests-633559914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:45:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-f1558165-5227-4672-8fc7-22676aa58c56 tempest-VolumeDependencyTests-633559914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:45:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-f1558165-5227-4672-8fc7-22676aa58c56 tempest-VolumeDependencyTests-633559914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:45:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f1558165-5227-4672-8fc7-22676aa58c56 tempest-VolumeDependencyTests-633559914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:45:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f1558165-5227-4672-8fc7-22676aa58c56 tempest-VolumeDependencyTests-633559914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:38 devstack sudo[102233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:45:38 devstack sudo[102233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:38 devstack sudo[102233]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f1558165-5227-4672-8fc7-22676aa58c56 tempest-VolumeDependencyTests-633559914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.270s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:38 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-f1558165-5227-4672-8fc7-22676aa58c56 tempest-VolumeDependencyTests-633559914 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:45:38 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-f1558165-5227-4672-8fc7-22676aa58c56 tempest-VolumeDependencyTests-633559914 None] Deleted volume successfully. Aug 28 09:45:38 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-f1558165-5227-4672-8fc7-22676aa58c56 tempest-VolumeDependencyTests-633559914 None] Lock "cinder-ec5f5d0c-5607-4088-89fe-f3f6c836613c-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:45:38 devstack sudo[102231]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7df75dc0-136e-4548-822c-d6c647c03f06 tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e4874bfb-7e3f-4da6-8374-ef485a4e27a0 1073741824" returned: 0 in 0.465s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7df75dc0-136e-4548-822c-d6c647c03f06 tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e4874bfb-7e3f-4da6-8374-ef485a4e27a0 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:38 devstack sudo[102240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e4874bfb-7e3f-4da6-8374-ef485a4e27a0 Aug 28 09:45:38 devstack sudo[102240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:38 devstack sudo[102240]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7df75dc0-136e-4548-822c-d6c647c03f06 tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e4874bfb-7e3f-4da6-8374-ef485a4e27a0" returned: 0 in 0.275s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-7df75dc0-136e-4548-822c-d6c647c03f06 tempest-VolumesSnapshotTestJSON-1121770850 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:45:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-7df75dc0-136e-4548-822c-d6c647c03f06 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:45:39 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7df75dc0-136e-4548-822c-d6c647c03f06 tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2573d49-24f0-4702-8f22-ef48b0376313) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4874bfb-7e3f-4da6-8374-ef485a4e27a0', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:39 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7df75dc0-136e-4548-822c-d6c647c03f06 tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adb5edbb-b8fe-4925-a906-2087ffdf7981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:39 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-7df75dc0-136e-4548-822c-d6c647c03f06 tempest-VolumesSnapshotTestJSON-1121770850 None] Volume volume-e4874bfb-7e3f-4da6-8374-ef485a4e27a0 (e4874bfb-7e3f-4da6-8374-ef485a4e27a0): created successfully Aug 28 09:45:39 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7df75dc0-136e-4548-822c-d6c647c03f06 tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adb5edbb-b8fe-4925-a906-2087ffdf7981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:39 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7df75dc0-136e-4548-822c-d6c647c03f06 tempest-VolumesSnapshotTestJSON-1121770850 None] Flow 'volume_create_manager' (4defb64c-f95f-41c1-9657-052fe61f0b24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:45:39 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-7df75dc0-136e-4548-822c-d6c647c03f06 tempest-VolumesSnapshotTestJSON-1121770850 None] Created volume successfully. Aug 28 09:45:39 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8af359e1-34ba-4990-84ea-aeea12652aff tempest-VolumeDependencyTests-633559914 None] Acquiring lock "cinder-f2aaa922-67fd-44cf-80c4-fa772fd74993-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:45:39 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8af359e1-34ba-4990-84ea-aeea12652aff tempest-VolumeDependencyTests-633559914 None] Lock "cinder-f2aaa922-67fd-44cf-80c4-fa772fd74993-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:45:39 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8af359e1-34ba-4990-84ea-aeea12652aff tempest-VolumeDependencyTests-633559914 None] Acquiring lock "cinder-quobyte-f2aaa922-67fd-44cf-80c4-fa772fd74993" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:45:39 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8af359e1-34ba-4990-84ea-aeea12652aff tempest-VolumeDependencyTests-633559914 None] Lock "cinder-quobyte-f2aaa922-67fd-44cf-80c4-fa772fd74993" acquired by "delete_volume" :: waited 0.023s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:45:39 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d87671d-3131-436f-b631-95996aafb4c0]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:45:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8af359e1-34ba-4990-84ea-aeea12652aff tempest-VolumeDependencyTests-633559914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f2aaa922-67fd-44cf-80c4-fa772fd74993 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:39 devstack sudo[102244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f2aaa922-67fd-44cf-80c4-fa772fd74993 Aug 28 09:45:39 devstack sudo[102244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:39 devstack sudo[102244]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8af359e1-34ba-4990-84ea-aeea12652aff tempest-VolumeDependencyTests-633559914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f2aaa922-67fd-44cf-80c4-fa772fd74993" returned: 0 in 0.360s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8af359e1-34ba-4990-84ea-aeea12652aff tempest-VolumeDependencyTests-633559914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f2aaa922-67fd-44cf-80c4-fa772fd74993 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:39 devstack sudo[102249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f2aaa922-67fd-44cf-80c4-fa772fd74993 Aug 28 09:45:39 devstack sudo[102249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:39 devstack sudo[102249]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8af359e1-34ba-4990-84ea-aeea12652aff tempest-VolumeDependencyTests-633559914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f2aaa922-67fd-44cf-80c4-fa772fd74993" returned: 0 in 0.247s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:39 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8af359e1-34ba-4990-84ea-aeea12652aff tempest-VolumeDependencyTests-633559914 None] Lock "cinder-quobyte-f2aaa922-67fd-44cf-80c4-fa772fd74993" released by "delete_volume" :: held 0.645s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:45:39 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writing DB stats cinder:SELECT=164,cinder:INSERT=58,cinder:UPDATE=216,cinder:DELETE=19 {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:45:39 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writing DB stats cinder:UPDATE=237,cinder:DELETE=18,cinder:SELECT=157,cinder:INSERT=51 {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:45:39 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-8af359e1-34ba-4990-84ea-aeea12652aff tempest-VolumeDependencyTests-633559914 None] Created reservations ['ca36b1ff-378a-4806-974a-3c6927e8fab7', '461dd161-4b2c-4fcf-abf6-a70cb6eb14bc', 'f1106e99-b402-46b4-9653-7c36328e484c', '1dfec921-b080-4b54-837a-9c41102251b6'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:45:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8af359e1-34ba-4990-84ea-aeea12652aff tempest-VolumeDependencyTests-633559914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:45:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8af359e1-34ba-4990-84ea-aeea12652aff tempest-VolumeDependencyTests-633559914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:45:40 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-8af359e1-34ba-4990-84ea-aeea12652aff tempest-VolumeDependencyTests-633559914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:45:40 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-8af359e1-34ba-4990-84ea-aeea12652aff tempest-VolumeDependencyTests-633559914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:45:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8af359e1-34ba-4990-84ea-aeea12652aff tempest-VolumeDependencyTests-633559914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:45:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8af359e1-34ba-4990-84ea-aeea12652aff tempest-VolumeDependencyTests-633559914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:40 devstack sudo[102252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:45:40 devstack sudo[102252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:40 devstack sudo[102252]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8af359e1-34ba-4990-84ea-aeea12652aff tempest-VolumeDependencyTests-633559914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.306s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:40 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-8af359e1-34ba-4990-84ea-aeea12652aff tempest-VolumeDependencyTests-633559914 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:45:40 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-8af359e1-34ba-4990-84ea-aeea12652aff tempest-VolumeDependencyTests-633559914 None] Deleted volume successfully. Aug 28 09:45:40 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8af359e1-34ba-4990-84ea-aeea12652aff tempest-VolumeDependencyTests-633559914 None] Lock "cinder-f2aaa922-67fd-44cf-80c4-fa772fd74993-delete_volume" released by "delete_volume" :: held 1.258s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:45:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-2328e3ce-7a58-40bc-8e46-7abb50261f15 tempest-VolumesSnapshotTestJSON-1121770850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:45:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-2328e3ce-7a58-40bc-8e46-7abb50261f15 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:45:40 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-2328e3ce-7a58-40bc-8e46-7abb50261f15 tempest-VolumesSnapshotTestJSON-1121770850 None] Creating offline snapshot 15b6d7b7-7fd8-4c50-80b0-abf75be2a243 of volume e4874bfb-7e3f-4da6-8374-ef485a4e27a0 {{(pid=86081) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:45:40 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c30c689-bc63-4699-ad43-9ab15eb6b6f4]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:45:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2328e3ce-7a58-40bc-8e46-7abb50261f15 tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e4874bfb-7e3f-4da6-8374-ef485a4e27a0 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:40 devstack sudo[102255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e4874bfb-7e3f-4da6-8374-ef485a4e27a0 Aug 28 09:45:40 devstack sudo[102255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:40 devstack sudo[102255]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2328e3ce-7a58-40bc-8e46-7abb50261f15 tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e4874bfb-7e3f-4da6-8374-ef485a4e27a0" returned: 0 in 0.405s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2328e3ce-7a58-40bc-8e46-7abb50261f15 tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e4874bfb-7e3f-4da6-8374-ef485a4e27a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e4874bfb-7e3f-4da6-8374-ef485a4e27a0.15b6d7b7-7fd8-4c50-80b0-abf75be2a243 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:40 devstack sudo[102260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e4874bfb-7e3f-4da6-8374-ef485a4e27a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e4874bfb-7e3f-4da6-8374-ef485a4e27a0.15b6d7b7-7fd8-4c50-80b0-abf75be2a243 1G Aug 28 09:45:40 devstack sudo[102260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:41 devstack sudo[102260]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2328e3ce-7a58-40bc-8e46-7abb50261f15 tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e4874bfb-7e3f-4da6-8374-ef485a4e27a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e4874bfb-7e3f-4da6-8374-ef485a4e27a0.15b6d7b7-7fd8-4c50-80b0-abf75be2a243 1G" returned: 0 in 0.462s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2328e3ce-7a58-40bc-8e46-7abb50261f15 tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4874bfb-7e3f-4da6-8374-ef485a4e27a0 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e4874bfb-7e3f-4da6-8374-ef485a4e27a0.15b6d7b7-7fd8-4c50-80b0-abf75be2a243 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:41 devstack sudo[102266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4874bfb-7e3f-4da6-8374-ef485a4e27a0 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e4874bfb-7e3f-4da6-8374-ef485a4e27a0.15b6d7b7-7fd8-4c50-80b0-abf75be2a243 Aug 28 09:45:41 devstack sudo[102266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:41 devstack sudo[102266]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2328e3ce-7a58-40bc-8e46-7abb50261f15 tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4874bfb-7e3f-4da6-8374-ef485a4e27a0 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e4874bfb-7e3f-4da6-8374-ef485a4e27a0.15b6d7b7-7fd8-4c50-80b0-abf75be2a243" returned: 0 in 0.369s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:41 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-2328e3ce-7a58-40bc-8e46-7abb50261f15 tempest-VolumesSnapshotTestJSON-1121770850 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e4874bfb-7e3f-4da6-8374-ef485a4e27a0.15b6d7b7-7fd8-4c50-80b0-abf75be2a243 is being set with open permissions: ugo+rw Aug 28 09:45:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2328e3ce-7a58-40bc-8e46-7abb50261f15 tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e4874bfb-7e3f-4da6-8374-ef485a4e27a0.15b6d7b7-7fd8-4c50-80b0-abf75be2a243 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:41 devstack sudo[102272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e4874bfb-7e3f-4da6-8374-ef485a4e27a0.15b6d7b7-7fd8-4c50-80b0-abf75be2a243 Aug 28 09:45:41 devstack sudo[102272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:42 devstack sudo[102272]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:42 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2328e3ce-7a58-40bc-8e46-7abb50261f15 tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e4874bfb-7e3f-4da6-8374-ef485a4e27a0.15b6d7b7-7fd8-4c50-80b0-abf75be2a243" returned: 0 in 0.284s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:42 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2328e3ce-7a58-40bc-8e46-7abb50261f15 tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e4874bfb-7e3f-4da6-8374-ef485a4e27a0.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:42 devstack sudo[102275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e4874bfb-7e3f-4da6-8374-ef485a4e27a0.info Aug 28 09:45:42 devstack sudo[102275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:42 devstack sudo[102275]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:42 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2328e3ce-7a58-40bc-8e46-7abb50261f15 tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e4874bfb-7e3f-4da6-8374-ef485a4e27a0.info" returned: 0 in 0.287s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:42 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-2328e3ce-7a58-40bc-8e46-7abb50261f15 tempest-VolumesSnapshotTestJSON-1121770850 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e4874bfb-7e3f-4da6-8374-ef485a4e27a0.info is being set with open permissions: ugo+rw Aug 28 09:45:42 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2328e3ce-7a58-40bc-8e46-7abb50261f15 tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e4874bfb-7e3f-4da6-8374-ef485a4e27a0.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:42 devstack sudo[102278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e4874bfb-7e3f-4da6-8374-ef485a4e27a0.info Aug 28 09:45:42 devstack sudo[102278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:42 devstack sudo[102278]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:42 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2328e3ce-7a58-40bc-8e46-7abb50261f15 tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e4874bfb-7e3f-4da6-8374-ef485a4e27a0.info" returned: 0 in 0.266s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:42 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-2328e3ce-7a58-40bc-8e46-7abb50261f15 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.175s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:45:42 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-2328e3ce-7a58-40bc-8e46-7abb50261f15 tempest-VolumesSnapshotTestJSON-1121770850 None] Create snapshot completed successfully Aug 28 09:45:43 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-05013f8c-eb75-4ea2-8aa4-0158beae4063 tempest-CinderUnicodeTest-785869527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:45:43 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-05013f8c-eb75-4ea2-8aa4-0158beae4063 tempest-CinderUnicodeTest-785869527 None] Flow 'volume_create_manager' (6ed97707-4720-4126-b5d4-c7b3821f657a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:45:43 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-05013f8c-eb75-4ea2-8aa4-0158beae4063 tempest-CinderUnicodeTest-785869527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d59618a-9e6c-40ca-9adb-511100522bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:43 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-05013f8c-eb75-4ea2-8aa4-0158beae4063 tempest-CinderUnicodeTest-785869527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d59618a-9e6c-40ca-9adb-511100522bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1b48f07-db95-487b-b56c-a6bdc8e516e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e21ff433f0394d81b12bc44a498d4989',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:45:43Z,use_quota=True,user_id='52976ef8c5264d0bbe2b9243ac89f910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:43 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-05013f8c-eb75-4ea2-8aa4-0158beae4063 tempest-CinderUnicodeTest-785869527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7982215f-4867-4ad4-bcf6-83da06ea265d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:43 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-05013f8c-eb75-4ea2-8aa4-0158beae4063 tempest-CinderUnicodeTest-785869527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7982215f-4867-4ad4-bcf6-83da06ea265d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:43 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-05013f8c-eb75-4ea2-8aa4-0158beae4063 tempest-CinderUnicodeTest-785869527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da9e7efd-5b96-4f4e-a84b-f35f08c200da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:43 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-05013f8c-eb75-4ea2-8aa4-0158beae4063 tempest-CinderUnicodeTest-785869527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da9e7efd-5b96-4f4e-a84b-f35f08c200da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1b48f07-db95-487b-b56c-a6bdc8e516e8', 'volume_name': 'volume-f1b48f07-db95-487b-b56c-a6bdc8e516e8', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:43 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-05013f8c-eb75-4ea2-8aa4-0158beae4063 tempest-CinderUnicodeTest-785869527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd5fe319-803a-4a24-85e9-a8c5397ca644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:43 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-05013f8c-eb75-4ea2-8aa4-0158beae4063 tempest-CinderUnicodeTest-785869527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd5fe319-803a-4a24-85e9-a8c5397ca644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:43 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-05013f8c-eb75-4ea2-8aa4-0158beae4063 tempest-CinderUnicodeTest-785869527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b867b5f-f235-4657-8f25-50115612730d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:43 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-05013f8c-eb75-4ea2-8aa4-0158beae4063 tempest-CinderUnicodeTest-785869527 None] Volume f1b48f07-db95-487b-b56c-a6bdc8e516e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1b48f07-db95-487b-b56c-a6bdc8e516e8', 'volume_size': 1} Aug 28 09:45:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-05013f8c-eb75-4ea2-8aa4-0158beae4063 tempest-CinderUnicodeTest-785869527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:45:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-05013f8c-eb75-4ea2-8aa4-0158beae4063 tempest-CinderUnicodeTest-785869527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:45:43 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-05013f8c-eb75-4ea2-8aa4-0158beae4063 tempest-CinderUnicodeTest-785869527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1b48f07-db95-487b-b56c-a6bdc8e516e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e21ff433f0394d81b12bc44a498d4989',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:45:43Z,use_quota=True,user_id='52976ef8c5264d0bbe2b9243ac89f910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:45:43 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-05013f8c-eb75-4ea2-8aa4-0158beae4063 tempest-CinderUnicodeTest-785869527 None] Creating volume f1b48f07-db95-487b-b56c-a6bdc8e516e8 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:45:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-05013f8c-eb75-4ea2-8aa4-0158beae4063 tempest-CinderUnicodeTest-785869527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:45:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-05013f8c-eb75-4ea2-8aa4-0158beae4063 tempest-CinderUnicodeTest-785869527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:45:43 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-05013f8c-eb75-4ea2-8aa4-0158beae4063 tempest-CinderUnicodeTest-785869527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:45:43 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-05013f8c-eb75-4ea2-8aa4-0158beae4063 tempest-CinderUnicodeTest-785869527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:45:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-05013f8c-eb75-4ea2-8aa4-0158beae4063 tempest-CinderUnicodeTest-785869527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:45:43 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-05013f8c-eb75-4ea2-8aa4-0158beae4063 tempest-CinderUnicodeTest-785869527 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:45:43 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-05013f8c-eb75-4ea2-8aa4-0158beae4063 tempest-CinderUnicodeTest-785869527 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:45:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-05013f8c-eb75-4ea2-8aa4-0158beae4063 tempest-CinderUnicodeTest-785869527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f1b48f07-db95-487b-b56c-a6bdc8e516e8 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:43 devstack sudo[102282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f1b48f07-db95-487b-b56c-a6bdc8e516e8 1073741824 Aug 28 09:45:43 devstack sudo[102282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:43 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-15c40584-f803-4d07-ba53-21881aec8a80 tempest-VolumesSnapshotTestJSON-1121770850 None] Acquiring lock "cinder-15b6d7b7-7fd8-4c50-80b0-abf75be2a243-delete_snapshot" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:45:43 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-15c40584-f803-4d07-ba53-21881aec8a80 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "cinder-15b6d7b7-7fd8-4c50-80b0-abf75be2a243-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:45:43 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-15c40584-f803-4d07-ba53-21881aec8a80 tempest-VolumesSnapshotTestJSON-1121770850 None] Acquiring lock "cinder-quobyte-e4874bfb-7e3f-4da6-8374-ef485a4e27a0" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:45:43 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-15c40584-f803-4d07-ba53-21881aec8a80 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "cinder-quobyte-e4874bfb-7e3f-4da6-8374-ef485a4e27a0" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:45:43 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-15c40584-f803-4d07-ba53-21881aec8a80 tempest-VolumesSnapshotTestJSON-1121770850 None] Acquiring lock "cinder-quobyte-15b6d7b7-7fd8-4c50-80b0-abf75be2a243" by "_delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:45:43 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-15c40584-f803-4d07-ba53-21881aec8a80 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "cinder-quobyte-15b6d7b7-7fd8-4c50-80b0-abf75be2a243" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:45:43 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-15c40584-f803-4d07-ba53-21881aec8a80 tempest-VolumesSnapshotTestJSON-1121770850 None] Deleting offline snapshot 15b6d7b7-7fd8-4c50-80b0-abf75be2a243 of volume e4874bfb-7e3f-4da6-8374-ef485a4e27a0 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:45:43 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-15c40584-f803-4d07-ba53-21881aec8a80 tempest-VolumesSnapshotTestJSON-1121770850 None] snapshot_file for this snap is: volume-e4874bfb-7e3f-4da6-8374-ef485a4e27a0.15b6d7b7-7fd8-4c50-80b0-abf75be2a243 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:45:43 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e67b6c7-9059-4d8e-8cc3-972adf31bf19]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:45:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-15c40584-f803-4d07-ba53-21881aec8a80 tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e4874bfb-7e3f-4da6-8374-ef485a4e27a0.15b6d7b7-7fd8-4c50-80b0-abf75be2a243 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:43 devstack sudo[102282]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-05013f8c-eb75-4ea2-8aa4-0158beae4063 tempest-CinderUnicodeTest-785869527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f1b48f07-db95-487b-b56c-a6bdc8e516e8 1073741824" returned: 0 in 0.452s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:43 devstack sudo[102288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e4874bfb-7e3f-4da6-8374-ef485a4e27a0.15b6d7b7-7fd8-4c50-80b0-abf75be2a243 Aug 28 09:45:43 devstack sudo[102288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-05013f8c-eb75-4ea2-8aa4-0158beae4063 tempest-CinderUnicodeTest-785869527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f1b48f07-db95-487b-b56c-a6bdc8e516e8 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:44 devstack sudo[102290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f1b48f07-db95-487b-b56c-a6bdc8e516e8 Aug 28 09:45:44 devstack sudo[102290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:44 devstack sudo[102288]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-15c40584-f803-4d07-ba53-21881aec8a80 tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e4874bfb-7e3f-4da6-8374-ef485a4e27a0.15b6d7b7-7fd8-4c50-80b0-abf75be2a243" returned: 0 in 0.395s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:44 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-15c40584-f803-4d07-ba53-21881aec8a80 tempest-VolumesSnapshotTestJSON-1121770850 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4874bfb-7e3f-4da6-8374-ef485a4e27a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:45:44 devstack sudo[102290]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-05013f8c-eb75-4ea2-8aa4-0158beae4063 tempest-CinderUnicodeTest-785869527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f1b48f07-db95-487b-b56c-a6bdc8e516e8" returned: 0 in 0.255s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:44 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-05013f8c-eb75-4ea2-8aa4-0158beae4063 tempest-CinderUnicodeTest-785869527 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:45:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-05013f8c-eb75-4ea2-8aa4-0158beae4063 tempest-CinderUnicodeTest-785869527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:45:44 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fdef0d-db0a-4e66-8a60-38215023f9d6]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:45:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-15c40584-f803-4d07-ba53-21881aec8a80 tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e4874bfb-7e3f-4da6-8374-ef485a4e27a0 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:44 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-05013f8c-eb75-4ea2-8aa4-0158beae4063 tempest-CinderUnicodeTest-785869527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b867b5f-f235-4657-8f25-50115612730d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1b48f07-db95-487b-b56c-a6bdc8e516e8', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:44 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-05013f8c-eb75-4ea2-8aa4-0158beae4063 tempest-CinderUnicodeTest-785869527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80b83669-313c-4ffe-ba81-feb6a9202020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:44 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-05013f8c-eb75-4ea2-8aa4-0158beae4063 tempest-CinderUnicodeTest-785869527 None] Volume volume-f1b48f07-db95-487b-b56c-a6bdc8e516e8 (f1b48f07-db95-487b-b56c-a6bdc8e516e8): created successfully Aug 28 09:45:44 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-05013f8c-eb75-4ea2-8aa4-0158beae4063 tempest-CinderUnicodeTest-785869527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80b83669-313c-4ffe-ba81-feb6a9202020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:44 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-05013f8c-eb75-4ea2-8aa4-0158beae4063 tempest-CinderUnicodeTest-785869527 None] Flow 'volume_create_manager' (6ed97707-4720-4126-b5d4-c7b3821f657a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:45:44 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-05013f8c-eb75-4ea2-8aa4-0158beae4063 tempest-CinderUnicodeTest-785869527 None] Created volume successfully. Aug 28 09:45:44 devstack sudo[102297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e4874bfb-7e3f-4da6-8374-ef485a4e27a0 Aug 28 09:45:44 devstack sudo[102297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:44 devstack sudo[102297]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-15c40584-f803-4d07-ba53-21881aec8a80 tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e4874bfb-7e3f-4da6-8374-ef485a4e27a0" returned: 0 in 0.351s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-15c40584-f803-4d07-ba53-21881aec8a80 tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e4874bfb-7e3f-4da6-8374-ef485a4e27a0.15b6d7b7-7fd8-4c50-80b0-abf75be2a243 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:44 devstack sudo[102302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e4874bfb-7e3f-4da6-8374-ef485a4e27a0.15b6d7b7-7fd8-4c50-80b0-abf75be2a243 Aug 28 09:45:44 devstack sudo[102302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:44 devstack sudo[102302]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-15c40584-f803-4d07-ba53-21881aec8a80 tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e4874bfb-7e3f-4da6-8374-ef485a4e27a0.15b6d7b7-7fd8-4c50-80b0-abf75be2a243" returned: 0 in 0.345s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-15c40584-f803-4d07-ba53-21881aec8a80 tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e4874bfb-7e3f-4da6-8374-ef485a4e27a0.15b6d7b7-7fd8-4c50-80b0-abf75be2a243 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:44 devstack sudo[102307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e4874bfb-7e3f-4da6-8374-ef485a4e27a0.15b6d7b7-7fd8-4c50-80b0-abf75be2a243 Aug 28 09:45:44 devstack sudo[102307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:44 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0d447d3-5b91-4332-a19a-ade2f5482823 tempest-CinderUnicodeTest-785869527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:45:45 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f0d447d3-5b91-4332-a19a-ade2f5482823 tempest-CinderUnicodeTest-785869527 None] Flow 'volume_create_manager' (7c130bf2-ca9f-4445-8726-e4774d26077b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:45:45 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f0d447d3-5b91-4332-a19a-ade2f5482823 tempest-CinderUnicodeTest-785869527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d0dbbb1-c6b0-47e5-9f7a-b8457e6311c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:45 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f0d447d3-5b91-4332-a19a-ade2f5482823 tempest-CinderUnicodeTest-785869527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d0dbbb1-c6b0-47e5-9f7a-b8457e6311c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:45:45Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1213612577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9802eb18-09f9-462d-aff6-f66b09c4f01c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e21ff433f0394d81b12bc44a498d4989',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:45:45Z,use_quota=True,user_id='52976ef8c5264d0bbe2b9243ac89f910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:45 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f0d447d3-5b91-4332-a19a-ade2f5482823 tempest-CinderUnicodeTest-785869527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48e2352f-b772-4a93-bf16-ed988d2111f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:45 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f0d447d3-5b91-4332-a19a-ade2f5482823 tempest-CinderUnicodeTest-785869527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48e2352f-b772-4a93-bf16-ed988d2111f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:45 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f0d447d3-5b91-4332-a19a-ade2f5482823 tempest-CinderUnicodeTest-785869527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7d2d4e7-5c0b-401e-800a-027f86a670a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:45 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f0d447d3-5b91-4332-a19a-ade2f5482823 tempest-CinderUnicodeTest-785869527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7d2d4e7-5c0b-401e-800a-027f86a670a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9802eb18-09f9-462d-aff6-f66b09c4f01c', 'volume_name': 'volume-9802eb18-09f9-462d-aff6-f66b09c4f01c', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:45 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f0d447d3-5b91-4332-a19a-ade2f5482823 tempest-CinderUnicodeTest-785869527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbd9abf5-2277-4fde-9fe0-ca0a71d1f6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:45 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f0d447d3-5b91-4332-a19a-ade2f5482823 tempest-CinderUnicodeTest-785869527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbd9abf5-2277-4fde-9fe0-ca0a71d1f6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:45 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f0d447d3-5b91-4332-a19a-ade2f5482823 tempest-CinderUnicodeTest-785869527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c271a3f3-3204-46bb-87ca-b4a0898cc262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:45 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-f0d447d3-5b91-4332-a19a-ade2f5482823 tempest-CinderUnicodeTest-785869527 None] Volume 9802eb18-09f9-462d-aff6-f66b09c4f01c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9802eb18-09f9-462d-aff6-f66b09c4f01c', 'volume_size': 1} Aug 28 09:45:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f0d447d3-5b91-4332-a19a-ade2f5482823 tempest-CinderUnicodeTest-785869527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:45:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f0d447d3-5b91-4332-a19a-ade2f5482823 tempest-CinderUnicodeTest-785869527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:45:45 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-f0d447d3-5b91-4332-a19a-ade2f5482823 tempest-CinderUnicodeTest-785869527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:45:45Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1213612577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9802eb18-09f9-462d-aff6-f66b09c4f01c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e21ff433f0394d81b12bc44a498d4989',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:45:45Z,use_quota=True,user_id='52976ef8c5264d0bbe2b9243ac89f910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:45:45 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-f0d447d3-5b91-4332-a19a-ade2f5482823 tempest-CinderUnicodeTest-785869527 None] Creating volume 9802eb18-09f9-462d-aff6-f66b09c4f01c {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:45:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f0d447d3-5b91-4332-a19a-ade2f5482823 tempest-CinderUnicodeTest-785869527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:45:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f0d447d3-5b91-4332-a19a-ade2f5482823 tempest-CinderUnicodeTest-785869527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:45:45 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-f0d447d3-5b91-4332-a19a-ade2f5482823 tempest-CinderUnicodeTest-785869527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:45:45 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-f0d447d3-5b91-4332-a19a-ade2f5482823 tempest-CinderUnicodeTest-785869527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:45:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f0d447d3-5b91-4332-a19a-ade2f5482823 tempest-CinderUnicodeTest-785869527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:45:45 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-f0d447d3-5b91-4332-a19a-ade2f5482823 tempest-CinderUnicodeTest-785869527 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:45:45 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-f0d447d3-5b91-4332-a19a-ade2f5482823 tempest-CinderUnicodeTest-785869527 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:45:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f0d447d3-5b91-4332-a19a-ade2f5482823 tempest-CinderUnicodeTest-785869527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9802eb18-09f9-462d-aff6-f66b09c4f01c 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:45 devstack sudo[102309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9802eb18-09f9-462d-aff6-f66b09c4f01c 1073741824 Aug 28 09:45:45 devstack sudo[102309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:45 devstack sudo[102307]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-15c40584-f803-4d07-ba53-21881aec8a80 tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e4874bfb-7e3f-4da6-8374-ef485a4e27a0.15b6d7b7-7fd8-4c50-80b0-abf75be2a243" returned: 0 in 0.258s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:45 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-15c40584-f803-4d07-ba53-21881aec8a80 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "cinder-quobyte-15b6d7b7-7fd8-4c50-80b0-abf75be2a243" released by "_delete_snapshot" :: held 1.451s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:45:45 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-15c40584-f803-4d07-ba53-21881aec8a80 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "cinder-quobyte-e4874bfb-7e3f-4da6-8374-ef485a4e27a0" released by "delete_snapshot" :: held 1.475s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:45:45 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-15c40584-f803-4d07-ba53-21881aec8a80 tempest-VolumesSnapshotTestJSON-1121770850 None] Created reservations ['16a8a3cc-adda-4cd5-926f-8ef6cd836d24', '9c164851-f527-4c03-9622-9717360897d4', '6b8c17d5-972b-4e81-9ead-b7ae64aed2d7', '5885fa31-ff4d-4354-82de-8c687356ffa3'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:45:45 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-15c40584-f803-4d07-ba53-21881aec8a80 tempest-VolumesSnapshotTestJSON-1121770850 None] Delete snapshot completed successfully. Aug 28 09:45:45 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-15c40584-f803-4d07-ba53-21881aec8a80 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "cinder-15b6d7b7-7fd8-4c50-80b0-abf75be2a243-delete_snapshot" released by "delete_snapshot" :: held 1.645s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:45:45 devstack sudo[102309]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f0d447d3-5b91-4332-a19a-ade2f5482823 tempest-CinderUnicodeTest-785869527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9802eb18-09f9-462d-aff6-f66b09c4f01c 1073741824" returned: 0 in 0.428s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f0d447d3-5b91-4332-a19a-ade2f5482823 tempest-CinderUnicodeTest-785869527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9802eb18-09f9-462d-aff6-f66b09c4f01c {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:45 devstack sudo[102316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9802eb18-09f9-462d-aff6-f66b09c4f01c Aug 28 09:45:45 devstack sudo[102316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:45 devstack sudo[102316]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f0d447d3-5b91-4332-a19a-ade2f5482823 tempest-CinderUnicodeTest-785869527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9802eb18-09f9-462d-aff6-f66b09c4f01c" returned: 0 in 0.247s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:45 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-f0d447d3-5b91-4332-a19a-ade2f5482823 tempest-CinderUnicodeTest-785869527 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:45:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f0d447d3-5b91-4332-a19a-ade2f5482823 tempest-CinderUnicodeTest-785869527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:45:45 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f0d447d3-5b91-4332-a19a-ade2f5482823 tempest-CinderUnicodeTest-785869527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c271a3f3-3204-46bb-87ca-b4a0898cc262) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9802eb18-09f9-462d-aff6-f66b09c4f01c', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:45 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f0d447d3-5b91-4332-a19a-ade2f5482823 tempest-CinderUnicodeTest-785869527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4103672a-cd13-4d0f-9b65-413b857a0e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:45 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-f0d447d3-5b91-4332-a19a-ade2f5482823 tempest-CinderUnicodeTest-785869527 None] Volume volume-9802eb18-09f9-462d-aff6-f66b09c4f01c (9802eb18-09f9-462d-aff6-f66b09c4f01c): created successfully Aug 28 09:45:45 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f0d447d3-5b91-4332-a19a-ade2f5482823 tempest-CinderUnicodeTest-785869527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4103672a-cd13-4d0f-9b65-413b857a0e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:45 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f0d447d3-5b91-4332-a19a-ade2f5482823 tempest-CinderUnicodeTest-785869527 None] Flow 'volume_create_manager' (7c130bf2-ca9f-4445-8726-e4774d26077b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:45:45 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-f0d447d3-5b91-4332-a19a-ade2f5482823 tempest-CinderUnicodeTest-785869527 None] Created volume successfully. Aug 28 09:45:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e6b43364-552a-4b3b-a0c4-a5dd9bacb96e tempest-CinderUnicodeTest-785869527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:45:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e6b43364-552a-4b3b-a0c4-a5dd9bacb96e tempest-CinderUnicodeTest-785869527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:45:46 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-e6b43364-552a-4b3b-a0c4-a5dd9bacb96e tempest-CinderUnicodeTest-785869527 None] Creating offline snapshot 1336ccde-d20c-49cc-920b-1a680a5d11a2 of volume 9802eb18-09f9-462d-aff6-f66b09c4f01c {{(pid=86081) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:45:46 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d59ec22-46ee-498c-9d9f-567d29040291]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:45:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e6b43364-552a-4b3b-a0c4-a5dd9bacb96e tempest-CinderUnicodeTest-785869527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9802eb18-09f9-462d-aff6-f66b09c4f01c {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:46 devstack sudo[102319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9802eb18-09f9-462d-aff6-f66b09c4f01c Aug 28 09:45:46 devstack sudo[102319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:46 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d104b53-1945-483f-a811-6b5fc52e894c tempest-VolumesSnapshotTestJSON-1121770850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:45:46 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0d104b53-1945-483f-a811-6b5fc52e894c tempest-VolumesSnapshotTestJSON-1121770850 None] Flow 'volume_create_manager' (8d452f62-cdf6-478c-a665-db5a8266ba3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:45:46 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0d104b53-1945-483f-a811-6b5fc52e894c tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14935268-5801-4f53-b8d4-dd699c9ca8fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:46 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0d104b53-1945-483f-a811-6b5fc52e894c tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14935268-5801-4f53-b8d4-dd699c9ca8fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:45:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-957507414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c62bda3d-8446-4d7d-ad36-6e177d4407c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4f333bae244877b27a5526908ef20f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:45:46Z,use_quota=True,user_id='1bf321707b67460792c7aedc2503bedc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:46 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0d104b53-1945-483f-a811-6b5fc52e894c tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53e8fdbf-a039-476a-801f-23a2044952fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:46 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0d104b53-1945-483f-a811-6b5fc52e894c tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53e8fdbf-a039-476a-801f-23a2044952fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:46 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0d104b53-1945-483f-a811-6b5fc52e894c tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93136bac-e6ee-460b-a7af-3fe1cf404759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:46 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0d104b53-1945-483f-a811-6b5fc52e894c tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93136bac-e6ee-460b-a7af-3fe1cf404759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c62bda3d-8446-4d7d-ad36-6e177d4407c5', 'volume_name': 'volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:46 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0d104b53-1945-483f-a811-6b5fc52e894c tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a722dbce-7dae-46a6-bb72-0d8f36f1097c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:46 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0d104b53-1945-483f-a811-6b5fc52e894c tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a722dbce-7dae-46a6-bb72-0d8f36f1097c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:46 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0d104b53-1945-483f-a811-6b5fc52e894c tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36ac31d9-9060-461a-b7bf-5b48646cf1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:46 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-0d104b53-1945-483f-a811-6b5fc52e894c tempest-VolumesSnapshotTestJSON-1121770850 None] Volume c62bda3d-8446-4d7d-ad36-6e177d4407c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5', 'volume_size': 1} Aug 28 09:45:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0d104b53-1945-483f-a811-6b5fc52e894c tempest-VolumesSnapshotTestJSON-1121770850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:45:46 devstack sudo[102319]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e6b43364-552a-4b3b-a0c4-a5dd9bacb96e tempest-CinderUnicodeTest-785869527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9802eb18-09f9-462d-aff6-f66b09c4f01c" returned: 0 in 0.351s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e6b43364-552a-4b3b-a0c4-a5dd9bacb96e tempest-CinderUnicodeTest-785869527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9802eb18-09f9-462d-aff6-f66b09c4f01c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9802eb18-09f9-462d-aff6-f66b09c4f01c.1336ccde-d20c-49cc-920b-1a680a5d11a2 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:46 devstack sudo[102324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9802eb18-09f9-462d-aff6-f66b09c4f01c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9802eb18-09f9-462d-aff6-f66b09c4f01c.1336ccde-d20c-49cc-920b-1a680a5d11a2 1G Aug 28 09:45:46 devstack sudo[102324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:47 devstack sudo[102324]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e6b43364-552a-4b3b-a0c4-a5dd9bacb96e tempest-CinderUnicodeTest-785869527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9802eb18-09f9-462d-aff6-f66b09c4f01c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9802eb18-09f9-462d-aff6-f66b09c4f01c.1336ccde-d20c-49cc-920b-1a680a5d11a2 1G" returned: 0 in 0.379s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e6b43364-552a-4b3b-a0c4-a5dd9bacb96e tempest-CinderUnicodeTest-785869527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9802eb18-09f9-462d-aff6-f66b09c4f01c -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9802eb18-09f9-462d-aff6-f66b09c4f01c.1336ccde-d20c-49cc-920b-1a680a5d11a2 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:47 devstack sudo[102330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9802eb18-09f9-462d-aff6-f66b09c4f01c -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9802eb18-09f9-462d-aff6-f66b09c4f01c.1336ccde-d20c-49cc-920b-1a680a5d11a2 Aug 28 09:45:47 devstack sudo[102330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:47 devstack sudo[102330]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e6b43364-552a-4b3b-a0c4-a5dd9bacb96e tempest-CinderUnicodeTest-785869527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9802eb18-09f9-462d-aff6-f66b09c4f01c -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9802eb18-09f9-462d-aff6-f66b09c4f01c.1336ccde-d20c-49cc-920b-1a680a5d11a2" returned: 0 in 0.289s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:47 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-e6b43364-552a-4b3b-a0c4-a5dd9bacb96e tempest-CinderUnicodeTest-785869527 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9802eb18-09f9-462d-aff6-f66b09c4f01c.1336ccde-d20c-49cc-920b-1a680a5d11a2 is being set with open permissions: ugo+rw Aug 28 09:45:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e6b43364-552a-4b3b-a0c4-a5dd9bacb96e tempest-CinderUnicodeTest-785869527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9802eb18-09f9-462d-aff6-f66b09c4f01c.1336ccde-d20c-49cc-920b-1a680a5d11a2 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:47 devstack sudo[102335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9802eb18-09f9-462d-aff6-f66b09c4f01c.1336ccde-d20c-49cc-920b-1a680a5d11a2 Aug 28 09:45:47 devstack sudo[102335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:47 devstack sudo[102335]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e6b43364-552a-4b3b-a0c4-a5dd9bacb96e tempest-CinderUnicodeTest-785869527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9802eb18-09f9-462d-aff6-f66b09c4f01c.1336ccde-d20c-49cc-920b-1a680a5d11a2" returned: 0 in 0.241s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e6b43364-552a-4b3b-a0c4-a5dd9bacb96e tempest-CinderUnicodeTest-785869527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9802eb18-09f9-462d-aff6-f66b09c4f01c.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:47 devstack sudo[102338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9802eb18-09f9-462d-aff6-f66b09c4f01c.info Aug 28 09:45:47 devstack sudo[102338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:47 devstack sudo[102338]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e6b43364-552a-4b3b-a0c4-a5dd9bacb96e tempest-CinderUnicodeTest-785869527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9802eb18-09f9-462d-aff6-f66b09c4f01c.info" returned: 0 in 0.254s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:47 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-e6b43364-552a-4b3b-a0c4-a5dd9bacb96e tempest-CinderUnicodeTest-785869527 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9802eb18-09f9-462d-aff6-f66b09c4f01c.info is being set with open permissions: ugo+rw Aug 28 09:45:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e6b43364-552a-4b3b-a0c4-a5dd9bacb96e tempest-CinderUnicodeTest-785869527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9802eb18-09f9-462d-aff6-f66b09c4f01c.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:47 devstack sudo[102341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9802eb18-09f9-462d-aff6-f66b09c4f01c.info Aug 28 09:45:47 devstack sudo[102341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:48 devstack sudo[102341]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e6b43364-552a-4b3b-a0c4-a5dd9bacb96e tempest-CinderUnicodeTest-785869527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9802eb18-09f9-462d-aff6-f66b09c4f01c.info" returned: 0 in 0.243s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e6b43364-552a-4b3b-a0c4-a5dd9bacb96e tempest-CinderUnicodeTest-785869527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.852s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:45:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0d104b53-1945-483f-a811-6b5fc52e894c tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.529s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:45:48 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0d104b53-1945-483f-a811-6b5fc52e894c tempest-VolumesSnapshotTestJSON-1121770850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:45:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-957507414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c62bda3d-8446-4d7d-ad36-6e177d4407c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4f333bae244877b27a5526908ef20f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:45:46Z,use_quota=True,user_id='1bf321707b67460792c7aedc2503bedc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:45:48 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-0d104b53-1945-483f-a811-6b5fc52e894c tempest-VolumesSnapshotTestJSON-1121770850 None] Creating volume c62bda3d-8446-4d7d-ad36-6e177d4407c5 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:45:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0d104b53-1945-483f-a811-6b5fc52e894c tempest-VolumesSnapshotTestJSON-1121770850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:45:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0d104b53-1945-483f-a811-6b5fc52e894c tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:45:48 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0d104b53-1945-483f-a811-6b5fc52e894c tempest-VolumesSnapshotTestJSON-1121770850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:45:48 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0d104b53-1945-483f-a811-6b5fc52e894c tempest-VolumesSnapshotTestJSON-1121770850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:45:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0d104b53-1945-483f-a811-6b5fc52e894c tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:45:48 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0d104b53-1945-483f-a811-6b5fc52e894c tempest-VolumesSnapshotTestJSON-1121770850 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:45:48 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-0d104b53-1945-483f-a811-6b5fc52e894c tempest-VolumesSnapshotTestJSON-1121770850 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:45:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0d104b53-1945-483f-a811-6b5fc52e894c tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:48 devstack sudo[102344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5 1073741824 Aug 28 09:45:48 devstack sudo[102344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:48 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-e6b43364-552a-4b3b-a0c4-a5dd9bacb96e tempest-CinderUnicodeTest-785869527 None] Create snapshot completed successfully Aug 28 09:45:48 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-9af5be15-6b60-4c08-8200-529b759ce76a tempest-CinderUnicodeTest-785869527 None] Acquiring lock "cinder-1336ccde-d20c-49cc-920b-1a680a5d11a2-delete_snapshot" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:45:48 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-9af5be15-6b60-4c08-8200-529b759ce76a tempest-CinderUnicodeTest-785869527 None] Lock "cinder-1336ccde-d20c-49cc-920b-1a680a5d11a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:45:48 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-9af5be15-6b60-4c08-8200-529b759ce76a tempest-CinderUnicodeTest-785869527 None] Acquiring lock "cinder-quobyte-9802eb18-09f9-462d-aff6-f66b09c4f01c" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:45:48 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-9af5be15-6b60-4c08-8200-529b759ce76a tempest-CinderUnicodeTest-785869527 None] Lock "cinder-quobyte-9802eb18-09f9-462d-aff6-f66b09c4f01c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:45:48 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-9af5be15-6b60-4c08-8200-529b759ce76a tempest-CinderUnicodeTest-785869527 None] Acquiring lock "cinder-quobyte-1336ccde-d20c-49cc-920b-1a680a5d11a2" by "_delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:45:48 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-9af5be15-6b60-4c08-8200-529b759ce76a tempest-CinderUnicodeTest-785869527 None] Lock "cinder-quobyte-1336ccde-d20c-49cc-920b-1a680a5d11a2" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:45:48 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-9af5be15-6b60-4c08-8200-529b759ce76a tempest-CinderUnicodeTest-785869527 None] Deleting offline snapshot 1336ccde-d20c-49cc-920b-1a680a5d11a2 of volume 9802eb18-09f9-462d-aff6-f66b09c4f01c {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:45:48 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-9af5be15-6b60-4c08-8200-529b759ce76a tempest-CinderUnicodeTest-785869527 None] snapshot_file for this snap is: volume-9802eb18-09f9-462d-aff6-f66b09c4f01c.1336ccde-d20c-49cc-920b-1a680a5d11a2 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:45:48 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab89e3f-482e-4718-aa4e-2f2ce634557c]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:45:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9af5be15-6b60-4c08-8200-529b759ce76a tempest-CinderUnicodeTest-785869527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9802eb18-09f9-462d-aff6-f66b09c4f01c.1336ccde-d20c-49cc-920b-1a680a5d11a2 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:48 devstack sudo[102344]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0d104b53-1945-483f-a811-6b5fc52e894c tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5 1073741824" returned: 0 in 0.448s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:48 devstack sudo[102349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9802eb18-09f9-462d-aff6-f66b09c4f01c.1336ccde-d20c-49cc-920b-1a680a5d11a2 Aug 28 09:45:48 devstack sudo[102349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0d104b53-1945-483f-a811-6b5fc52e894c tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:48 devstack sudo[102352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5 Aug 28 09:45:48 devstack sudo[102352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:48 devstack sudo[102349]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9af5be15-6b60-4c08-8200-529b759ce76a tempest-CinderUnicodeTest-785869527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9802eb18-09f9-462d-aff6-f66b09c4f01c.1336ccde-d20c-49cc-920b-1a680a5d11a2" returned: 0 in 0.364s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:48 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-9af5be15-6b60-4c08-8200-529b759ce76a tempest-CinderUnicodeTest-785869527 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9802eb18-09f9-462d-aff6-f66b09c4f01c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:45:48 devstack sudo[102352]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0d104b53-1945-483f-a811-6b5fc52e894c tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5" returned: 0 in 0.264s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:48 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0d104b53-1945-483f-a811-6b5fc52e894c tempest-VolumesSnapshotTestJSON-1121770850 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:45:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0d104b53-1945-483f-a811-6b5fc52e894c tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:45:48 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[690f0c08-2093-4d33-99fe-a1b2ba5e75ee]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:45:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9af5be15-6b60-4c08-8200-529b759ce76a tempest-CinderUnicodeTest-785869527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9802eb18-09f9-462d-aff6-f66b09c4f01c {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:48 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0d104b53-1945-483f-a811-6b5fc52e894c tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36ac31d9-9060-461a-b7bf-5b48646cf1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:48 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0d104b53-1945-483f-a811-6b5fc52e894c tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63ab1d5f-62e2-4893-aa88-e1274476a686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:48 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-0d104b53-1945-483f-a811-6b5fc52e894c tempest-VolumesSnapshotTestJSON-1121770850 None] Volume volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5 (c62bda3d-8446-4d7d-ad36-6e177d4407c5): created successfully Aug 28 09:45:48 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0d104b53-1945-483f-a811-6b5fc52e894c tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63ab1d5f-62e2-4893-aa88-e1274476a686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:48 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0d104b53-1945-483f-a811-6b5fc52e894c tempest-VolumesSnapshotTestJSON-1121770850 None] Flow 'volume_create_manager' (8d452f62-cdf6-478c-a665-db5a8266ba3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:45:48 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-0d104b53-1945-483f-a811-6b5fc52e894c tempest-VolumesSnapshotTestJSON-1121770850 None] Created volume successfully. Aug 28 09:45:48 devstack sudo[102358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9802eb18-09f9-462d-aff6-f66b09c4f01c Aug 28 09:45:48 devstack sudo[102358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:49 devstack sudo[102358]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9af5be15-6b60-4c08-8200-529b759ce76a tempest-CinderUnicodeTest-785869527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9802eb18-09f9-462d-aff6-f66b09c4f01c" returned: 0 in 0.395s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9af5be15-6b60-4c08-8200-529b759ce76a tempest-CinderUnicodeTest-785869527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9802eb18-09f9-462d-aff6-f66b09c4f01c.1336ccde-d20c-49cc-920b-1a680a5d11a2 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:49 devstack sudo[102364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9802eb18-09f9-462d-aff6-f66b09c4f01c.1336ccde-d20c-49cc-920b-1a680a5d11a2 Aug 28 09:45:49 devstack sudo[102364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:49 devstack sudo[102364]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9af5be15-6b60-4c08-8200-529b759ce76a tempest-CinderUnicodeTest-785869527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9802eb18-09f9-462d-aff6-f66b09c4f01c.1336ccde-d20c-49cc-920b-1a680a5d11a2" returned: 0 in 0.389s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9af5be15-6b60-4c08-8200-529b759ce76a tempest-CinderUnicodeTest-785869527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9802eb18-09f9-462d-aff6-f66b09c4f01c.1336ccde-d20c-49cc-920b-1a680a5d11a2 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:49 devstack sudo[102370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9802eb18-09f9-462d-aff6-f66b09c4f01c.1336ccde-d20c-49cc-920b-1a680a5d11a2 Aug 28 09:45:49 devstack sudo[102370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-df04234b-41b2-4c60-a95c-386e0a9dcc2a tempest-VolumesSnapshotTestJSON-1121770850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:45:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-df04234b-41b2-4c60-a95c-386e0a9dcc2a tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:45:49 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-df04234b-41b2-4c60-a95c-386e0a9dcc2a tempest-VolumesSnapshotTestJSON-1121770850 None] Creating offline snapshot 950b413e-80cf-47b9-87c5-a6b3bdfdd02c of volume c62bda3d-8446-4d7d-ad36-6e177d4407c5 {{(pid=86081) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:45:49 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11b46c2-fee4-42bc-8b35-2e7a9fa29201]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:45:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-df04234b-41b2-4c60-a95c-386e0a9dcc2a tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:49 devstack sudo[102370]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9af5be15-6b60-4c08-8200-529b759ce76a tempest-CinderUnicodeTest-785869527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9802eb18-09f9-462d-aff6-f66b09c4f01c.1336ccde-d20c-49cc-920b-1a680a5d11a2" returned: 0 in 0.310s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:49 devstack sudo[102372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5 Aug 28 09:45:49 devstack sudo[102372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:50 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-9af5be15-6b60-4c08-8200-529b759ce76a tempest-CinderUnicodeTest-785869527 None] Lock "cinder-quobyte-1336ccde-d20c-49cc-920b-1a680a5d11a2" released by "_delete_snapshot" :: held 1.576s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:45:50 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-9af5be15-6b60-4c08-8200-529b759ce76a tempest-CinderUnicodeTest-785869527 None] Lock "cinder-quobyte-9802eb18-09f9-462d-aff6-f66b09c4f01c" released by "delete_snapshot" :: held 1.611s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:45:50 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-9af5be15-6b60-4c08-8200-529b759ce76a tempest-CinderUnicodeTest-785869527 None] Created reservations ['a395f528-63d9-450b-9c1f-1a189831e5ea', '6d2365cb-1104-4965-87a3-6f9a92ecc201', '14264754-c39e-4f6e-b9fc-7c1d35677fb0', '838abffa-2a3b-44ba-8e7c-decf42f4f2a3'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:45:50 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-9af5be15-6b60-4c08-8200-529b759ce76a tempest-CinderUnicodeTest-785869527 None] Delete snapshot completed successfully. Aug 28 09:45:50 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-9af5be15-6b60-4c08-8200-529b759ce76a tempest-CinderUnicodeTest-785869527 None] Lock "cinder-1336ccde-d20c-49cc-920b-1a680a5d11a2-delete_snapshot" released by "delete_snapshot" :: held 1.767s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:45:50 devstack sudo[102372]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-df04234b-41b2-4c60-a95c-386e0a9dcc2a tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5" returned: 0 in 0.389s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-df04234b-41b2-4c60-a95c-386e0a9dcc2a tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5.950b413e-80cf-47b9-87c5-a6b3bdfdd02c 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:50 devstack sudo[102378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5.950b413e-80cf-47b9-87c5-a6b3bdfdd02c 1G Aug 28 09:45:50 devstack sudo[102378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:50 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-960f4e0e-24b3-4caa-97bc-62cf62395151 tempest-CinderUnicodeTest-785869527 None] Acquiring lock "cinder-9802eb18-09f9-462d-aff6-f66b09c4f01c-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:45:50 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-960f4e0e-24b3-4caa-97bc-62cf62395151 tempest-CinderUnicodeTest-785869527 None] Lock "cinder-9802eb18-09f9-462d-aff6-f66b09c4f01c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:45:50 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-960f4e0e-24b3-4caa-97bc-62cf62395151 tempest-CinderUnicodeTest-785869527 None] Acquiring lock "cinder-quobyte-9802eb18-09f9-462d-aff6-f66b09c4f01c" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:45:50 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-960f4e0e-24b3-4caa-97bc-62cf62395151 tempest-CinderUnicodeTest-785869527 None] Lock "cinder-quobyte-9802eb18-09f9-462d-aff6-f66b09c4f01c" acquired by "delete_volume" :: waited 0.014s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:45:50 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d74702-9441-4767-9985-65d55b899abd]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:45:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-960f4e0e-24b3-4caa-97bc-62cf62395151 tempest-CinderUnicodeTest-785869527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9802eb18-09f9-462d-aff6-f66b09c4f01c {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:50 devstack sudo[102378]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-df04234b-41b2-4c60-a95c-386e0a9dcc2a tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5.950b413e-80cf-47b9-87c5-a6b3bdfdd02c 1G" returned: 0 in 0.433s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-df04234b-41b2-4c60-a95c-386e0a9dcc2a tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5.950b413e-80cf-47b9-87c5-a6b3bdfdd02c {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:50 devstack sudo[102385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5.950b413e-80cf-47b9-87c5-a6b3bdfdd02c Aug 28 09:45:50 devstack sudo[102385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:50 devstack sudo[102384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9802eb18-09f9-462d-aff6-f66b09c4f01c Aug 28 09:45:50 devstack sudo[102384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:50 devstack sudo[102385]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-df04234b-41b2-4c60-a95c-386e0a9dcc2a tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5.950b413e-80cf-47b9-87c5-a6b3bdfdd02c" returned: 0 in 0.305s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:50 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-df04234b-41b2-4c60-a95c-386e0a9dcc2a tempest-VolumesSnapshotTestJSON-1121770850 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5.950b413e-80cf-47b9-87c5-a6b3bdfdd02c is being set with open permissions: ugo+rw Aug 28 09:45:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-df04234b-41b2-4c60-a95c-386e0a9dcc2a tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5.950b413e-80cf-47b9-87c5-a6b3bdfdd02c {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:51 devstack sudo[102397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5.950b413e-80cf-47b9-87c5-a6b3bdfdd02c Aug 28 09:45:51 devstack sudo[102397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:51 devstack sudo[102384]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-960f4e0e-24b3-4caa-97bc-62cf62395151 tempest-CinderUnicodeTest-785869527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9802eb18-09f9-462d-aff6-f66b09c4f01c" returned: 0 in 0.418s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-960f4e0e-24b3-4caa-97bc-62cf62395151 tempest-CinderUnicodeTest-785869527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9802eb18-09f9-462d-aff6-f66b09c4f01c {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:51 devstack sudo[102400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9802eb18-09f9-462d-aff6-f66b09c4f01c Aug 28 09:45:51 devstack sudo[102400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:51 devstack sudo[102397]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-df04234b-41b2-4c60-a95c-386e0a9dcc2a tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5.950b413e-80cf-47b9-87c5-a6b3bdfdd02c" returned: 0 in 0.270s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-df04234b-41b2-4c60-a95c-386e0a9dcc2a tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:51 devstack sudo[102400]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:51 devstack sudo[102404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5.info Aug 28 09:45:51 devstack sudo[102404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-960f4e0e-24b3-4caa-97bc-62cf62395151 tempest-CinderUnicodeTest-785869527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9802eb18-09f9-462d-aff6-f66b09c4f01c" returned: 0 in 0.259s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:51 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-960f4e0e-24b3-4caa-97bc-62cf62395151 tempest-CinderUnicodeTest-785869527 None] Lock "cinder-quobyte-9802eb18-09f9-462d-aff6-f66b09c4f01c" released by "delete_volume" :: held 0.746s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:45:51 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-960f4e0e-24b3-4caa-97bc-62cf62395151 tempest-CinderUnicodeTest-785869527 None] Created reservations ['5222d0ec-7235-42bf-9207-b4900b88c533', 'cbaeef3b-28a9-42eb-a29b-970c3f335218', '93a9d589-a81c-405d-8704-cda90eb991e0', '78f4d7a0-8dff-4775-8bd1-b14ef09b11bd'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:45:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-960f4e0e-24b3-4caa-97bc-62cf62395151 tempest-CinderUnicodeTest-785869527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:45:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-960f4e0e-24b3-4caa-97bc-62cf62395151 tempest-CinderUnicodeTest-785869527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:45:51 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-960f4e0e-24b3-4caa-97bc-62cf62395151 tempest-CinderUnicodeTest-785869527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:45:51 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-960f4e0e-24b3-4caa-97bc-62cf62395151 tempest-CinderUnicodeTest-785869527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:45:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-960f4e0e-24b3-4caa-97bc-62cf62395151 tempest-CinderUnicodeTest-785869527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:45:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-960f4e0e-24b3-4caa-97bc-62cf62395151 tempest-CinderUnicodeTest-785869527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:51 devstack sudo[102406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:45:51 devstack sudo[102406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:51 devstack sudo[102404]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-df04234b-41b2-4c60-a95c-386e0a9dcc2a tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5.info" returned: 0 in 0.270s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:51 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-df04234b-41b2-4c60-a95c-386e0a9dcc2a tempest-VolumesSnapshotTestJSON-1121770850 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5.info is being set with open permissions: ugo+rw Aug 28 09:45:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-df04234b-41b2-4c60-a95c-386e0a9dcc2a tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:51 devstack sudo[102409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5.info Aug 28 09:45:51 devstack sudo[102409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:51 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ca85c43a-27be-419f-9d84-b90e66673060 tempest-CinderUnicodeTest-785869527 None] Acquiring lock "cinder-f1b48f07-db95-487b-b56c-a6bdc8e516e8-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:45:51 devstack sudo[102406]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-960f4e0e-24b3-4caa-97bc-62cf62395151 tempest-CinderUnicodeTest-785869527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.262s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:51 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-960f4e0e-24b3-4caa-97bc-62cf62395151 tempest-CinderUnicodeTest-785869527 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:45:51 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-960f4e0e-24b3-4caa-97bc-62cf62395151 tempest-CinderUnicodeTest-785869527 None] Deleted volume successfully. Aug 28 09:45:51 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ca85c43a-27be-419f-9d84-b90e66673060 tempest-CinderUnicodeTest-785869527 None] Lock "cinder-f1b48f07-db95-487b-b56c-a6bdc8e516e8-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:45:51 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-960f4e0e-24b3-4caa-97bc-62cf62395151 tempest-CinderUnicodeTest-785869527 None] Lock "cinder-9802eb18-09f9-462d-aff6-f66b09c4f01c-delete_volume" released by "delete_volume" :: held 1.276s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:45:51 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ca85c43a-27be-419f-9d84-b90e66673060 tempest-CinderUnicodeTest-785869527 None] Acquiring lock "cinder-quobyte-f1b48f07-db95-487b-b56c-a6bdc8e516e8" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:45:51 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ca85c43a-27be-419f-9d84-b90e66673060 tempest-CinderUnicodeTest-785869527 None] Lock "cinder-quobyte-f1b48f07-db95-487b-b56c-a6bdc8e516e8" acquired by "delete_volume" :: waited 0.020s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:45:51 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e75451-a4a2-4a85-97d4-a5fb18e5b8a7]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:45:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ca85c43a-27be-419f-9d84-b90e66673060 tempest-CinderUnicodeTest-785869527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f1b48f07-db95-487b-b56c-a6bdc8e516e8 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:51 devstack sudo[102409]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-df04234b-41b2-4c60-a95c-386e0a9dcc2a tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5.info" returned: 0 in 0.376s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-df04234b-41b2-4c60-a95c-386e0a9dcc2a tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.163s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:45:52 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-df04234b-41b2-4c60-a95c-386e0a9dcc2a tempest-VolumesSnapshotTestJSON-1121770850 None] Create snapshot completed successfully Aug 28 09:45:52 devstack sudo[102413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f1b48f07-db95-487b-b56c-a6bdc8e516e8 Aug 28 09:45:52 devstack sudo[102413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:52 devstack sudo[102413]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ca85c43a-27be-419f-9d84-b90e66673060 tempest-CinderUnicodeTest-785869527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f1b48f07-db95-487b-b56c-a6bdc8e516e8" returned: 0 in 0.406s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ca85c43a-27be-419f-9d84-b90e66673060 tempest-CinderUnicodeTest-785869527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f1b48f07-db95-487b-b56c-a6bdc8e516e8 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:52 devstack sudo[102419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f1b48f07-db95-487b-b56c-a6bdc8e516e8 Aug 28 09:45:52 devstack sudo[102419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:52 devstack sudo[102419]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ca85c43a-27be-419f-9d84-b90e66673060 tempest-CinderUnicodeTest-785869527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f1b48f07-db95-487b-b56c-a6bdc8e516e8" returned: 0 in 0.277s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:52 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ca85c43a-27be-419f-9d84-b90e66673060 tempest-CinderUnicodeTest-785869527 None] Lock "cinder-quobyte-f1b48f07-db95-487b-b56c-a6bdc8e516e8" released by "delete_volume" :: held 0.754s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:45:52 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-ca85c43a-27be-419f-9d84-b90e66673060 tempest-CinderUnicodeTest-785869527 None] Created reservations ['0e7c23a5-d0f5-40a8-a88c-2a5e8dc6964a', 'f057fb10-8f10-4930-bc63-c4299448b7e6', '65366ffa-965d-4d2e-9f6f-ebb737be927a', 'd4fd0b83-2d10-442e-8b25-38fa7d70f66d'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:45:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ca85c43a-27be-419f-9d84-b90e66673060 tempest-CinderUnicodeTest-785869527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:45:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ca85c43a-27be-419f-9d84-b90e66673060 tempest-CinderUnicodeTest-785869527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:45:52 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ca85c43a-27be-419f-9d84-b90e66673060 tempest-CinderUnicodeTest-785869527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:45:52 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ca85c43a-27be-419f-9d84-b90e66673060 tempest-CinderUnicodeTest-785869527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:45:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ca85c43a-27be-419f-9d84-b90e66673060 tempest-CinderUnicodeTest-785869527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:45:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ca85c43a-27be-419f-9d84-b90e66673060 tempest-CinderUnicodeTest-785869527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:52 devstack sudo[102422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:45:52 devstack sudo[102422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:53 devstack sudo[102422]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ca85c43a-27be-419f-9d84-b90e66673060 tempest-CinderUnicodeTest-785869527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.300s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:53 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-ca85c43a-27be-419f-9d84-b90e66673060 tempest-CinderUnicodeTest-785869527 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:45:53 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-ca85c43a-27be-419f-9d84-b90e66673060 tempest-CinderUnicodeTest-785869527 None] Deleted volume successfully. Aug 28 09:45:53 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ca85c43a-27be-419f-9d84-b90e66673060 tempest-CinderUnicodeTest-785869527 None] Lock "cinder-f1b48f07-db95-487b-b56c-a6bdc8e516e8-delete_volume" released by "delete_volume" :: held 1.355s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:45:53 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-e450240a-8557-4131-a094-db9980b5e516 tempest-VolumesSnapshotTestJSON-1121770850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:45:53 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e450240a-8557-4131-a094-db9980b5e516 tempest-VolumesSnapshotTestJSON-1121770850 None] Flow 'volume_create_manager' (fd040d0d-5924-4201-959e-b06a54b3f33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:45:53 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e450240a-8557-4131-a094-db9980b5e516 tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7659abec-720a-4e21-bc89-51301b2c6e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:53 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e450240a-8557-4131-a094-db9980b5e516 tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7659abec-720a-4e21-bc89-51301b2c6e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:45:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-409354561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5af9966-4308-4b3d-bbae-da90a46638b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4f333bae244877b27a5526908ef20f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:45:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=950b413e-80cf-47b9-87c5-a6b3bdfdd02c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:45:54Z,use_quota=True,user_id='1bf321707b67460792c7aedc2503bedc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:53 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e450240a-8557-4131-a094-db9980b5e516 tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67bb1b6f-cd06-40db-befe-74d9e7f28bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:54 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e450240a-8557-4131-a094-db9980b5e516 tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67bb1b6f-cd06-40db-befe-74d9e7f28bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:54 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e450240a-8557-4131-a094-db9980b5e516 tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dfa9e60-733e-40f5-9d72-2a094f1b194d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:54 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e450240a-8557-4131-a094-db9980b5e516 tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dfa9e60-733e-40f5-9d72-2a094f1b194d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a5af9966-4308-4b3d-bbae-da90a46638b0', 'volume_name': 'volume-a5af9966-4308-4b3d-bbae-da90a46638b0', 'volume_size': 2, 'snapshot_id': '950b413e-80cf-47b9-87c5-a6b3bdfdd02c'}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:54 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e450240a-8557-4131-a094-db9980b5e516 tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (450fb7ab-d004-45e0-8e9d-e1f4a7a0d3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:54 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e450240a-8557-4131-a094-db9980b5e516 tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (450fb7ab-d004-45e0-8e9d-e1f4a7a0d3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:45:54 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e450240a-8557-4131-a094-db9980b5e516 tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8efacfe-0b15-4aac-a168-906c87305da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:45:54 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-e450240a-8557-4131-a094-db9980b5e516 tempest-VolumesSnapshotTestJSON-1121770850 None] Volume a5af9966-4308-4b3d-bbae-da90a46638b0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a5af9966-4308-4b3d-bbae-da90a46638b0', 'volume_size': 2, 'snapshot_id': '950b413e-80cf-47b9-87c5-a6b3bdfdd02c'} Aug 28 09:45:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e450240a-8557-4131-a094-db9980b5e516 tempest-VolumesSnapshotTestJSON-1121770850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:45:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e450240a-8557-4131-a094-db9980b5e516 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:45:54 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e450240a-8557-4131-a094-db9980b5e516 tempest-VolumesSnapshotTestJSON-1121770850 None] Acquiring lock "cinder-quobyte-950b413e-80cf-47b9-87c5-a6b3bdfdd02c-a5af9966-4308-4b3d-bbae-da90a46638b0" by "_create_volume_from_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:45:54 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e450240a-8557-4131-a094-db9980b5e516 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "cinder-quobyte-950b413e-80cf-47b9-87c5-a6b3bdfdd02c-a5af9966-4308-4b3d-bbae-da90a46638b0" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:45:54 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e450240a-8557-4131-a094-db9980b5e516 tempest-VolumesSnapshotTestJSON-1121770850 None] Creating volume a5af9966-4308-4b3d-bbae-da90a46638b0 from snapshot 950b413e-80cf-47b9-87c5-a6b3bdfdd02c {{(pid=86081) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 28 09:45:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e450240a-8557-4131-a094-db9980b5e516 tempest-VolumesSnapshotTestJSON-1121770850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:45:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e450240a-8557-4131-a094-db9980b5e516 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:45:54 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e450240a-8557-4131-a094-db9980b5e516 tempest-VolumesSnapshotTestJSON-1121770850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:45:54 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e450240a-8557-4131-a094-db9980b5e516 tempest-VolumesSnapshotTestJSON-1121770850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:45:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e450240a-8557-4131-a094-db9980b5e516 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:45:54 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e450240a-8557-4131-a094-db9980b5e516 tempest-VolumesSnapshotTestJSON-1121770850 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:45:54 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e450240a-8557-4131-a094-db9980b5e516 tempest-VolumesSnapshotTestJSON-1121770850 None] Acquiring lock "cinder-quobyte-a5af9966-4308-4b3d-bbae-da90a46638b0" by "_copy_volume_from_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:45:54 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e450240a-8557-4131-a094-db9980b5e516 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "cinder-quobyte-a5af9966-4308-4b3d-bbae-da90a46638b0" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:45:54 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e450240a-8557-4131-a094-db9980b5e516 tempest-VolumesSnapshotTestJSON-1121770850 None] snapshot: 950b413e-80cf-47b9-87c5-a6b3bdfdd02c, volume: a5af9966-4308-4b3d-bbae-da90a46638b0, {{(pid=86081) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 28 09:45:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e450240a-8557-4131-a094-db9980b5e516 tempest-VolumesSnapshotTestJSON-1121770850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:45:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e450240a-8557-4131-a094-db9980b5e516 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:45:54 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e450240a-8557-4131-a094-db9980b5e516 tempest-VolumesSnapshotTestJSON-1121770850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:45:54 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e450240a-8557-4131-a094-db9980b5e516 tempest-VolumesSnapshotTestJSON-1121770850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:45:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e450240a-8557-4131-a094-db9980b5e516 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:45:54 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[8015eaa1-3410-496e-be59-97df908761de]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:45:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e450240a-8557-4131-a094-db9980b5e516 tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5.950b413e-80cf-47b9-87c5-a6b3bdfdd02c {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:54 devstack cinder-volume[86081]: INFO cinder.volume.manager [req-764d21e3-2a0b-455b-b8c3-4071563b2e1c req-7ecf4560-45a2-4218-9a17-61648588d38f tempest-TestMinimumBasicScenario-1075905623 None] Terminate volume connection completed successfully. Aug 28 09:45:54 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-764d21e3-2a0b-455b-b8c3-4071563b2e1c req-7ecf4560-45a2-4218-9a17-61648588d38f tempest-TestMinimumBasicScenario-1075905623 None] Deleting attachment ddc934be-442b-4297-9676-2556b8473cc4. {{(pid=86081) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 09:45:54 devstack sudo[102430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5.950b413e-80cf-47b9-87c5-a6b3bdfdd02c Aug 28 09:45:54 devstack sudo[102430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:54 devstack sudo[102430]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e450240a-8557-4131-a094-db9980b5e516 tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5.950b413e-80cf-47b9-87c5-a6b3bdfdd02c" returned: 0 in 0.397s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:54 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-e450240a-8557-4131-a094-db9980b5e516 tempest-VolumesSnapshotTestJSON-1121770850 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:45:54 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[d448cad6-4d8d-4adf-9113-918cf41d497a]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:45:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e450240a-8557-4131-a094-db9980b5e516 tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:54 devstack sudo[102435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5 Aug 28 09:45:54 devstack sudo[102435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:55 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-80f4c42e-0f4d-4b7d-acb8-237d8b51b71e tempest-TestMinimumBasicScenario-1075905623 None] Acquiring lock "cinder-a6d16b0a-c1a7-4c0b-8649-c9cf2c8729bc-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:45:55 devstack sudo[102435]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e450240a-8557-4131-a094-db9980b5e516 tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5" returned: 0 in 0.396s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:55 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e450240a-8557-4131-a094-db9980b5e516 tempest-VolumesSnapshotTestJSON-1121770850 None] will copy from snapshot at /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5 {{(pid=86081) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 28 09:45:55 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e450240a-8557-4131-a094-db9980b5e516 tempest-VolumesSnapshotTestJSON-1121770850 None] Creating direct copy from snapshot {{(pid=86081) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 28 09:45:55 devstack cinder-volume[86081]: DEBUG cinder.utils [None req-e450240a-8557-4131-a094-db9980b5e516 tempest-VolumesSnapshotTestJSON-1121770850 None] Path /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a5af9966-4308-4b3d-bbae-da90a46638b0 not found in is_blk_device check {{(pid=86081) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 28 09:45:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e450240a-8557-4131-a094-db9980b5e516 tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a5af9966-4308-4b3d-bbae-da90a46638b0 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:55 devstack sudo[102440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a5af9966-4308-4b3d-bbae-da90a46638b0 Aug 28 09:45:55 devstack sudo[102440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:55 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-80f4c42e-0f4d-4b7d-acb8-237d8b51b71e tempest-TestMinimumBasicScenario-1075905623 None] Lock "cinder-a6d16b0a-c1a7-4c0b-8649-c9cf2c8729bc-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:45:55 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-80f4c42e-0f4d-4b7d-acb8-237d8b51b71e tempest-TestMinimumBasicScenario-1075905623 None] Acquiring lock "cinder-quobyte-a6d16b0a-c1a7-4c0b-8649-c9cf2c8729bc" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:45:55 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-80f4c42e-0f4d-4b7d-acb8-237d8b51b71e tempest-TestMinimumBasicScenario-1075905623 None] Lock "cinder-quobyte-a6d16b0a-c1a7-4c0b-8649-c9cf2c8729bc" acquired by "delete_volume" :: waited 0.017s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:45:55 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1dc705-d701-4689-86b8-52fdcf3bebf5]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:45:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-80f4c42e-0f4d-4b7d-acb8-237d8b51b71e tempest-TestMinimumBasicScenario-1075905623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a6d16b0a-c1a7-4c0b-8649-c9cf2c8729bc {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:55 devstack sudo[102442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a6d16b0a-c1a7-4c0b-8649-c9cf2c8729bc Aug 28 09:45:55 devstack sudo[102442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:55 devstack sudo[102442]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-80f4c42e-0f4d-4b7d-acb8-237d8b51b71e tempest-TestMinimumBasicScenario-1075905623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a6d16b0a-c1a7-4c0b-8649-c9cf2c8729bc" returned: 0 in 0.372s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-80f4c42e-0f4d-4b7d-acb8-237d8b51b71e tempest-TestMinimumBasicScenario-1075905623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a6d16b0a-c1a7-4c0b-8649-c9cf2c8729bc {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:55 devstack sudo[102453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a6d16b0a-c1a7-4c0b-8649-c9cf2c8729bc Aug 28 09:45:55 devstack sudo[102453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:56 devstack sudo[102453]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-80f4c42e-0f4d-4b7d-acb8-237d8b51b71e tempest-TestMinimumBasicScenario-1075905623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a6d16b0a-c1a7-4c0b-8649-c9cf2c8729bc" returned: 0 in 0.502s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:56 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-80f4c42e-0f4d-4b7d-acb8-237d8b51b71e tempest-TestMinimumBasicScenario-1075905623 None] Lock "cinder-quobyte-a6d16b0a-c1a7-4c0b-8649-c9cf2c8729bc" released by "delete_volume" :: held 0.938s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:45:56 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-80f4c42e-0f4d-4b7d-acb8-237d8b51b71e tempest-TestMinimumBasicScenario-1075905623 None] Created reservations ['f07fe73b-6e04-459b-84ef-12ed8daa041a', 'da4758be-3aca-4557-9e2f-6ae489f2e944', '2081da8a-e8e2-43dd-9b30-319195c400c6', '0018da41-b4e5-4d59-a2c3-247637c93ab8'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:45:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-80f4c42e-0f4d-4b7d-acb8-237d8b51b71e tempest-TestMinimumBasicScenario-1075905623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:45:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-80f4c42e-0f4d-4b7d-acb8-237d8b51b71e tempest-TestMinimumBasicScenario-1075905623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:45:56 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-80f4c42e-0f4d-4b7d-acb8-237d8b51b71e tempest-TestMinimumBasicScenario-1075905623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:45:56 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-80f4c42e-0f4d-4b7d-acb8-237d8b51b71e tempest-TestMinimumBasicScenario-1075905623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:45:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-80f4c42e-0f4d-4b7d-acb8-237d8b51b71e tempest-TestMinimumBasicScenario-1075905623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:45:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-80f4c42e-0f4d-4b7d-acb8-237d8b51b71e tempest-TestMinimumBasicScenario-1075905623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:45:56 devstack sudo[102460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:45:56 devstack sudo[102460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:45:56 devstack sudo[102460]: pam_unix(sudo:session): session closed for user root Aug 28 09:45:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-80f4c42e-0f4d-4b7d-acb8-237d8b51b71e tempest-TestMinimumBasicScenario-1075905623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.469s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:45:56 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-80f4c42e-0f4d-4b7d-acb8-237d8b51b71e tempest-TestMinimumBasicScenario-1075905623 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:45:56 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-80f4c42e-0f4d-4b7d-acb8-237d8b51b71e tempest-TestMinimumBasicScenario-1075905623 None] Deleted volume successfully. Aug 28 09:45:56 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-80f4c42e-0f4d-4b7d-acb8-237d8b51b71e tempest-TestMinimumBasicScenario-1075905623 None] Lock "cinder-a6d16b0a-c1a7-4c0b-8649-c9cf2c8729bc-delete_volume" released by "delete_volume" :: held 1.911s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:46:01 devstack sudo[102440]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e450240a-8557-4131-a094-db9980b5e516 tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a5af9966-4308-4b3d-bbae-da90a46638b0" returned: 0 in 6.209s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:01 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-e450240a-8557-4131-a094-db9980b5e516 tempest-VolumesSnapshotTestJSON-1121770850 None] Image conversion details: src /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5, size 1024.00 MB, duration 6.21 sec, destination /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a5af9966-4308-4b3d-bbae-da90a46638b0 {{(pid=86081) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 09:46:01 devstack cinder-volume[86081]: INFO cinder.image.image_utils [None req-e450240a-8557-4131-a094-db9980b5e516 tempest-VolumesSnapshotTestJSON-1121770850 None] Converted 1024.00 MB image at 164.89 MB/s Aug 28 09:46:01 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-e450240a-8557-4131-a094-db9980b5e516 tempest-VolumesSnapshotTestJSON-1121770850 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a5af9966-4308-4b3d-bbae-da90a46638b0 is being set with open permissions: ugo+rw Aug 28 09:46:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e450240a-8557-4131-a094-db9980b5e516 tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a5af9966-4308-4b3d-bbae-da90a46638b0 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:01 devstack sudo[102490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a5af9966-4308-4b3d-bbae-da90a46638b0 Aug 28 09:46:01 devstack sudo[102490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:01 devstack sudo[102490]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e450240a-8557-4131-a094-db9980b5e516 tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a5af9966-4308-4b3d-bbae-da90a46638b0" returned: 0 in 0.315s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:01 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e450240a-8557-4131-a094-db9980b5e516 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "cinder-quobyte-a5af9966-4308-4b3d-bbae-da90a46638b0" released by "_copy_volume_from_snapshot" :: held 7.472s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:46:01 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e450240a-8557-4131-a094-db9980b5e516 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "cinder-quobyte-950b413e-80cf-47b9-87c5-a6b3bdfdd02c-a5af9966-4308-4b3d-bbae-da90a46638b0" released by "_create_volume_from_snapshot" :: held 7.546s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:46:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e450240a-8557-4131-a094-db9980b5e516 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.566s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:46:01 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e450240a-8557-4131-a094-db9980b5e516 tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8efacfe-0b15-4aac-a168-906c87305da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5af9966-4308-4b3d-bbae-da90a46638b0', 'volume_size': 2, 'snapshot_id': '950b413e-80cf-47b9-87c5-a6b3bdfdd02c'}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:46:01 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e450240a-8557-4131-a094-db9980b5e516 tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0233304c-9ec4-4e3a-a42b-5d9bcca97c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:46:01 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-e450240a-8557-4131-a094-db9980b5e516 tempest-VolumesSnapshotTestJSON-1121770850 None] Volume volume-a5af9966-4308-4b3d-bbae-da90a46638b0 (a5af9966-4308-4b3d-bbae-da90a46638b0): created successfully Aug 28 09:46:01 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e450240a-8557-4131-a094-db9980b5e516 tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0233304c-9ec4-4e3a-a42b-5d9bcca97c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:46:01 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e450240a-8557-4131-a094-db9980b5e516 tempest-VolumesSnapshotTestJSON-1121770850 None] Flow 'volume_create_manager' (fd040d0d-5924-4201-959e-b06a54b3f33c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:46:01 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-e450240a-8557-4131-a094-db9980b5e516 tempest-VolumesSnapshotTestJSON-1121770850 None] Created volume successfully. Aug 28 09:46:02 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-b4f06c2e-085f-47da-a4df-9c6015d9bfce tempest-VolumesSnapshotTestJSON-1121770850 None] Acquiring lock "cinder-a5af9966-4308-4b3d-bbae-da90a46638b0-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:46:02 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-b4f06c2e-085f-47da-a4df-9c6015d9bfce tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "cinder-a5af9966-4308-4b3d-bbae-da90a46638b0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:46:02 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-b4f06c2e-085f-47da-a4df-9c6015d9bfce tempest-VolumesSnapshotTestJSON-1121770850 None] Acquiring lock "cinder-quobyte-a5af9966-4308-4b3d-bbae-da90a46638b0" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:46:02 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-b4f06c2e-085f-47da-a4df-9c6015d9bfce tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "cinder-quobyte-a5af9966-4308-4b3d-bbae-da90a46638b0" acquired by "delete_volume" :: waited 0.022s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:46:02 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2dc1c2d-d838-40b9-b665-2266bdf52648]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:46:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b4f06c2e-085f-47da-a4df-9c6015d9bfce tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a5af9966-4308-4b3d-bbae-da90a46638b0 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:02 devstack sudo[102493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a5af9966-4308-4b3d-bbae-da90a46638b0 Aug 28 09:46:02 devstack sudo[102493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:03 devstack sudo[102493]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b4f06c2e-085f-47da-a4df-9c6015d9bfce tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a5af9966-4308-4b3d-bbae-da90a46638b0" returned: 0 in 0.447s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b4f06c2e-085f-47da-a4df-9c6015d9bfce tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a5af9966-4308-4b3d-bbae-da90a46638b0 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:03 devstack sudo[102498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a5af9966-4308-4b3d-bbae-da90a46638b0 Aug 28 09:46:03 devstack sudo[102498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:03 devstack sudo[102498]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b4f06c2e-085f-47da-a4df-9c6015d9bfce tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a5af9966-4308-4b3d-bbae-da90a46638b0" returned: 0 in 0.267s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:03 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-b4f06c2e-085f-47da-a4df-9c6015d9bfce tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "cinder-quobyte-a5af9966-4308-4b3d-bbae-da90a46638b0" released by "delete_volume" :: held 0.768s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:46:03 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-b4f06c2e-085f-47da-a4df-9c6015d9bfce tempest-VolumesSnapshotTestJSON-1121770850 None] Created reservations ['9f01e07a-c5ba-47bb-ba0d-ce7533819d54', 'd42ed23d-f818-4fce-a09b-b291f3f4a9f7', 'b9a539ed-d43e-4e65-a448-ac805c741230', '7656d5b8-29fe-4307-98ec-fccbe116f843'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:46:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b4f06c2e-085f-47da-a4df-9c6015d9bfce tempest-VolumesSnapshotTestJSON-1121770850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:46:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b4f06c2e-085f-47da-a4df-9c6015d9bfce tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:46:03 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-b4f06c2e-085f-47da-a4df-9c6015d9bfce tempest-VolumesSnapshotTestJSON-1121770850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:46:03 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-b4f06c2e-085f-47da-a4df-9c6015d9bfce tempest-VolumesSnapshotTestJSON-1121770850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:46:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b4f06c2e-085f-47da-a4df-9c6015d9bfce tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:46:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b4f06c2e-085f-47da-a4df-9c6015d9bfce tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:03 devstack sudo[102501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:46:03 devstack sudo[102501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:03 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-21e9821c-4855-42e3-a47a-b5dc9facd512 tempest-VolumesSnapshotTestJSON-1121770850 None] Acquiring lock "cinder-950b413e-80cf-47b9-87c5-a6b3bdfdd02c-delete_snapshot" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:46:04 devstack sudo[102501]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b4f06c2e-085f-47da-a4df-9c6015d9bfce tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.368s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:04 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-b4f06c2e-085f-47da-a4df-9c6015d9bfce tempest-VolumesSnapshotTestJSON-1121770850 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:46:04 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-21e9821c-4855-42e3-a47a-b5dc9facd512 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "cinder-950b413e-80cf-47b9-87c5-a6b3bdfdd02c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:46:04 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-21e9821c-4855-42e3-a47a-b5dc9facd512 tempest-VolumesSnapshotTestJSON-1121770850 None] Acquiring lock "cinder-quobyte-c62bda3d-8446-4d7d-ad36-6e177d4407c5" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:46:04 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-b4f06c2e-085f-47da-a4df-9c6015d9bfce tempest-VolumesSnapshotTestJSON-1121770850 None] Deleted volume successfully. Aug 28 09:46:04 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-21e9821c-4855-42e3-a47a-b5dc9facd512 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "cinder-quobyte-c62bda3d-8446-4d7d-ad36-6e177d4407c5" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:46:04 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-21e9821c-4855-42e3-a47a-b5dc9facd512 tempest-VolumesSnapshotTestJSON-1121770850 None] Acquiring lock "cinder-quobyte-950b413e-80cf-47b9-87c5-a6b3bdfdd02c" by "_delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:46:04 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-b4f06c2e-085f-47da-a4df-9c6015d9bfce tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "cinder-a5af9966-4308-4b3d-bbae-da90a46638b0-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:46:04 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-21e9821c-4855-42e3-a47a-b5dc9facd512 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "cinder-quobyte-950b413e-80cf-47b9-87c5-a6b3bdfdd02c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:46:04 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-21e9821c-4855-42e3-a47a-b5dc9facd512 tempest-VolumesSnapshotTestJSON-1121770850 None] Deleting offline snapshot 950b413e-80cf-47b9-87c5-a6b3bdfdd02c of volume c62bda3d-8446-4d7d-ad36-6e177d4407c5 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:46:04 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-21e9821c-4855-42e3-a47a-b5dc9facd512 tempest-VolumesSnapshotTestJSON-1121770850 None] snapshot_file for this snap is: volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5.950b413e-80cf-47b9-87c5-a6b3bdfdd02c {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:46:04 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb64094c-0879-43e6-8162-63c86ad0888f]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:46:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-21e9821c-4855-42e3-a47a-b5dc9facd512 tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5.950b413e-80cf-47b9-87c5-a6b3bdfdd02c {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:04 devstack sudo[102505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5.950b413e-80cf-47b9-87c5-a6b3bdfdd02c Aug 28 09:46:04 devstack sudo[102505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:04 devstack sudo[102505]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-21e9821c-4855-42e3-a47a-b5dc9facd512 tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5.950b413e-80cf-47b9-87c5-a6b3bdfdd02c" returned: 0 in 0.392s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:04 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-21e9821c-4855-42e3-a47a-b5dc9facd512 tempest-VolumesSnapshotTestJSON-1121770850 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:46:04 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6024769-e7f4-4672-b1a1-8fdc78c976a0]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:46:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-21e9821c-4855-42e3-a47a-b5dc9facd512 tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:04 devstack sudo[102516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5 Aug 28 09:46:04 devstack sudo[102516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:05 devstack sudo[102516]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-21e9821c-4855-42e3-a47a-b5dc9facd512 tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5" returned: 0 in 0.606s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-21e9821c-4855-42e3-a47a-b5dc9facd512 tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5.950b413e-80cf-47b9-87c5-a6b3bdfdd02c {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:05 devstack sudo[102521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5.950b413e-80cf-47b9-87c5-a6b3bdfdd02c Aug 28 09:46:05 devstack sudo[102521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:05 devstack sudo[102521]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-21e9821c-4855-42e3-a47a-b5dc9facd512 tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5.950b413e-80cf-47b9-87c5-a6b3bdfdd02c" returned: 0 in 0.373s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-21e9821c-4855-42e3-a47a-b5dc9facd512 tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5.950b413e-80cf-47b9-87c5-a6b3bdfdd02c {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:05 devstack sudo[102526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5.950b413e-80cf-47b9-87c5-a6b3bdfdd02c Aug 28 09:46:05 devstack sudo[102526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:05 devstack sudo[102526]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-21e9821c-4855-42e3-a47a-b5dc9facd512 tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5.950b413e-80cf-47b9-87c5-a6b3bdfdd02c" returned: 0 in 0.285s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:05 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-21e9821c-4855-42e3-a47a-b5dc9facd512 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "cinder-quobyte-950b413e-80cf-47b9-87c5-a6b3bdfdd02c" released by "_delete_snapshot" :: held 1.801s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:46:05 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-21e9821c-4855-42e3-a47a-b5dc9facd512 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "cinder-quobyte-c62bda3d-8446-4d7d-ad36-6e177d4407c5" released by "delete_snapshot" :: held 1.836s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:46:05 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-21e9821c-4855-42e3-a47a-b5dc9facd512 tempest-VolumesSnapshotTestJSON-1121770850 None] Created reservations ['88cbb242-156f-4442-b3f7-166d8cb4de8f', '6b789f9d-90c5-44cc-8a71-8a5c15b99969', 'b7b613da-7dc2-4943-9445-ba6c50122f9a', '2179dbd7-d454-4c97-b52d-a2154096b1c9'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:46:06 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-21e9821c-4855-42e3-a47a-b5dc9facd512 tempest-VolumesSnapshotTestJSON-1121770850 None] Delete snapshot completed successfully. Aug 28 09:46:06 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-21e9821c-4855-42e3-a47a-b5dc9facd512 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "cinder-950b413e-80cf-47b9-87c5-a6b3bdfdd02c-delete_snapshot" released by "delete_snapshot" :: held 2.047s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:46:06 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a38e3a1f-5adc-4c3c-82f1-ff7b72a9b249 tempest-VolumesSnapshotTestJSON-1121770850 None] Acquiring lock "cinder-c62bda3d-8446-4d7d-ad36-6e177d4407c5-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:46:06 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a38e3a1f-5adc-4c3c-82f1-ff7b72a9b249 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "cinder-c62bda3d-8446-4d7d-ad36-6e177d4407c5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:46:06 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a38e3a1f-5adc-4c3c-82f1-ff7b72a9b249 tempest-VolumesSnapshotTestJSON-1121770850 None] Acquiring lock "cinder-quobyte-c62bda3d-8446-4d7d-ad36-6e177d4407c5" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:46:06 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a38e3a1f-5adc-4c3c-82f1-ff7b72a9b249 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "cinder-quobyte-c62bda3d-8446-4d7d-ad36-6e177d4407c5" acquired by "delete_volume" :: waited 0.019s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:46:06 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd5ce47-b9b3-49a4-a462-61b853289d0c]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:46:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a38e3a1f-5adc-4c3c-82f1-ff7b72a9b249 tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:06 devstack sudo[102529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5 Aug 28 09:46:06 devstack sudo[102529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:06 devstack sudo[102529]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a38e3a1f-5adc-4c3c-82f1-ff7b72a9b249 tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5" returned: 0 in 0.406s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a38e3a1f-5adc-4c3c-82f1-ff7b72a9b249 tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:06 devstack sudo[102534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5 Aug 28 09:46:06 devstack sudo[102534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:07 devstack sudo[102534]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a38e3a1f-5adc-4c3c-82f1-ff7b72a9b249 tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c62bda3d-8446-4d7d-ad36-6e177d4407c5" returned: 0 in 0.306s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:07 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a38e3a1f-5adc-4c3c-82f1-ff7b72a9b249 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "cinder-quobyte-c62bda3d-8446-4d7d-ad36-6e177d4407c5" released by "delete_volume" :: held 0.784s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:46:07 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-a38e3a1f-5adc-4c3c-82f1-ff7b72a9b249 tempest-VolumesSnapshotTestJSON-1121770850 None] Created reservations ['08bf06d3-1f29-47f7-9fbe-a3ea8f3d82c2', 'd868fa8c-9d2e-4538-8776-1c789305053a', 'c958c43c-6dc0-4c05-9be3-1b5577f27ad1', 'cd7f1ac8-7f77-42b5-85a9-211f284b6597'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:46:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a38e3a1f-5adc-4c3c-82f1-ff7b72a9b249 tempest-VolumesSnapshotTestJSON-1121770850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:46:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a38e3a1f-5adc-4c3c-82f1-ff7b72a9b249 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:46:07 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-a38e3a1f-5adc-4c3c-82f1-ff7b72a9b249 tempest-VolumesSnapshotTestJSON-1121770850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:46:07 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-a38e3a1f-5adc-4c3c-82f1-ff7b72a9b249 tempest-VolumesSnapshotTestJSON-1121770850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:46:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a38e3a1f-5adc-4c3c-82f1-ff7b72a9b249 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:46:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a38e3a1f-5adc-4c3c-82f1-ff7b72a9b249 tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:07 devstack sudo[102538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:46:07 devstack sudo[102538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:07 devstack sudo[102538]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a38e3a1f-5adc-4c3c-82f1-ff7b72a9b249 tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.279s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:07 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-a38e3a1f-5adc-4c3c-82f1-ff7b72a9b249 tempest-VolumesSnapshotTestJSON-1121770850 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:46:07 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-a38e3a1f-5adc-4c3c-82f1-ff7b72a9b249 tempest-VolumesSnapshotTestJSON-1121770850 None] Deleted volume successfully. Aug 28 09:46:07 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a38e3a1f-5adc-4c3c-82f1-ff7b72a9b249 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "cinder-c62bda3d-8446-4d7d-ad36-6e177d4407c5-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:46:08 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d762679-5da8-40c3-a2d5-37fb26b3355e tempest-VolumesSnapshotTestJSON-1121770850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:46:08 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0d762679-5da8-40c3-a2d5-37fb26b3355e tempest-VolumesSnapshotTestJSON-1121770850 None] Flow 'volume_create_manager' (f9bb8e1d-473d-4768-86a9-0e1d733fc5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:46:08 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0d762679-5da8-40c3-a2d5-37fb26b3355e tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57f9ba09-836c-4caf-a4ef-684d52cbf7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:46:08 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0d762679-5da8-40c3-a2d5-37fb26b3355e tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57f9ba09-836c-4caf-a4ef-684d52cbf7d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1540247946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fda31b9-b482-47ee-b77c-79be2a064ed0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4f333bae244877b27a5526908ef20f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:46:08Z,use_quota=True,user_id='1bf321707b67460792c7aedc2503bedc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:46:08 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0d762679-5da8-40c3-a2d5-37fb26b3355e tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92de7e11-0e9c-4c31-9069-a126cc271660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:46:08 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0d762679-5da8-40c3-a2d5-37fb26b3355e tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92de7e11-0e9c-4c31-9069-a126cc271660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:46:08 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0d762679-5da8-40c3-a2d5-37fb26b3355e tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fbdc34b-01f2-42c9-8090-24211b7a565d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:46:08 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0d762679-5da8-40c3-a2d5-37fb26b3355e tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fbdc34b-01f2-42c9-8090-24211b7a565d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fda31b9-b482-47ee-b77c-79be2a064ed0', 'volume_name': 'volume-9fda31b9-b482-47ee-b77c-79be2a064ed0', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:46:08 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0d762679-5da8-40c3-a2d5-37fb26b3355e tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26fdb7f2-a890-4d92-be26-4ed75a5296da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:46:08 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0d762679-5da8-40c3-a2d5-37fb26b3355e tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26fdb7f2-a890-4d92-be26-4ed75a5296da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:46:08 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0d762679-5da8-40c3-a2d5-37fb26b3355e tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85baba2e-6092-4434-8fdd-d0828f7bb5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:46:08 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-0d762679-5da8-40c3-a2d5-37fb26b3355e tempest-VolumesSnapshotTestJSON-1121770850 None] Volume 9fda31b9-b482-47ee-b77c-79be2a064ed0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fda31b9-b482-47ee-b77c-79be2a064ed0', 'volume_size': 1} Aug 28 09:46:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0d762679-5da8-40c3-a2d5-37fb26b3355e tempest-VolumesSnapshotTestJSON-1121770850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:46:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0d762679-5da8-40c3-a2d5-37fb26b3355e tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:46:08 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0d762679-5da8-40c3-a2d5-37fb26b3355e tempest-VolumesSnapshotTestJSON-1121770850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1540247946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fda31b9-b482-47ee-b77c-79be2a064ed0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4f333bae244877b27a5526908ef20f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:46:08Z,use_quota=True,user_id='1bf321707b67460792c7aedc2503bedc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:46:08 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-0d762679-5da8-40c3-a2d5-37fb26b3355e tempest-VolumesSnapshotTestJSON-1121770850 None] Creating volume 9fda31b9-b482-47ee-b77c-79be2a064ed0 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:46:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0d762679-5da8-40c3-a2d5-37fb26b3355e tempest-VolumesSnapshotTestJSON-1121770850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:46:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0d762679-5da8-40c3-a2d5-37fb26b3355e tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:46:08 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0d762679-5da8-40c3-a2d5-37fb26b3355e tempest-VolumesSnapshotTestJSON-1121770850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:46:08 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0d762679-5da8-40c3-a2d5-37fb26b3355e tempest-VolumesSnapshotTestJSON-1121770850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:46:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0d762679-5da8-40c3-a2d5-37fb26b3355e tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:46:08 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0d762679-5da8-40c3-a2d5-37fb26b3355e tempest-VolumesSnapshotTestJSON-1121770850 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:46:08 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-0d762679-5da8-40c3-a2d5-37fb26b3355e tempest-VolumesSnapshotTestJSON-1121770850 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:46:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0d762679-5da8-40c3-a2d5-37fb26b3355e tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:08 devstack sudo[102541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0 1073741824 Aug 28 09:46:08 devstack sudo[102541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:08 devstack sudo[102541]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0d762679-5da8-40c3-a2d5-37fb26b3355e tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0 1073741824" returned: 0 in 0.484s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0d762679-5da8-40c3-a2d5-37fb26b3355e tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:08 devstack sudo[102548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0 Aug 28 09:46:08 devstack sudo[102548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:09 devstack sudo[102548]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0d762679-5da8-40c3-a2d5-37fb26b3355e tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0" returned: 0 in 0.267s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:09 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0d762679-5da8-40c3-a2d5-37fb26b3355e tempest-VolumesSnapshotTestJSON-1121770850 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:46:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0d762679-5da8-40c3-a2d5-37fb26b3355e tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:46:09 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0d762679-5da8-40c3-a2d5-37fb26b3355e tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85baba2e-6092-4434-8fdd-d0828f7bb5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fda31b9-b482-47ee-b77c-79be2a064ed0', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:46:09 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0d762679-5da8-40c3-a2d5-37fb26b3355e tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (842189a1-dc54-48b1-a350-09ba89deb6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:46:09 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-0d762679-5da8-40c3-a2d5-37fb26b3355e tempest-VolumesSnapshotTestJSON-1121770850 None] Volume volume-9fda31b9-b482-47ee-b77c-79be2a064ed0 (9fda31b9-b482-47ee-b77c-79be2a064ed0): created successfully Aug 28 09:46:09 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0d762679-5da8-40c3-a2d5-37fb26b3355e tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (842189a1-dc54-48b1-a350-09ba89deb6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:46:09 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0d762679-5da8-40c3-a2d5-37fb26b3355e tempest-VolumesSnapshotTestJSON-1121770850 None] Flow 'volume_create_manager' (f9bb8e1d-473d-4768-86a9-0e1d733fc5c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:46:09 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-0d762679-5da8-40c3-a2d5-37fb26b3355e tempest-VolumesSnapshotTestJSON-1121770850 None] Created volume successfully. Aug 28 09:46:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-3347e927-e3db-44c7-b809-f95f28144904 tempest-VolumesSnapshotTestJSON-1121770850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:46:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-3347e927-e3db-44c7-b809-f95f28144904 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:46:10 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-3347e927-e3db-44c7-b809-f95f28144904 tempest-VolumesSnapshotTestJSON-1121770850 None] Creating offline snapshot 227974c4-2ff0-4f76-b02a-03b7a9ab9089 of volume 9fda31b9-b482-47ee-b77c-79be2a064ed0 {{(pid=86081) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:46:10 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[53999f2c-483f-47ae-9145-8aa6878c891e]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:46:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3347e927-e3db-44c7-b809-f95f28144904 tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:10 devstack sudo[102552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0 Aug 28 09:46:10 devstack sudo[102552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:10 devstack sudo[102552]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3347e927-e3db-44c7-b809-f95f28144904 tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0" returned: 0 in 0.374s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3347e927-e3db-44c7-b809-f95f28144904 tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0.227974c4-2ff0-4f76-b02a-03b7a9ab9089 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:10 devstack sudo[102557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0.227974c4-2ff0-4f76-b02a-03b7a9ab9089 1G Aug 28 09:46:10 devstack sudo[102557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:11 devstack sudo[102557]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3347e927-e3db-44c7-b809-f95f28144904 tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0.227974c4-2ff0-4f76-b02a-03b7a9ab9089 1G" returned: 0 in 0.563s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3347e927-e3db-44c7-b809-f95f28144904 tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fda31b9-b482-47ee-b77c-79be2a064ed0 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0.227974c4-2ff0-4f76-b02a-03b7a9ab9089 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:11 devstack sudo[102562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fda31b9-b482-47ee-b77c-79be2a064ed0 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0.227974c4-2ff0-4f76-b02a-03b7a9ab9089 Aug 28 09:46:11 devstack sudo[102562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:11 devstack sudo[102562]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3347e927-e3db-44c7-b809-f95f28144904 tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fda31b9-b482-47ee-b77c-79be2a064ed0 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0.227974c4-2ff0-4f76-b02a-03b7a9ab9089" returned: 0 in 0.348s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:11 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-3347e927-e3db-44c7-b809-f95f28144904 tempest-VolumesSnapshotTestJSON-1121770850 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0.227974c4-2ff0-4f76-b02a-03b7a9ab9089 is being set with open permissions: ugo+rw Aug 28 09:46:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3347e927-e3db-44c7-b809-f95f28144904 tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0.227974c4-2ff0-4f76-b02a-03b7a9ab9089 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:11 devstack sudo[102568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0.227974c4-2ff0-4f76-b02a-03b7a9ab9089 Aug 28 09:46:11 devstack sudo[102568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:11 devstack sudo[102568]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3347e927-e3db-44c7-b809-f95f28144904 tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0.227974c4-2ff0-4f76-b02a-03b7a9ab9089" returned: 0 in 0.289s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3347e927-e3db-44c7-b809-f95f28144904 tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:12 devstack sudo[102571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0.info Aug 28 09:46:12 devstack sudo[102571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:12 devstack sudo[102571]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3347e927-e3db-44c7-b809-f95f28144904 tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0.info" returned: 0 in 0.316s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:12 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-3347e927-e3db-44c7-b809-f95f28144904 tempest-VolumesSnapshotTestJSON-1121770850 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0.info is being set with open permissions: ugo+rw Aug 28 09:46:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3347e927-e3db-44c7-b809-f95f28144904 tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:12 devstack sudo[102575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0.info Aug 28 09:46:12 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:12 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3347e927-e3db-44c7-b809-f95f28144904 tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0.info" returned: 0 in 0.311s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-3347e927-e3db-44c7-b809-f95f28144904 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.316s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:46:12 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-3347e927-e3db-44c7-b809-f95f28144904 tempest-VolumesSnapshotTestJSON-1121770850 None] Create snapshot completed successfully Aug 28 09:46:14 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-62beb442-e8e8-4a45-92b7-b66d69115955 tempest-VolumesSnapshotTestJSON-1121770850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:46:14 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-62beb442-e8e8-4a45-92b7-b66d69115955 tempest-VolumesSnapshotTestJSON-1121770850 None] Flow 'volume_create_manager' (835e8a5c-c18d-4e10-9c48-4840c2c3186c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:46:14 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-62beb442-e8e8-4a45-92b7-b66d69115955 tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc8eb8ce-41f6-42a6-bf37-7fc3d0ab4ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:46:14 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-62beb442-e8e8-4a45-92b7-b66d69115955 tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc8eb8ce-41f6-42a6-bf37-7fc3d0ab4ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:46:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-161956125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97aac478-21ee-426c-93a4-ff672d26b80e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4f333bae244877b27a5526908ef20f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:46:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=227974c4-2ff0-4f76-b02a-03b7a9ab9089,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:46:14Z,use_quota=True,user_id='1bf321707b67460792c7aedc2503bedc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:46:14 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-62beb442-e8e8-4a45-92b7-b66d69115955 tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (300b9ae3-d236-4890-8d46-8199a067c035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:46:14 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-62beb442-e8e8-4a45-92b7-b66d69115955 tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (300b9ae3-d236-4890-8d46-8199a067c035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:46:14 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-62beb442-e8e8-4a45-92b7-b66d69115955 tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8966d68-13b1-42aa-9446-85c50e170b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:46:14 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-62beb442-e8e8-4a45-92b7-b66d69115955 tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8966d68-13b1-42aa-9446-85c50e170b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '97aac478-21ee-426c-93a4-ff672d26b80e', 'volume_name': 'volume-97aac478-21ee-426c-93a4-ff672d26b80e', 'volume_size': 1, 'snapshot_id': '227974c4-2ff0-4f76-b02a-03b7a9ab9089'}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:46:14 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-62beb442-e8e8-4a45-92b7-b66d69115955 tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd31d506-6a48-49cb-8daa-449638f79d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:46:14 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-62beb442-e8e8-4a45-92b7-b66d69115955 tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd31d506-6a48-49cb-8daa-449638f79d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:46:14 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-62beb442-e8e8-4a45-92b7-b66d69115955 tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41b5b30a-1a66-45ec-83e8-efd51a00f6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:46:14 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-62beb442-e8e8-4a45-92b7-b66d69115955 tempest-VolumesSnapshotTestJSON-1121770850 None] Volume 97aac478-21ee-426c-93a4-ff672d26b80e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-97aac478-21ee-426c-93a4-ff672d26b80e', 'volume_size': 1, 'snapshot_id': '227974c4-2ff0-4f76-b02a-03b7a9ab9089'} Aug 28 09:46:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-62beb442-e8e8-4a45-92b7-b66d69115955 tempest-VolumesSnapshotTestJSON-1121770850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:46:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-62beb442-e8e8-4a45-92b7-b66d69115955 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:46:14 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-62beb442-e8e8-4a45-92b7-b66d69115955 tempest-VolumesSnapshotTestJSON-1121770850 None] Acquiring lock "cinder-quobyte-227974c4-2ff0-4f76-b02a-03b7a9ab9089-97aac478-21ee-426c-93a4-ff672d26b80e" by "_create_volume_from_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:46:14 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-62beb442-e8e8-4a45-92b7-b66d69115955 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "cinder-quobyte-227974c4-2ff0-4f76-b02a-03b7a9ab9089-97aac478-21ee-426c-93a4-ff672d26b80e" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:46:14 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-62beb442-e8e8-4a45-92b7-b66d69115955 tempest-VolumesSnapshotTestJSON-1121770850 None] Creating volume 97aac478-21ee-426c-93a4-ff672d26b80e from snapshot 227974c4-2ff0-4f76-b02a-03b7a9ab9089 {{(pid=86081) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 28 09:46:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-62beb442-e8e8-4a45-92b7-b66d69115955 tempest-VolumesSnapshotTestJSON-1121770850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:46:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-62beb442-e8e8-4a45-92b7-b66d69115955 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:46:14 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-62beb442-e8e8-4a45-92b7-b66d69115955 tempest-VolumesSnapshotTestJSON-1121770850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:46:14 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-62beb442-e8e8-4a45-92b7-b66d69115955 tempest-VolumesSnapshotTestJSON-1121770850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:46:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-62beb442-e8e8-4a45-92b7-b66d69115955 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:46:14 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-62beb442-e8e8-4a45-92b7-b66d69115955 tempest-VolumesSnapshotTestJSON-1121770850 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:46:14 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-62beb442-e8e8-4a45-92b7-b66d69115955 tempest-VolumesSnapshotTestJSON-1121770850 None] Acquiring lock "cinder-quobyte-97aac478-21ee-426c-93a4-ff672d26b80e" by "_copy_volume_from_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:46:14 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-62beb442-e8e8-4a45-92b7-b66d69115955 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "cinder-quobyte-97aac478-21ee-426c-93a4-ff672d26b80e" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:46:14 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-62beb442-e8e8-4a45-92b7-b66d69115955 tempest-VolumesSnapshotTestJSON-1121770850 None] snapshot: 227974c4-2ff0-4f76-b02a-03b7a9ab9089, volume: 97aac478-21ee-426c-93a4-ff672d26b80e, {{(pid=86081) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 28 09:46:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-62beb442-e8e8-4a45-92b7-b66d69115955 tempest-VolumesSnapshotTestJSON-1121770850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:46:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-62beb442-e8e8-4a45-92b7-b66d69115955 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:46:14 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-62beb442-e8e8-4a45-92b7-b66d69115955 tempest-VolumesSnapshotTestJSON-1121770850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:46:14 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-62beb442-e8e8-4a45-92b7-b66d69115955 tempest-VolumesSnapshotTestJSON-1121770850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:46:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-62beb442-e8e8-4a45-92b7-b66d69115955 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:46:14 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a84de5-356a-4bc0-a9fc-4f741e9b6912]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:46:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-62beb442-e8e8-4a45-92b7-b66d69115955 tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0.227974c4-2ff0-4f76-b02a-03b7a9ab9089 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:14 devstack sudo[102614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0.227974c4-2ff0-4f76-b02a-03b7a9ab9089 Aug 28 09:46:14 devstack sudo[102614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:14 devstack sudo[102614]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-62beb442-e8e8-4a45-92b7-b66d69115955 tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0.227974c4-2ff0-4f76-b02a-03b7a9ab9089" returned: 0 in 0.438s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:14 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-62beb442-e8e8-4a45-92b7-b66d69115955 tempest-VolumesSnapshotTestJSON-1121770850 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9fda31b9-b482-47ee-b77c-79be2a064ed0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:46:15 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d87d435-128a-4dcb-9ffc-a6253c0ce266]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:46:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-62beb442-e8e8-4a45-92b7-b66d69115955 tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:15 devstack sudo[102619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0 Aug 28 09:46:15 devstack sudo[102619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:15 devstack sudo[102619]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-62beb442-e8e8-4a45-92b7-b66d69115955 tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0" returned: 0 in 0.385s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:15 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-62beb442-e8e8-4a45-92b7-b66d69115955 tempest-VolumesSnapshotTestJSON-1121770850 None] will copy from snapshot at /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0 {{(pid=86081) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 28 09:46:15 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-62beb442-e8e8-4a45-92b7-b66d69115955 tempest-VolumesSnapshotTestJSON-1121770850 None] Creating direct copy from snapshot {{(pid=86081) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 28 09:46:15 devstack cinder-volume[86081]: DEBUG cinder.utils [None req-62beb442-e8e8-4a45-92b7-b66d69115955 tempest-VolumesSnapshotTestJSON-1121770850 None] Path /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97aac478-21ee-426c-93a4-ff672d26b80e not found in is_blk_device check {{(pid=86081) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 28 09:46:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-62beb442-e8e8-4a45-92b7-b66d69115955 tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97aac478-21ee-426c-93a4-ff672d26b80e {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:15 devstack sudo[102624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97aac478-21ee-426c-93a4-ff672d26b80e Aug 28 09:46:15 devstack sudo[102624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:21 devstack sudo[102624]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-62beb442-e8e8-4a45-92b7-b66d69115955 tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97aac478-21ee-426c-93a4-ff672d26b80e" returned: 0 in 5.996s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:21 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-62beb442-e8e8-4a45-92b7-b66d69115955 tempest-VolumesSnapshotTestJSON-1121770850 None] Image conversion details: src /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0, size 1024.00 MB, duration 6.00 sec, destination /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97aac478-21ee-426c-93a4-ff672d26b80e {{(pid=86081) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 09:46:21 devstack cinder-volume[86081]: INFO cinder.image.image_utils [None req-62beb442-e8e8-4a45-92b7-b66d69115955 tempest-VolumesSnapshotTestJSON-1121770850 None] Converted 1024.00 MB image at 170.73 MB/s Aug 28 09:46:21 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-62beb442-e8e8-4a45-92b7-b66d69115955 tempest-VolumesSnapshotTestJSON-1121770850 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97aac478-21ee-426c-93a4-ff672d26b80e is being set with open permissions: ugo+rw Aug 28 09:46:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-62beb442-e8e8-4a45-92b7-b66d69115955 tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97aac478-21ee-426c-93a4-ff672d26b80e {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:21 devstack sudo[102641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97aac478-21ee-426c-93a4-ff672d26b80e Aug 28 09:46:21 devstack sudo[102641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:21 devstack sudo[102641]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-62beb442-e8e8-4a45-92b7-b66d69115955 tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97aac478-21ee-426c-93a4-ff672d26b80e" returned: 0 in 0.291s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:21 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-62beb442-e8e8-4a45-92b7-b66d69115955 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "cinder-quobyte-97aac478-21ee-426c-93a4-ff672d26b80e" released by "_copy_volume_from_snapshot" :: held 7.216s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:46:21 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-62beb442-e8e8-4a45-92b7-b66d69115955 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "cinder-quobyte-227974c4-2ff0-4f76-b02a-03b7a9ab9089-97aac478-21ee-426c-93a4-ff672d26b80e" released by "_create_volume_from_snapshot" :: held 7.311s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:46:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-62beb442-e8e8-4a45-92b7-b66d69115955 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.328s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:46:21 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-62beb442-e8e8-4a45-92b7-b66d69115955 tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41b5b30a-1a66-45ec-83e8-efd51a00f6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97aac478-21ee-426c-93a4-ff672d26b80e', 'volume_size': 1, 'snapshot_id': '227974c4-2ff0-4f76-b02a-03b7a9ab9089'}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:46:21 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-62beb442-e8e8-4a45-92b7-b66d69115955 tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af78b2a9-a0c3-432c-85e2-50de496c2cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:46:21 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-62beb442-e8e8-4a45-92b7-b66d69115955 tempest-VolumesSnapshotTestJSON-1121770850 None] Volume volume-97aac478-21ee-426c-93a4-ff672d26b80e (97aac478-21ee-426c-93a4-ff672d26b80e): created successfully Aug 28 09:46:21 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-62beb442-e8e8-4a45-92b7-b66d69115955 tempest-VolumesSnapshotTestJSON-1121770850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af78b2a9-a0c3-432c-85e2-50de496c2cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:46:21 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-62beb442-e8e8-4a45-92b7-b66d69115955 tempest-VolumesSnapshotTestJSON-1121770850 None] Flow 'volume_create_manager' (835e8a5c-c18d-4e10-9c48-4840c2c3186c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:46:21 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-62beb442-e8e8-4a45-92b7-b66d69115955 tempest-VolumesSnapshotTestJSON-1121770850 None] Created volume successfully. Aug 28 09:46:22 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ec789074-b2bc-4a1e-81b9-bd06fa77dc72 tempest-VolumesSnapshotTestJSON-1121770850 None] Acquiring lock "cinder-97aac478-21ee-426c-93a4-ff672d26b80e-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:46:22 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ec789074-b2bc-4a1e-81b9-bd06fa77dc72 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "cinder-97aac478-21ee-426c-93a4-ff672d26b80e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:46:22 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ec789074-b2bc-4a1e-81b9-bd06fa77dc72 tempest-VolumesSnapshotTestJSON-1121770850 None] Acquiring lock "cinder-quobyte-97aac478-21ee-426c-93a4-ff672d26b80e" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:46:22 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ec789074-b2bc-4a1e-81b9-bd06fa77dc72 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "cinder-quobyte-97aac478-21ee-426c-93a4-ff672d26b80e" acquired by "delete_volume" :: waited 0.027s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:46:22 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1d75ae-9758-4e9f-b4bd-9845f27d7048]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:46:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ec789074-b2bc-4a1e-81b9-bd06fa77dc72 tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97aac478-21ee-426c-93a4-ff672d26b80e {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:22 devstack sudo[102644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97aac478-21ee-426c-93a4-ff672d26b80e Aug 28 09:46:22 devstack sudo[102644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:22 devstack sudo[102644]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ec789074-b2bc-4a1e-81b9-bd06fa77dc72 tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97aac478-21ee-426c-93a4-ff672d26b80e" returned: 0 in 0.408s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ec789074-b2bc-4a1e-81b9-bd06fa77dc72 tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97aac478-21ee-426c-93a4-ff672d26b80e {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:22 devstack sudo[102649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97aac478-21ee-426c-93a4-ff672d26b80e Aug 28 09:46:22 devstack sudo[102649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:23 devstack sudo[102649]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ec789074-b2bc-4a1e-81b9-bd06fa77dc72 tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-97aac478-21ee-426c-93a4-ff672d26b80e" returned: 0 in 0.291s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:23 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ec789074-b2bc-4a1e-81b9-bd06fa77dc72 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "cinder-quobyte-97aac478-21ee-426c-93a4-ff672d26b80e" released by "delete_volume" :: held 0.752s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:46:23 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-ec789074-b2bc-4a1e-81b9-bd06fa77dc72 tempest-VolumesSnapshotTestJSON-1121770850 None] Created reservations ['d613123b-cb73-49a5-9d66-0eef28cce757', 'fbb99236-ba7b-460c-82b0-f672e650bb5b', '6df0a2f5-fd22-4927-a160-375d05ef08df', '99703368-9bd5-4a4a-9be6-3829e1cce698'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:46:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ec789074-b2bc-4a1e-81b9-bd06fa77dc72 tempest-VolumesSnapshotTestJSON-1121770850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:46:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ec789074-b2bc-4a1e-81b9-bd06fa77dc72 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:46:23 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ec789074-b2bc-4a1e-81b9-bd06fa77dc72 tempest-VolumesSnapshotTestJSON-1121770850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:46:23 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ec789074-b2bc-4a1e-81b9-bd06fa77dc72 tempest-VolumesSnapshotTestJSON-1121770850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:46:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ec789074-b2bc-4a1e-81b9-bd06fa77dc72 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:46:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ec789074-b2bc-4a1e-81b9-bd06fa77dc72 tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:23 devstack sudo[102652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:46:23 devstack sudo[102652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:23 devstack sudo[102652]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:23 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-638ddbd5-5afe-4d4c-bcf7-1c9940eaccf7 tempest-VolumesSnapshotTestJSON-1121770850 None] Acquiring lock "cinder-227974c4-2ff0-4f76-b02a-03b7a9ab9089-delete_snapshot" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:46:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ec789074-b2bc-4a1e-81b9-bd06fa77dc72 tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.287s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:23 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-ec789074-b2bc-4a1e-81b9-bd06fa77dc72 tempest-VolumesSnapshotTestJSON-1121770850 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:46:23 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-638ddbd5-5afe-4d4c-bcf7-1c9940eaccf7 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "cinder-227974c4-2ff0-4f76-b02a-03b7a9ab9089-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:46:23 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-638ddbd5-5afe-4d4c-bcf7-1c9940eaccf7 tempest-VolumesSnapshotTestJSON-1121770850 None] Acquiring lock "cinder-quobyte-9fda31b9-b482-47ee-b77c-79be2a064ed0" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:46:23 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-ec789074-b2bc-4a1e-81b9-bd06fa77dc72 tempest-VolumesSnapshotTestJSON-1121770850 None] Deleted volume successfully. Aug 28 09:46:23 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-638ddbd5-5afe-4d4c-bcf7-1c9940eaccf7 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "cinder-quobyte-9fda31b9-b482-47ee-b77c-79be2a064ed0" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:46:23 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-638ddbd5-5afe-4d4c-bcf7-1c9940eaccf7 tempest-VolumesSnapshotTestJSON-1121770850 None] Acquiring lock "cinder-quobyte-227974c4-2ff0-4f76-b02a-03b7a9ab9089" by "_delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:46:23 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ec789074-b2bc-4a1e-81b9-bd06fa77dc72 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "cinder-97aac478-21ee-426c-93a4-ff672d26b80e-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:46:23 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-638ddbd5-5afe-4d4c-bcf7-1c9940eaccf7 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "cinder-quobyte-227974c4-2ff0-4f76-b02a-03b7a9ab9089" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:46:23 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-638ddbd5-5afe-4d4c-bcf7-1c9940eaccf7 tempest-VolumesSnapshotTestJSON-1121770850 None] Deleting offline snapshot 227974c4-2ff0-4f76-b02a-03b7a9ab9089 of volume 9fda31b9-b482-47ee-b77c-79be2a064ed0 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:46:23 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-638ddbd5-5afe-4d4c-bcf7-1c9940eaccf7 tempest-VolumesSnapshotTestJSON-1121770850 None] snapshot_file for this snap is: volume-9fda31b9-b482-47ee-b77c-79be2a064ed0.227974c4-2ff0-4f76-b02a-03b7a9ab9089 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:46:23 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce28d61-0dd2-452d-ae91-e1c2bf03b6da]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:46:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-638ddbd5-5afe-4d4c-bcf7-1c9940eaccf7 tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0.227974c4-2ff0-4f76-b02a-03b7a9ab9089 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:23 devstack sudo[102655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0.227974c4-2ff0-4f76-b02a-03b7a9ab9089 Aug 28 09:46:23 devstack sudo[102655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:24 devstack sudo[102655]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-638ddbd5-5afe-4d4c-bcf7-1c9940eaccf7 tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0.227974c4-2ff0-4f76-b02a-03b7a9ab9089" returned: 0 in 0.431s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:24 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-638ddbd5-5afe-4d4c-bcf7-1c9940eaccf7 tempest-VolumesSnapshotTestJSON-1121770850 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9fda31b9-b482-47ee-b77c-79be2a064ed0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:46:24 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[50115fb0-ce31-4454-86a8-d0eefc2f8779]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:46:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-638ddbd5-5afe-4d4c-bcf7-1c9940eaccf7 tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:24 devstack sudo[102660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0 Aug 28 09:46:24 devstack sudo[102660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:24 devstack sudo[102660]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-638ddbd5-5afe-4d4c-bcf7-1c9940eaccf7 tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0" returned: 0 in 0.645s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-638ddbd5-5afe-4d4c-bcf7-1c9940eaccf7 tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0.227974c4-2ff0-4f76-b02a-03b7a9ab9089 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:24 devstack sudo[102665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0.227974c4-2ff0-4f76-b02a-03b7a9ab9089 Aug 28 09:46:24 devstack sudo[102665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:25 devstack sudo[102665]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-638ddbd5-5afe-4d4c-bcf7-1c9940eaccf7 tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0.227974c4-2ff0-4f76-b02a-03b7a9ab9089" returned: 0 in 0.446s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-638ddbd5-5afe-4d4c-bcf7-1c9940eaccf7 tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0.227974c4-2ff0-4f76-b02a-03b7a9ab9089 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:25 devstack sudo[102670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0.227974c4-2ff0-4f76-b02a-03b7a9ab9089 Aug 28 09:46:25 devstack sudo[102670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:25 devstack sudo[102670]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-638ddbd5-5afe-4d4c-bcf7-1c9940eaccf7 tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0.227974c4-2ff0-4f76-b02a-03b7a9ab9089" returned: 0 in 0.305s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:25 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-638ddbd5-5afe-4d4c-bcf7-1c9940eaccf7 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "cinder-quobyte-227974c4-2ff0-4f76-b02a-03b7a9ab9089" released by "_delete_snapshot" :: held 2.044s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:46:25 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-638ddbd5-5afe-4d4c-bcf7-1c9940eaccf7 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "cinder-quobyte-9fda31b9-b482-47ee-b77c-79be2a064ed0" released by "delete_snapshot" :: held 2.092s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:46:25 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-638ddbd5-5afe-4d4c-bcf7-1c9940eaccf7 tempest-VolumesSnapshotTestJSON-1121770850 None] Created reservations ['edd46770-2606-49d3-a1c6-415bf182e4e4', '44507726-801d-4021-aa3b-46d32cb189c1', 'fe3dc083-ae1c-46c2-8f33-bb4aeb099a7d', '0915fb37-0cce-4979-92ac-a7219c1ffa45'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:46:25 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-638ddbd5-5afe-4d4c-bcf7-1c9940eaccf7 tempest-VolumesSnapshotTestJSON-1121770850 None] Delete snapshot completed successfully. Aug 28 09:46:25 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-638ddbd5-5afe-4d4c-bcf7-1c9940eaccf7 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "cinder-227974c4-2ff0-4f76-b02a-03b7a9ab9089-delete_snapshot" released by "delete_snapshot" :: held 2.322s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:46:26 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-1b4e2a11-c568-482a-8bac-b35461cfbd53 tempest-VolumesSnapshotTestJSON-1121770850 None] Acquiring lock "cinder-9fda31b9-b482-47ee-b77c-79be2a064ed0-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:46:26 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-1b4e2a11-c568-482a-8bac-b35461cfbd53 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "cinder-9fda31b9-b482-47ee-b77c-79be2a064ed0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:46:26 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-1b4e2a11-c568-482a-8bac-b35461cfbd53 tempest-VolumesSnapshotTestJSON-1121770850 None] Acquiring lock "cinder-quobyte-9fda31b9-b482-47ee-b77c-79be2a064ed0" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:46:26 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-1b4e2a11-c568-482a-8bac-b35461cfbd53 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "cinder-quobyte-9fda31b9-b482-47ee-b77c-79be2a064ed0" acquired by "delete_volume" :: waited 0.015s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:46:27 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef5b2a6-f354-4ec0-a63b-c120a2646e85]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:46:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1b4e2a11-c568-482a-8bac-b35461cfbd53 tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:27 devstack sudo[102673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0 Aug 28 09:46:27 devstack sudo[102673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:27 devstack sudo[102673]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1b4e2a11-c568-482a-8bac-b35461cfbd53 tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0" returned: 0 in 0.443s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1b4e2a11-c568-482a-8bac-b35461cfbd53 tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:27 devstack sudo[102678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0 Aug 28 09:46:27 devstack sudo[102678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:27 devstack sudo[102678]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1b4e2a11-c568-482a-8bac-b35461cfbd53 tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9fda31b9-b482-47ee-b77c-79be2a064ed0" returned: 0 in 0.304s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:27 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-1b4e2a11-c568-482a-8bac-b35461cfbd53 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "cinder-quobyte-9fda31b9-b482-47ee-b77c-79be2a064ed0" released by "delete_volume" :: held 0.819s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:46:27 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-1b4e2a11-c568-482a-8bac-b35461cfbd53 tempest-VolumesSnapshotTestJSON-1121770850 None] Created reservations ['76fe25dc-810c-4f65-bf58-5d6bcc2e4227', 'bc99d1bb-5c2f-4f7f-a79d-0251be06d5d1', '7aec9ac4-9b83-457c-b68c-50302db5d050', '789fbd51-97cb-4234-90b0-b07a41b8561d'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:46:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-1b4e2a11-c568-482a-8bac-b35461cfbd53 tempest-VolumesSnapshotTestJSON-1121770850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:46:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-1b4e2a11-c568-482a-8bac-b35461cfbd53 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:46:27 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-1b4e2a11-c568-482a-8bac-b35461cfbd53 tempest-VolumesSnapshotTestJSON-1121770850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:46:27 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-1b4e2a11-c568-482a-8bac-b35461cfbd53 tempest-VolumesSnapshotTestJSON-1121770850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:46:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-1b4e2a11-c568-482a-8bac-b35461cfbd53 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:46:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1b4e2a11-c568-482a-8bac-b35461cfbd53 tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:27 devstack sudo[102681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:46:27 devstack sudo[102681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:28 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-80283693-874f-4b9a-9a19-85da75ee328a tempest-VolumesSnapshotTestJSON-1121770850 None] Acquiring lock "cinder-e4874bfb-7e3f-4da6-8374-ef485a4e27a0-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:46:28 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-80283693-874f-4b9a-9a19-85da75ee328a tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "cinder-e4874bfb-7e3f-4da6-8374-ef485a4e27a0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:46:28 devstack sudo[102681]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1b4e2a11-c568-482a-8bac-b35461cfbd53 tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.396s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:28 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-1b4e2a11-c568-482a-8bac-b35461cfbd53 tempest-VolumesSnapshotTestJSON-1121770850 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:46:28 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-1b4e2a11-c568-482a-8bac-b35461cfbd53 tempest-VolumesSnapshotTestJSON-1121770850 None] Deleted volume successfully. Aug 28 09:46:28 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-80283693-874f-4b9a-9a19-85da75ee328a tempest-VolumesSnapshotTestJSON-1121770850 None] Acquiring lock "cinder-quobyte-e4874bfb-7e3f-4da6-8374-ef485a4e27a0" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:46:28 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-1b4e2a11-c568-482a-8bac-b35461cfbd53 tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "cinder-9fda31b9-b482-47ee-b77c-79be2a064ed0-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:46:28 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-80283693-874f-4b9a-9a19-85da75ee328a tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "cinder-quobyte-e4874bfb-7e3f-4da6-8374-ef485a4e27a0" acquired by "delete_volume" :: waited 0.032s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:46:28 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4392ac5-be09-413e-88cc-4a5041ea3991]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:46:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-80283693-874f-4b9a-9a19-85da75ee328a tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e4874bfb-7e3f-4da6-8374-ef485a4e27a0 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:28 devstack sudo[102684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e4874bfb-7e3f-4da6-8374-ef485a4e27a0 Aug 28 09:46:28 devstack sudo[102684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:28 devstack sudo[102684]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-80283693-874f-4b9a-9a19-85da75ee328a tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e4874bfb-7e3f-4da6-8374-ef485a4e27a0" returned: 0 in 0.534s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-80283693-874f-4b9a-9a19-85da75ee328a tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e4874bfb-7e3f-4da6-8374-ef485a4e27a0 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:29 devstack sudo[102689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e4874bfb-7e3f-4da6-8374-ef485a4e27a0 Aug 28 09:46:29 devstack sudo[102689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:29 devstack sudo[102689]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-80283693-874f-4b9a-9a19-85da75ee328a tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e4874bfb-7e3f-4da6-8374-ef485a4e27a0" returned: 0 in 0.381s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:29 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-80283693-874f-4b9a-9a19-85da75ee328a tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "cinder-quobyte-e4874bfb-7e3f-4da6-8374-ef485a4e27a0" released by "delete_volume" :: held 1.006s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:46:29 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-80283693-874f-4b9a-9a19-85da75ee328a tempest-VolumesSnapshotTestJSON-1121770850 None] Created reservations ['46ee1476-fb17-4c58-b496-01e848f4e072', 'd30b2917-fd24-4014-ad90-99ae4912c012', 'ffe65c83-c8f5-4a7c-bcaf-c1fd6421c608', '5646113d-87f5-4b2d-b983-cf734dd7203c'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:46:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-80283693-874f-4b9a-9a19-85da75ee328a tempest-VolumesSnapshotTestJSON-1121770850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:46:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-80283693-874f-4b9a-9a19-85da75ee328a tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:46:29 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-80283693-874f-4b9a-9a19-85da75ee328a tempest-VolumesSnapshotTestJSON-1121770850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:46:29 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-80283693-874f-4b9a-9a19-85da75ee328a tempest-VolumesSnapshotTestJSON-1121770850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:46:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-80283693-874f-4b9a-9a19-85da75ee328a tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:46:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-80283693-874f-4b9a-9a19-85da75ee328a tempest-VolumesSnapshotTestJSON-1121770850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:29 devstack sudo[102693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:46:29 devstack sudo[102693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:29 devstack sudo[102693]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-80283693-874f-4b9a-9a19-85da75ee328a tempest-VolumesSnapshotTestJSON-1121770850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.279s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:29 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-80283693-874f-4b9a-9a19-85da75ee328a tempest-VolumesSnapshotTestJSON-1121770850 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:46:29 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-80283693-874f-4b9a-9a19-85da75ee328a tempest-VolumesSnapshotTestJSON-1121770850 None] Deleted volume successfully. Aug 28 09:46:29 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-80283693-874f-4b9a-9a19-85da75ee328a tempest-VolumesSnapshotTestJSON-1121770850 None] Lock "cinder-e4874bfb-7e3f-4da6-8374-ef485a4e27a0-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:46:33 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-beafde25-3ea6-487d-9260-9119d7a61bfa tempest-SnapshotDependencyTests-2011846907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:46:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-beafde25-3ea6-487d-9260-9119d7a61bfa tempest-SnapshotDependencyTests-2011846907 None] Flow 'volume_create_manager' (385c7bdb-e699-4462-b8c0-8802ed4fa4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:46:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-beafde25-3ea6-487d-9260-9119d7a61bfa tempest-SnapshotDependencyTests-2011846907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd453521-44a0-4f16-bf00-3281f5ed9b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:46:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-beafde25-3ea6-487d-9260-9119d7a61bfa tempest-SnapshotDependencyTests-2011846907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd453521-44a0-4f16-bf00-3281f5ed9b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1402502892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4159242e-86e9-4c19-8606-77bd49fbdf5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afcc5713d0db4fac977681adfda24d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:46:33Z,use_quota=True,user_id='130ccf0fb6e74251b9da2efbd31251b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:46:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-beafde25-3ea6-487d-9260-9119d7a61bfa tempest-SnapshotDependencyTests-2011846907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3678a14d-4e3c-40ac-97d5-9f9710fa71ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:46:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-beafde25-3ea6-487d-9260-9119d7a61bfa tempest-SnapshotDependencyTests-2011846907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3678a14d-4e3c-40ac-97d5-9f9710fa71ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:46:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-beafde25-3ea6-487d-9260-9119d7a61bfa tempest-SnapshotDependencyTests-2011846907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44787904-036c-47b6-a7e6-d36af932ef90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:46:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-beafde25-3ea6-487d-9260-9119d7a61bfa tempest-SnapshotDependencyTests-2011846907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44787904-036c-47b6-a7e6-d36af932ef90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4159242e-86e9-4c19-8606-77bd49fbdf5d', 'volume_name': 'volume-4159242e-86e9-4c19-8606-77bd49fbdf5d', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:46:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-beafde25-3ea6-487d-9260-9119d7a61bfa tempest-SnapshotDependencyTests-2011846907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5bbe8be-993c-4e75-b5c4-daf7328fb990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:46:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-beafde25-3ea6-487d-9260-9119d7a61bfa tempest-SnapshotDependencyTests-2011846907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5bbe8be-993c-4e75-b5c4-daf7328fb990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:46:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-beafde25-3ea6-487d-9260-9119d7a61bfa tempest-SnapshotDependencyTests-2011846907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe43b4c7-bb96-40e7-9601-5977745152d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:46:33 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-beafde25-3ea6-487d-9260-9119d7a61bfa tempest-SnapshotDependencyTests-2011846907 None] Volume 4159242e-86e9-4c19-8606-77bd49fbdf5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4159242e-86e9-4c19-8606-77bd49fbdf5d', 'volume_size': 1} Aug 28 09:46:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-beafde25-3ea6-487d-9260-9119d7a61bfa tempest-SnapshotDependencyTests-2011846907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:46:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-beafde25-3ea6-487d-9260-9119d7a61bfa tempest-SnapshotDependencyTests-2011846907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:46:33 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-beafde25-3ea6-487d-9260-9119d7a61bfa tempest-SnapshotDependencyTests-2011846907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1402502892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4159242e-86e9-4c19-8606-77bd49fbdf5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afcc5713d0db4fac977681adfda24d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:46:33Z,use_quota=True,user_id='130ccf0fb6e74251b9da2efbd31251b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:46:33 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-beafde25-3ea6-487d-9260-9119d7a61bfa tempest-SnapshotDependencyTests-2011846907 None] Creating volume 4159242e-86e9-4c19-8606-77bd49fbdf5d {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:46:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-beafde25-3ea6-487d-9260-9119d7a61bfa tempest-SnapshotDependencyTests-2011846907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:46:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-beafde25-3ea6-487d-9260-9119d7a61bfa tempest-SnapshotDependencyTests-2011846907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:46:33 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-beafde25-3ea6-487d-9260-9119d7a61bfa tempest-SnapshotDependencyTests-2011846907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:46:33 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-beafde25-3ea6-487d-9260-9119d7a61bfa tempest-SnapshotDependencyTests-2011846907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:46:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-beafde25-3ea6-487d-9260-9119d7a61bfa tempest-SnapshotDependencyTests-2011846907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:46:33 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-beafde25-3ea6-487d-9260-9119d7a61bfa tempest-SnapshotDependencyTests-2011846907 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:46:33 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-beafde25-3ea6-487d-9260-9119d7a61bfa tempest-SnapshotDependencyTests-2011846907 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:46:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-beafde25-3ea6-487d-9260-9119d7a61bfa tempest-SnapshotDependencyTests-2011846907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:33 devstack sudo[102696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d 1073741824 Aug 28 09:46:33 devstack sudo[102696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:34 devstack sudo[102696]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-beafde25-3ea6-487d-9260-9119d7a61bfa tempest-SnapshotDependencyTests-2011846907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d 1073741824" returned: 0 in 0.652s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-beafde25-3ea6-487d-9260-9119d7a61bfa tempest-SnapshotDependencyTests-2011846907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:34 devstack sudo[102702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d Aug 28 09:46:34 devstack sudo[102702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:34 devstack sudo[102702]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-beafde25-3ea6-487d-9260-9119d7a61bfa tempest-SnapshotDependencyTests-2011846907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d" returned: 0 in 0.337s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:34 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-beafde25-3ea6-487d-9260-9119d7a61bfa tempest-SnapshotDependencyTests-2011846907 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:46:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-beafde25-3ea6-487d-9260-9119d7a61bfa tempest-SnapshotDependencyTests-2011846907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:46:34 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-beafde25-3ea6-487d-9260-9119d7a61bfa tempest-SnapshotDependencyTests-2011846907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe43b4c7-bb96-40e7-9601-5977745152d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4159242e-86e9-4c19-8606-77bd49fbdf5d', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:46:34 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-beafde25-3ea6-487d-9260-9119d7a61bfa tempest-SnapshotDependencyTests-2011846907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd89c4aa-c1b5-4748-9ba7-edc1a5a2b5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:46:34 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-beafde25-3ea6-487d-9260-9119d7a61bfa tempest-SnapshotDependencyTests-2011846907 None] Volume volume-4159242e-86e9-4c19-8606-77bd49fbdf5d (4159242e-86e9-4c19-8606-77bd49fbdf5d): created successfully Aug 28 09:46:34 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-beafde25-3ea6-487d-9260-9119d7a61bfa tempest-SnapshotDependencyTests-2011846907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd89c4aa-c1b5-4748-9ba7-edc1a5a2b5f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:46:34 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-beafde25-3ea6-487d-9260-9119d7a61bfa tempest-SnapshotDependencyTests-2011846907 None] Flow 'volume_create_manager' (385c7bdb-e699-4462-b8c0-8802ed4fa4e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:46:34 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-beafde25-3ea6-487d-9260-9119d7a61bfa tempest-SnapshotDependencyTests-2011846907 None] Created volume successfully. Aug 28 09:46:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-6517e92d-de82-449d-80f0-7b124f3d22a9 tempest-SnapshotDependencyTests-2011846907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:46:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-6517e92d-de82-449d-80f0-7b124f3d22a9 tempest-SnapshotDependencyTests-2011846907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:46:36 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-6517e92d-de82-449d-80f0-7b124f3d22a9 tempest-SnapshotDependencyTests-2011846907 None] Creating offline snapshot 64b1d7df-ed27-4446-9b50-cc1ab0710248 of volume 4159242e-86e9-4c19-8606-77bd49fbdf5d {{(pid=86081) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:46:36 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a9ceb3-c70b-4c7d-9404-984c6772a83b]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:46:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6517e92d-de82-449d-80f0-7b124f3d22a9 tempest-SnapshotDependencyTests-2011846907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:36 devstack sudo[102706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d Aug 28 09:46:36 devstack sudo[102706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:36 devstack sudo[102706]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6517e92d-de82-449d-80f0-7b124f3d22a9 tempest-SnapshotDependencyTests-2011846907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d" returned: 0 in 0.427s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6517e92d-de82-449d-80f0-7b124f3d22a9 tempest-SnapshotDependencyTests-2011846907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d.64b1d7df-ed27-4446-9b50-cc1ab0710248 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:36 devstack sudo[102711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d.64b1d7df-ed27-4446-9b50-cc1ab0710248 1G Aug 28 09:46:36 devstack sudo[102711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:36 devstack sudo[102711]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6517e92d-de82-449d-80f0-7b124f3d22a9 tempest-SnapshotDependencyTests-2011846907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d.64b1d7df-ed27-4446-9b50-cc1ab0710248 1G" returned: 0 in 0.412s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6517e92d-de82-449d-80f0-7b124f3d22a9 tempest-SnapshotDependencyTests-2011846907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4159242e-86e9-4c19-8606-77bd49fbdf5d -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d.64b1d7df-ed27-4446-9b50-cc1ab0710248 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:36 devstack sudo[102716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4159242e-86e9-4c19-8606-77bd49fbdf5d -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d.64b1d7df-ed27-4446-9b50-cc1ab0710248 Aug 28 09:46:36 devstack sudo[102716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:37 devstack sudo[102716]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6517e92d-de82-449d-80f0-7b124f3d22a9 tempest-SnapshotDependencyTests-2011846907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4159242e-86e9-4c19-8606-77bd49fbdf5d -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d.64b1d7df-ed27-4446-9b50-cc1ab0710248" returned: 0 in 0.321s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:37 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-6517e92d-de82-449d-80f0-7b124f3d22a9 tempest-SnapshotDependencyTests-2011846907 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d.64b1d7df-ed27-4446-9b50-cc1ab0710248 is being set with open permissions: ugo+rw Aug 28 09:46:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6517e92d-de82-449d-80f0-7b124f3d22a9 tempest-SnapshotDependencyTests-2011846907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d.64b1d7df-ed27-4446-9b50-cc1ab0710248 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:37 devstack sudo[102722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d.64b1d7df-ed27-4446-9b50-cc1ab0710248 Aug 28 09:46:37 devstack sudo[102722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:37 devstack sudo[102722]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6517e92d-de82-449d-80f0-7b124f3d22a9 tempest-SnapshotDependencyTests-2011846907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d.64b1d7df-ed27-4446-9b50-cc1ab0710248" returned: 0 in 0.344s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6517e92d-de82-449d-80f0-7b124f3d22a9 tempest-SnapshotDependencyTests-2011846907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:37 devstack sudo[102725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d.info Aug 28 09:46:37 devstack sudo[102725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:38 devstack sudo[102725]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:38 devstack cinder-volume[86081]: DEBUG oslo_service.periodic_task [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86081) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:46:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:46:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:46:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:46:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:46:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:46:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6517e92d-de82-449d-80f0-7b124f3d22a9 tempest-SnapshotDependencyTests-2011846907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d.info" returned: 0 in 0.500s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:38 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-6517e92d-de82-449d-80f0-7b124f3d22a9 tempest-SnapshotDependencyTests-2011846907 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d.info is being set with open permissions: ugo+rw Aug 28 09:46:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6517e92d-de82-449d-80f0-7b124f3d22a9 tempest-SnapshotDependencyTests-2011846907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:38 devstack sudo[102731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:46:38 devstack sudo[102731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:38 devstack sudo[102733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d.info Aug 28 09:46:38 devstack sudo[102733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:38 devstack sudo[102731]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.373s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:38 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:46:38 devstack cinder-volume[86081]: DEBUG oslo_service.periodic_task [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running periodic task VolumeManager._thread_info {{(pid=86081) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:46:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] thread count: 28 {{(pid=86081) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 09:46:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] thread info: [<_MainThread(MainThread, started 129914189705344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86081) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 09:46:38 devstack sudo[102733]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6517e92d-de82-449d-80f0-7b124f3d22a9 tempest-SnapshotDependencyTests-2011846907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d.info" returned: 0 in 0.395s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-6517e92d-de82-449d-80f0-7b124f3d22a9 tempest-SnapshotDependencyTests-2011846907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.545s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:46:38 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-6517e92d-de82-449d-80f0-7b124f3d22a9 tempest-SnapshotDependencyTests-2011846907 None] Create snapshot completed successfully Aug 28 09:46:39 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-8acd86bc-9f43-4042-a6c7-d3932171509b tempest-SnapshotDependencyTests-2011846907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:46:39 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8acd86bc-9f43-4042-a6c7-d3932171509b tempest-SnapshotDependencyTests-2011846907 None] Flow 'volume_create_manager' (25d0acad-c83d-4d96-add4-f479c90b4ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:46:39 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8acd86bc-9f43-4042-a6c7-d3932171509b tempest-SnapshotDependencyTests-2011846907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dfbdae3-2347-4bad-b0d0-7b477ae4d539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:46:39 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writing DB stats cinder:SELECT=112,cinder:INSERT=31,cinder:UPDATE=133,cinder:DELETE=12 {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:46:40 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8acd86bc-9f43-4042-a6c7-d3932171509b tempest-SnapshotDependencyTests-2011846907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dfbdae3-2347-4bad-b0d0-7b477ae4d539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:46:39Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a27ba79-91a5-436f-8366-414e15988b1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afcc5713d0db4fac977681adfda24d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:46:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=64b1d7df-ed27-4446-9b50-cc1ab0710248,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:46:40Z,use_quota=True,user_id='130ccf0fb6e74251b9da2efbd31251b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:46:40 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8acd86bc-9f43-4042-a6c7-d3932171509b tempest-SnapshotDependencyTests-2011846907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d1dc159-9cec-4b64-b3e1-daf44296ae0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:46:40 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8acd86bc-9f43-4042-a6c7-d3932171509b tempest-SnapshotDependencyTests-2011846907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d1dc159-9cec-4b64-b3e1-daf44296ae0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:46:40 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8acd86bc-9f43-4042-a6c7-d3932171509b tempest-SnapshotDependencyTests-2011846907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ea5a2f6-a0c3-4965-98aa-c146aade4910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:46:40 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8acd86bc-9f43-4042-a6c7-d3932171509b tempest-SnapshotDependencyTests-2011846907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ea5a2f6-a0c3-4965-98aa-c146aade4910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2a27ba79-91a5-436f-8366-414e15988b1c', 'volume_name': 'volume-2a27ba79-91a5-436f-8366-414e15988b1c', 'volume_size': 1, 'snapshot_id': '64b1d7df-ed27-4446-9b50-cc1ab0710248'}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:46:40 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8acd86bc-9f43-4042-a6c7-d3932171509b tempest-SnapshotDependencyTests-2011846907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff9901c8-7e78-4657-b6b2-cc8869588f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:46:40 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8acd86bc-9f43-4042-a6c7-d3932171509b tempest-SnapshotDependencyTests-2011846907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff9901c8-7e78-4657-b6b2-cc8869588f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:46:40 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8acd86bc-9f43-4042-a6c7-d3932171509b tempest-SnapshotDependencyTests-2011846907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80260cc5-fd14-48dd-945d-9676e261da94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:46:40 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-8acd86bc-9f43-4042-a6c7-d3932171509b tempest-SnapshotDependencyTests-2011846907 None] Volume 2a27ba79-91a5-436f-8366-414e15988b1c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2a27ba79-91a5-436f-8366-414e15988b1c', 'volume_size': 1, 'snapshot_id': '64b1d7df-ed27-4446-9b50-cc1ab0710248'} Aug 28 09:46:40 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writing DB stats cinder:SELECT=105,cinder:INSERT=33,cinder:UPDATE=114,cinder:DELETE=9 {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:46:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8acd86bc-9f43-4042-a6c7-d3932171509b tempest-SnapshotDependencyTests-2011846907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:46:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8acd86bc-9f43-4042-a6c7-d3932171509b tempest-SnapshotDependencyTests-2011846907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:46:40 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8acd86bc-9f43-4042-a6c7-d3932171509b tempest-SnapshotDependencyTests-2011846907 None] Acquiring lock "cinder-quobyte-64b1d7df-ed27-4446-9b50-cc1ab0710248-2a27ba79-91a5-436f-8366-414e15988b1c" by "_create_volume_from_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:46:40 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8acd86bc-9f43-4042-a6c7-d3932171509b tempest-SnapshotDependencyTests-2011846907 None] Lock "cinder-quobyte-64b1d7df-ed27-4446-9b50-cc1ab0710248-2a27ba79-91a5-436f-8366-414e15988b1c" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:46:40 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-8acd86bc-9f43-4042-a6c7-d3932171509b tempest-SnapshotDependencyTests-2011846907 None] Creating volume 2a27ba79-91a5-436f-8366-414e15988b1c from snapshot 64b1d7df-ed27-4446-9b50-cc1ab0710248 {{(pid=86081) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 28 09:46:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8acd86bc-9f43-4042-a6c7-d3932171509b tempest-SnapshotDependencyTests-2011846907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:46:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8acd86bc-9f43-4042-a6c7-d3932171509b tempest-SnapshotDependencyTests-2011846907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:46:40 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-8acd86bc-9f43-4042-a6c7-d3932171509b tempest-SnapshotDependencyTests-2011846907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:46:40 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-8acd86bc-9f43-4042-a6c7-d3932171509b tempest-SnapshotDependencyTests-2011846907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:46:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8acd86bc-9f43-4042-a6c7-d3932171509b tempest-SnapshotDependencyTests-2011846907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:46:40 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-8acd86bc-9f43-4042-a6c7-d3932171509b tempest-SnapshotDependencyTests-2011846907 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:46:40 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8acd86bc-9f43-4042-a6c7-d3932171509b tempest-SnapshotDependencyTests-2011846907 None] Acquiring lock "cinder-quobyte-2a27ba79-91a5-436f-8366-414e15988b1c" by "_copy_volume_from_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:46:40 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8acd86bc-9f43-4042-a6c7-d3932171509b tempest-SnapshotDependencyTests-2011846907 None] Lock "cinder-quobyte-2a27ba79-91a5-436f-8366-414e15988b1c" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:46:40 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-8acd86bc-9f43-4042-a6c7-d3932171509b tempest-SnapshotDependencyTests-2011846907 None] snapshot: 64b1d7df-ed27-4446-9b50-cc1ab0710248, volume: 2a27ba79-91a5-436f-8366-414e15988b1c, {{(pid=86081) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 28 09:46:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8acd86bc-9f43-4042-a6c7-d3932171509b tempest-SnapshotDependencyTests-2011846907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:46:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8acd86bc-9f43-4042-a6c7-d3932171509b tempest-SnapshotDependencyTests-2011846907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:46:40 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-8acd86bc-9f43-4042-a6c7-d3932171509b tempest-SnapshotDependencyTests-2011846907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:46:40 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-8acd86bc-9f43-4042-a6c7-d3932171509b tempest-SnapshotDependencyTests-2011846907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:46:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8acd86bc-9f43-4042-a6c7-d3932171509b tempest-SnapshotDependencyTests-2011846907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:46:40 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ae9e88-cf7c-4dc7-b2f4-6f555f4e90f3]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:46:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8acd86bc-9f43-4042-a6c7-d3932171509b tempest-SnapshotDependencyTests-2011846907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d.64b1d7df-ed27-4446-9b50-cc1ab0710248 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:40 devstack sudo[102738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d.64b1d7df-ed27-4446-9b50-cc1ab0710248 Aug 28 09:46:40 devstack sudo[102738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:40 devstack sudo[102738]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8acd86bc-9f43-4042-a6c7-d3932171509b tempest-SnapshotDependencyTests-2011846907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d.64b1d7df-ed27-4446-9b50-cc1ab0710248" returned: 0 in 0.480s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:40 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-8acd86bc-9f43-4042-a6c7-d3932171509b tempest-SnapshotDependencyTests-2011846907 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4159242e-86e9-4c19-8606-77bd49fbdf5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:46:40 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f636e5a-f2af-4035-b01d-f953a3c7ebe0]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:46:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8acd86bc-9f43-4042-a6c7-d3932171509b tempest-SnapshotDependencyTests-2011846907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:40 devstack sudo[102743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d Aug 28 09:46:40 devstack sudo[102743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:41 devstack sudo[102743]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8acd86bc-9f43-4042-a6c7-d3932171509b tempest-SnapshotDependencyTests-2011846907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d" returned: 0 in 0.551s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:41 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-8acd86bc-9f43-4042-a6c7-d3932171509b tempest-SnapshotDependencyTests-2011846907 None] will copy from snapshot at /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d {{(pid=86081) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 28 09:46:41 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-8acd86bc-9f43-4042-a6c7-d3932171509b tempest-SnapshotDependencyTests-2011846907 None] Creating direct copy from snapshot {{(pid=86081) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 28 09:46:41 devstack cinder-volume[86081]: DEBUG cinder.utils [None req-8acd86bc-9f43-4042-a6c7-d3932171509b tempest-SnapshotDependencyTests-2011846907 None] Path /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2a27ba79-91a5-436f-8366-414e15988b1c not found in is_blk_device check {{(pid=86081) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 28 09:46:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8acd86bc-9f43-4042-a6c7-d3932171509b tempest-SnapshotDependencyTests-2011846907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2a27ba79-91a5-436f-8366-414e15988b1c {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:41 devstack sudo[102748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2a27ba79-91a5-436f-8366-414e15988b1c Aug 28 09:46:41 devstack sudo[102748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:41 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-c668c9f7-ea62-45c6-b638-f9d8aa6ccf91 tempest-VolumesSnapshotListTestJSON-747565511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:46:41 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-c668c9f7-ea62-45c6-b638-f9d8aa6ccf91 tempest-VolumesSnapshotListTestJSON-747565511 None] Flow 'volume_create_manager' (9e2e52cf-68de-48bc-802f-9355c17d6a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:46:41 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-c668c9f7-ea62-45c6-b638-f9d8aa6ccf91 tempest-VolumesSnapshotListTestJSON-747565511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48b13023-ff47-4955-a2e8-f16501df2624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:46:41 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-c668c9f7-ea62-45c6-b638-f9d8aa6ccf91 tempest-VolumesSnapshotListTestJSON-747565511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48b13023-ff47-4955-a2e8-f16501df2624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1015719030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c45e9792-2cb2-4406-9da0-ff901d805195,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfdec0a78ec04147a41a9a715ed64953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:46:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:46:41Z,use_quota=True,user_id='cc475644a22a4b2e9704e997b5d59a5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:46:41 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-c668c9f7-ea62-45c6-b638-f9d8aa6ccf91 tempest-VolumesSnapshotListTestJSON-747565511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4927c609-7894-4a3b-af53-ab1f1867a789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:46:41 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-c668c9f7-ea62-45c6-b638-f9d8aa6ccf91 tempest-VolumesSnapshotListTestJSON-747565511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4927c609-7894-4a3b-af53-ab1f1867a789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:46:41 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-c668c9f7-ea62-45c6-b638-f9d8aa6ccf91 tempest-VolumesSnapshotListTestJSON-747565511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52b1bc1d-681d-4e34-a644-e3655fd498ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:46:41 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-c668c9f7-ea62-45c6-b638-f9d8aa6ccf91 tempest-VolumesSnapshotListTestJSON-747565511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52b1bc1d-681d-4e34-a644-e3655fd498ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c45e9792-2cb2-4406-9da0-ff901d805195', 'volume_name': 'volume-c45e9792-2cb2-4406-9da0-ff901d805195', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:46:41 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-c668c9f7-ea62-45c6-b638-f9d8aa6ccf91 tempest-VolumesSnapshotListTestJSON-747565511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6d484e3-c695-424c-a768-2eb29fbb8639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:46:41 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-c668c9f7-ea62-45c6-b638-f9d8aa6ccf91 tempest-VolumesSnapshotListTestJSON-747565511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6d484e3-c695-424c-a768-2eb29fbb8639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:46:41 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-c668c9f7-ea62-45c6-b638-f9d8aa6ccf91 tempest-VolumesSnapshotListTestJSON-747565511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8366934-57ef-43da-884e-63b9a7c3d42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:46:41 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-c668c9f7-ea62-45c6-b638-f9d8aa6ccf91 tempest-VolumesSnapshotListTestJSON-747565511 None] Volume c45e9792-2cb2-4406-9da0-ff901d805195: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c45e9792-2cb2-4406-9da0-ff901d805195', 'volume_size': 1} Aug 28 09:46:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-c668c9f7-ea62-45c6-b638-f9d8aa6ccf91 tempest-VolumesSnapshotListTestJSON-747565511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:46:46 devstack sudo[102748]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8acd86bc-9f43-4042-a6c7-d3932171509b tempest-SnapshotDependencyTests-2011846907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2a27ba79-91a5-436f-8366-414e15988b1c" returned: 0 in 5.312s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:46 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-8acd86bc-9f43-4042-a6c7-d3932171509b tempest-SnapshotDependencyTests-2011846907 None] Image conversion details: src /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d, size 1024.00 MB, duration 5.31 sec, destination /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2a27ba79-91a5-436f-8366-414e15988b1c {{(pid=86081) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 09:46:46 devstack cinder-volume[86081]: INFO cinder.image.image_utils [None req-8acd86bc-9f43-4042-a6c7-d3932171509b tempest-SnapshotDependencyTests-2011846907 None] Converted 1024.00 MB image at 192.75 MB/s Aug 28 09:46:46 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-8acd86bc-9f43-4042-a6c7-d3932171509b tempest-SnapshotDependencyTests-2011846907 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2a27ba79-91a5-436f-8366-414e15988b1c is being set with open permissions: ugo+rw Aug 28 09:46:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8acd86bc-9f43-4042-a6c7-d3932171509b tempest-SnapshotDependencyTests-2011846907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2a27ba79-91a5-436f-8366-414e15988b1c {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:46 devstack sudo[102762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2a27ba79-91a5-436f-8366-414e15988b1c Aug 28 09:46:46 devstack sudo[102762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:46 devstack sudo[102762]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8acd86bc-9f43-4042-a6c7-d3932171509b tempest-SnapshotDependencyTests-2011846907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2a27ba79-91a5-436f-8366-414e15988b1c" returned: 0 in 0.310s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:46 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8acd86bc-9f43-4042-a6c7-d3932171509b tempest-SnapshotDependencyTests-2011846907 None] Lock "cinder-quobyte-2a27ba79-91a5-436f-8366-414e15988b1c" released by "_copy_volume_from_snapshot" :: held 6.757s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:46:46 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8acd86bc-9f43-4042-a6c7-d3932171509b tempest-SnapshotDependencyTests-2011846907 None] Lock "cinder-quobyte-64b1d7df-ed27-4446-9b50-cc1ab0710248-2a27ba79-91a5-436f-8366-414e15988b1c" released by "_create_volume_from_snapshot" :: held 6.830s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:46:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8acd86bc-9f43-4042-a6c7-d3932171509b tempest-SnapshotDependencyTests-2011846907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.857s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:46:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-c668c9f7-ea62-45c6-b638-f9d8aa6ccf91 tempest-VolumesSnapshotListTestJSON-747565511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.492s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:46:46 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-c668c9f7-ea62-45c6-b638-f9d8aa6ccf91 tempest-VolumesSnapshotListTestJSON-747565511 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1015719030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c45e9792-2cb2-4406-9da0-ff901d805195,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfdec0a78ec04147a41a9a715ed64953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:46:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:46:41Z,use_quota=True,user_id='cc475644a22a4b2e9704e997b5d59a5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:46:46 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-c668c9f7-ea62-45c6-b638-f9d8aa6ccf91 tempest-VolumesSnapshotListTestJSON-747565511 None] Creating volume c45e9792-2cb2-4406-9da0-ff901d805195 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:46:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-c668c9f7-ea62-45c6-b638-f9d8aa6ccf91 tempest-VolumesSnapshotListTestJSON-747565511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:46:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-c668c9f7-ea62-45c6-b638-f9d8aa6ccf91 tempest-VolumesSnapshotListTestJSON-747565511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:46:46 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-c668c9f7-ea62-45c6-b638-f9d8aa6ccf91 tempest-VolumesSnapshotListTestJSON-747565511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:46:46 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-c668c9f7-ea62-45c6-b638-f9d8aa6ccf91 tempest-VolumesSnapshotListTestJSON-747565511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:46:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-c668c9f7-ea62-45c6-b638-f9d8aa6ccf91 tempest-VolumesSnapshotListTestJSON-747565511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:46:46 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-c668c9f7-ea62-45c6-b638-f9d8aa6ccf91 tempest-VolumesSnapshotListTestJSON-747565511 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:46:46 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-c668c9f7-ea62-45c6-b638-f9d8aa6ccf91 tempest-VolumesSnapshotListTestJSON-747565511 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:46:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c668c9f7-ea62-45c6-b638-f9d8aa6ccf91 tempest-VolumesSnapshotListTestJSON-747565511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:46 devstack sudo[102765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195 1073741824 Aug 28 09:46:46 devstack sudo[102765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8acd86bc-9f43-4042-a6c7-d3932171509b tempest-SnapshotDependencyTests-2011846907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80260cc5-fd14-48dd-945d-9676e261da94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a27ba79-91a5-436f-8366-414e15988b1c', 'volume_size': 1, 'snapshot_id': '64b1d7df-ed27-4446-9b50-cc1ab0710248'}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:46:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8acd86bc-9f43-4042-a6c7-d3932171509b tempest-SnapshotDependencyTests-2011846907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56182fd1-c918-404a-b3af-ebed89316f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:46:47 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-8acd86bc-9f43-4042-a6c7-d3932171509b tempest-SnapshotDependencyTests-2011846907 None] Volume volume-2a27ba79-91a5-436f-8366-414e15988b1c (2a27ba79-91a5-436f-8366-414e15988b1c): created successfully Aug 28 09:46:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8acd86bc-9f43-4042-a6c7-d3932171509b tempest-SnapshotDependencyTests-2011846907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56182fd1-c918-404a-b3af-ebed89316f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:46:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8acd86bc-9f43-4042-a6c7-d3932171509b tempest-SnapshotDependencyTests-2011846907 None] Flow 'volume_create_manager' (25d0acad-c83d-4d96-add4-f479c90b4ea1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:46:47 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-8acd86bc-9f43-4042-a6c7-d3932171509b tempest-SnapshotDependencyTests-2011846907 None] Created volume successfully. Aug 28 09:46:47 devstack sudo[102765]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c668c9f7-ea62-45c6-b638-f9d8aa6ccf91 tempest-VolumesSnapshotListTestJSON-747565511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195 1073741824" returned: 0 in 0.473s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c668c9f7-ea62-45c6-b638-f9d8aa6ccf91 tempest-VolumesSnapshotListTestJSON-747565511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:47 devstack sudo[102771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195 Aug 28 09:46:47 devstack sudo[102771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:47 devstack sudo[102771]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c668c9f7-ea62-45c6-b638-f9d8aa6ccf91 tempest-VolumesSnapshotListTestJSON-747565511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195" returned: 0 in 0.257s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:47 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-c668c9f7-ea62-45c6-b638-f9d8aa6ccf91 tempest-VolumesSnapshotListTestJSON-747565511 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:46:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-c668c9f7-ea62-45c6-b638-f9d8aa6ccf91 tempest-VolumesSnapshotListTestJSON-747565511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:46:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-c668c9f7-ea62-45c6-b638-f9d8aa6ccf91 tempest-VolumesSnapshotListTestJSON-747565511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8366934-57ef-43da-884e-63b9a7c3d42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c45e9792-2cb2-4406-9da0-ff901d805195', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:46:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-c668c9f7-ea62-45c6-b638-f9d8aa6ccf91 tempest-VolumesSnapshotListTestJSON-747565511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ff9600b-e68e-4b6f-b14c-6ceabfd7a945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:46:47 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad58ca9d-d53d-4a78-b305-8358459a9ee9 tempest-TestImageHashVerification-67088554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:46:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ad58ca9d-d53d-4a78-b305-8358459a9ee9 tempest-TestImageHashVerification-67088554 None] Flow 'volume_create_manager' (9f618a8f-510a-46eb-9564-808990c91a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:46:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ad58ca9d-d53d-4a78-b305-8358459a9ee9 tempest-TestImageHashVerification-67088554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b91c7586-dd89-488d-abaf-925889e6d5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:46:47 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-c668c9f7-ea62-45c6-b638-f9d8aa6ccf91 tempest-VolumesSnapshotListTestJSON-747565511 None] Volume volume-c45e9792-2cb2-4406-9da0-ff901d805195 (c45e9792-2cb2-4406-9da0-ff901d805195): created successfully Aug 28 09:46:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-c668c9f7-ea62-45c6-b638-f9d8aa6ccf91 tempest-VolumesSnapshotListTestJSON-747565511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ff9600b-e68e-4b6f-b14c-6ceabfd7a945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:46:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-c668c9f7-ea62-45c6-b638-f9d8aa6ccf91 tempest-VolumesSnapshotListTestJSON-747565511 None] Flow 'volume_create_manager' (9e2e52cf-68de-48bc-802f-9355c17d6a16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:46:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ad58ca9d-d53d-4a78-b305-8358459a9ee9 tempest-TestImageHashVerification-67088554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b91c7586-dd89-488d-abaf-925889e6d5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:46:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-670888576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fedbb5a5-ce00-41cd-a63f-f28d118dadd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='261de6ed5319420a814fc8adfe4b12ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:46:48Z,use_quota=True,user_id='e29fbce9324949cf9d5d6241159a945d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:46:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ad58ca9d-d53d-4a78-b305-8358459a9ee9 tempest-TestImageHashVerification-67088554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ced0bc09-f2da-4645-b3a7-31ac5d9a4ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:46:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ad58ca9d-d53d-4a78-b305-8358459a9ee9 tempest-TestImageHashVerification-67088554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ced0bc09-f2da-4645-b3a7-31ac5d9a4ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:46:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ad58ca9d-d53d-4a78-b305-8358459a9ee9 tempest-TestImageHashVerification-67088554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f31b6e1-a99d-439d-88ff-6088c0de0387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:46:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ad58ca9d-d53d-4a78-b305-8358459a9ee9 tempest-TestImageHashVerification-67088554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f31b6e1-a99d-439d-88ff-6088c0de0387) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fedbb5a5-ce00-41cd-a63f-f28d118dadd7', 'volume_name': 'volume-fedbb5a5-ce00-41cd-a63f-f28d118dadd7', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:46:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ad58ca9d-d53d-4a78-b305-8358459a9ee9 tempest-TestImageHashVerification-67088554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85531a79-7599-4688-9cec-19c04d696f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:46:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ad58ca9d-d53d-4a78-b305-8358459a9ee9 tempest-TestImageHashVerification-67088554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85531a79-7599-4688-9cec-19c04d696f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:46:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ad58ca9d-d53d-4a78-b305-8358459a9ee9 tempest-TestImageHashVerification-67088554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8ca841f-4822-4ded-aba5-74ed54f54837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:46:47 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-ad58ca9d-d53d-4a78-b305-8358459a9ee9 tempest-TestImageHashVerification-67088554 None] Volume fedbb5a5-ce00-41cd-a63f-f28d118dadd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fedbb5a5-ce00-41cd-a63f-f28d118dadd7', 'volume_size': 1} Aug 28 09:46:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ad58ca9d-d53d-4a78-b305-8358459a9ee9 tempest-TestImageHashVerification-67088554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:46:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ad58ca9d-d53d-4a78-b305-8358459a9ee9 tempest-TestImageHashVerification-67088554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:46:47 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ad58ca9d-d53d-4a78-b305-8358459a9ee9 tempest-TestImageHashVerification-67088554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:46:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-670888576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fedbb5a5-ce00-41cd-a63f-f28d118dadd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='261de6ed5319420a814fc8adfe4b12ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:46:48Z,use_quota=True,user_id='e29fbce9324949cf9d5d6241159a945d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:46:47 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-ad58ca9d-d53d-4a78-b305-8358459a9ee9 tempest-TestImageHashVerification-67088554 None] Creating volume fedbb5a5-ce00-41cd-a63f-f28d118dadd7 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:46:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ad58ca9d-d53d-4a78-b305-8358459a9ee9 tempest-TestImageHashVerification-67088554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:46:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ad58ca9d-d53d-4a78-b305-8358459a9ee9 tempest-TestImageHashVerification-67088554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:46:47 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ad58ca9d-d53d-4a78-b305-8358459a9ee9 tempest-TestImageHashVerification-67088554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:46:47 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ad58ca9d-d53d-4a78-b305-8358459a9ee9 tempest-TestImageHashVerification-67088554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:46:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ad58ca9d-d53d-4a78-b305-8358459a9ee9 tempest-TestImageHashVerification-67088554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:46:47 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ad58ca9d-d53d-4a78-b305-8358459a9ee9 tempest-TestImageHashVerification-67088554 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:46:47 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-ad58ca9d-d53d-4a78-b305-8358459a9ee9 tempest-TestImageHashVerification-67088554 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:46:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ad58ca9d-d53d-4a78-b305-8358459a9ee9 tempest-TestImageHashVerification-67088554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fedbb5a5-ce00-41cd-a63f-f28d118dadd7 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:47 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-c668c9f7-ea62-45c6-b638-f9d8aa6ccf91 tempest-VolumesSnapshotListTestJSON-747565511 None] Created volume successfully. Aug 28 09:46:47 devstack sudo[102774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fedbb5a5-ce00-41cd-a63f-f28d118dadd7 1073741824 Aug 28 09:46:47 devstack sudo[102774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:47 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-43bfb53a-7781-48e2-8349-40e894ae8980 tempest-SnapshotDependencyTests-2011846907 None] Acquiring lock "cinder-64b1d7df-ed27-4446-9b50-cc1ab0710248-delete_snapshot" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:46:48 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-43bfb53a-7781-48e2-8349-40e894ae8980 tempest-SnapshotDependencyTests-2011846907 None] Lock "cinder-64b1d7df-ed27-4446-9b50-cc1ab0710248-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:46:48 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-43bfb53a-7781-48e2-8349-40e894ae8980 tempest-SnapshotDependencyTests-2011846907 None] Acquiring lock "cinder-quobyte-4159242e-86e9-4c19-8606-77bd49fbdf5d" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:46:48 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-43bfb53a-7781-48e2-8349-40e894ae8980 tempest-SnapshotDependencyTests-2011846907 None] Lock "cinder-quobyte-4159242e-86e9-4c19-8606-77bd49fbdf5d" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:46:48 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-43bfb53a-7781-48e2-8349-40e894ae8980 tempest-SnapshotDependencyTests-2011846907 None] Acquiring lock "cinder-quobyte-64b1d7df-ed27-4446-9b50-cc1ab0710248" by "_delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:46:48 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-43bfb53a-7781-48e2-8349-40e894ae8980 tempest-SnapshotDependencyTests-2011846907 None] Lock "cinder-quobyte-64b1d7df-ed27-4446-9b50-cc1ab0710248" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:46:48 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-43bfb53a-7781-48e2-8349-40e894ae8980 tempest-SnapshotDependencyTests-2011846907 None] Deleting offline snapshot 64b1d7df-ed27-4446-9b50-cc1ab0710248 of volume 4159242e-86e9-4c19-8606-77bd49fbdf5d {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:46:48 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-43bfb53a-7781-48e2-8349-40e894ae8980 tempest-SnapshotDependencyTests-2011846907 None] snapshot_file for this snap is: volume-4159242e-86e9-4c19-8606-77bd49fbdf5d.64b1d7df-ed27-4446-9b50-cc1ab0710248 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:46:48 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9353f5-6cd1-43cb-8726-d2d84da4495a]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:46:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-43bfb53a-7781-48e2-8349-40e894ae8980 tempest-SnapshotDependencyTests-2011846907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d.64b1d7df-ed27-4446-9b50-cc1ab0710248 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:48 devstack sudo[102779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d.64b1d7df-ed27-4446-9b50-cc1ab0710248 Aug 28 09:46:48 devstack sudo[102779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:48 devstack sudo[102774]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ad58ca9d-d53d-4a78-b305-8358459a9ee9 tempest-TestImageHashVerification-67088554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fedbb5a5-ce00-41cd-a63f-f28d118dadd7 1073741824" returned: 0 in 0.529s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-1ead1b43-11e6-4f93-b82e-525eced5e511 tempest-VolumesSnapshotListTestJSON-747565511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:46:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ad58ca9d-d53d-4a78-b305-8358459a9ee9 tempest-TestImageHashVerification-67088554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fedbb5a5-ce00-41cd-a63f-f28d118dadd7 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:48 devstack sudo[102781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fedbb5a5-ce00-41cd-a63f-f28d118dadd7 Aug 28 09:46:48 devstack sudo[102781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:48 devstack sudo[102779]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-43bfb53a-7781-48e2-8349-40e894ae8980 tempest-SnapshotDependencyTests-2011846907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d.64b1d7df-ed27-4446-9b50-cc1ab0710248" returned: 0 in 0.398s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:48 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-43bfb53a-7781-48e2-8349-40e894ae8980 tempest-SnapshotDependencyTests-2011846907 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4159242e-86e9-4c19-8606-77bd49fbdf5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:46:48 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f8e688-23fa-4582-9181-8840b9dd2ba3]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:46:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-43bfb53a-7781-48e2-8349-40e894ae8980 tempest-SnapshotDependencyTests-2011846907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:48 devstack sudo[102786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d Aug 28 09:46:48 devstack sudo[102786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:48 devstack sudo[102781]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ad58ca9d-d53d-4a78-b305-8358459a9ee9 tempest-TestImageHashVerification-67088554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fedbb5a5-ce00-41cd-a63f-f28d118dadd7" returned: 0 in 0.257s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:48 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ad58ca9d-d53d-4a78-b305-8358459a9ee9 tempest-TestImageHashVerification-67088554 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:46:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ad58ca9d-d53d-4a78-b305-8358459a9ee9 tempest-TestImageHashVerification-67088554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:46:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-1ead1b43-11e6-4f93-b82e-525eced5e511 tempest-VolumesSnapshotListTestJSON-747565511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.275s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:46:48 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ad58ca9d-d53d-4a78-b305-8358459a9ee9 tempest-TestImageHashVerification-67088554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8ca841f-4822-4ded-aba5-74ed54f54837) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fedbb5a5-ce00-41cd-a63f-f28d118dadd7', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:46:48 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ad58ca9d-d53d-4a78-b305-8358459a9ee9 tempest-TestImageHashVerification-67088554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc53284f-4124-4ba3-9661-3c82ffa85e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:46:48 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-1ead1b43-11e6-4f93-b82e-525eced5e511 tempest-VolumesSnapshotListTestJSON-747565511 None] Creating offline snapshot 551680fe-00ef-46cf-b378-fe0373c36b0a of volume c45e9792-2cb2-4406-9da0-ff901d805195 {{(pid=86081) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:46:48 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-ad58ca9d-d53d-4a78-b305-8358459a9ee9 tempest-TestImageHashVerification-67088554 None] Volume volume-fedbb5a5-ce00-41cd-a63f-f28d118dadd7 (fedbb5a5-ce00-41cd-a63f-f28d118dadd7): created successfully Aug 28 09:46:48 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ad58ca9d-d53d-4a78-b305-8358459a9ee9 tempest-TestImageHashVerification-67088554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc53284f-4124-4ba3-9661-3c82ffa85e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:46:48 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ad58ca9d-d53d-4a78-b305-8358459a9ee9 tempest-TestImageHashVerification-67088554 None] Flow 'volume_create_manager' (9f618a8f-510a-46eb-9564-808990c91a1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:46:48 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[94437c56-5972-437b-8e4d-6f9b29ad978d]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:46:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1ead1b43-11e6-4f93-b82e-525eced5e511 tempest-VolumesSnapshotListTestJSON-747565511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:48 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-ad58ca9d-d53d-4a78-b305-8358459a9ee9 tempest-TestImageHashVerification-67088554 None] Created volume successfully. Aug 28 09:46:48 devstack sudo[102789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195 Aug 28 09:46:48 devstack sudo[102789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:49 devstack sudo[102786]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-43bfb53a-7781-48e2-8349-40e894ae8980 tempest-SnapshotDependencyTests-2011846907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d" returned: 0 in 0.549s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-43bfb53a-7781-48e2-8349-40e894ae8980 tempest-SnapshotDependencyTests-2011846907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d.64b1d7df-ed27-4446-9b50-cc1ab0710248 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:49 devstack sudo[102797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d.64b1d7df-ed27-4446-9b50-cc1ab0710248 Aug 28 09:46:49 devstack sudo[102797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:49 devstack sudo[102789]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1ead1b43-11e6-4f93-b82e-525eced5e511 tempest-VolumesSnapshotListTestJSON-747565511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195" returned: 0 in 0.381s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1ead1b43-11e6-4f93-b82e-525eced5e511 tempest-VolumesSnapshotListTestJSON-747565511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.551680fe-00ef-46cf-b378-fe0373c36b0a 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:49 devstack sudo[102799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.551680fe-00ef-46cf-b378-fe0373c36b0a 1G Aug 28 09:46:49 devstack sudo[102799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:49 devstack sudo[102797]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-43bfb53a-7781-48e2-8349-40e894ae8980 tempest-SnapshotDependencyTests-2011846907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d.64b1d7df-ed27-4446-9b50-cc1ab0710248" returned: 0 in 0.339s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-43bfb53a-7781-48e2-8349-40e894ae8980 tempest-SnapshotDependencyTests-2011846907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d.64b1d7df-ed27-4446-9b50-cc1ab0710248 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:49 devstack sudo[102808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d.64b1d7df-ed27-4446-9b50-cc1ab0710248 Aug 28 09:46:49 devstack sudo[102808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:49 devstack sudo[102799]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1ead1b43-11e6-4f93-b82e-525eced5e511 tempest-VolumesSnapshotListTestJSON-747565511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.551680fe-00ef-46cf-b378-fe0373c36b0a 1G" returned: 0 in 0.417s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1ead1b43-11e6-4f93-b82e-525eced5e511 tempest-VolumesSnapshotListTestJSON-747565511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c45e9792-2cb2-4406-9da0-ff901d805195 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.551680fe-00ef-46cf-b378-fe0373c36b0a {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:49 devstack sudo[102811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c45e9792-2cb2-4406-9da0-ff901d805195 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.551680fe-00ef-46cf-b378-fe0373c36b0a Aug 28 09:46:49 devstack sudo[102811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:49 devstack sudo[102808]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-43bfb53a-7781-48e2-8349-40e894ae8980 tempest-SnapshotDependencyTests-2011846907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d.64b1d7df-ed27-4446-9b50-cc1ab0710248" returned: 0 in 0.249s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:49 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-43bfb53a-7781-48e2-8349-40e894ae8980 tempest-SnapshotDependencyTests-2011846907 None] Lock "cinder-quobyte-64b1d7df-ed27-4446-9b50-cc1ab0710248" released by "_delete_snapshot" :: held 1.658s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:46:49 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-43bfb53a-7781-48e2-8349-40e894ae8980 tempest-SnapshotDependencyTests-2011846907 None] Lock "cinder-quobyte-4159242e-86e9-4c19-8606-77bd49fbdf5d" released by "delete_snapshot" :: held 1.683s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:46:49 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-43bfb53a-7781-48e2-8349-40e894ae8980 tempest-SnapshotDependencyTests-2011846907 None] Created reservations ['39bd3d91-adee-43ab-b77f-3436aeb2c719', 'c2310978-59c0-49b8-aa3e-b059fc90cf14', '120730b6-2509-47a2-80f5-d59d26209b20', '80537052-919f-404b-a31e-7f388527ffbc'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:46:49 devstack sudo[102811]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1ead1b43-11e6-4f93-b82e-525eced5e511 tempest-VolumesSnapshotListTestJSON-747565511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c45e9792-2cb2-4406-9da0-ff901d805195 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.551680fe-00ef-46cf-b378-fe0373c36b0a" returned: 0 in 0.330s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:49 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-1ead1b43-11e6-4f93-b82e-525eced5e511 tempest-VolumesSnapshotListTestJSON-747565511 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.551680fe-00ef-46cf-b378-fe0373c36b0a is being set with open permissions: ugo+rw Aug 28 09:46:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1ead1b43-11e6-4f93-b82e-525eced5e511 tempest-VolumesSnapshotListTestJSON-747565511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.551680fe-00ef-46cf-b378-fe0373c36b0a {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:49 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-43bfb53a-7781-48e2-8349-40e894ae8980 tempest-SnapshotDependencyTests-2011846907 None] Delete snapshot completed successfully. Aug 28 09:46:49 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-43bfb53a-7781-48e2-8349-40e894ae8980 tempest-SnapshotDependencyTests-2011846907 None] Lock "cinder-64b1d7df-ed27-4446-9b50-cc1ab0710248-delete_snapshot" released by "delete_snapshot" :: held 1.871s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:46:49 devstack sudo[102818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.551680fe-00ef-46cf-b378-fe0373c36b0a Aug 28 09:46:49 devstack sudo[102818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:50 devstack sudo[102818]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1ead1b43-11e6-4f93-b82e-525eced5e511 tempest-VolumesSnapshotListTestJSON-747565511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.551680fe-00ef-46cf-b378-fe0373c36b0a" returned: 0 in 0.260s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:50 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-7687bddf-e494-4c06-904f-94e3df2ebb58 tempest-SnapshotDependencyTests-2011846907 None] Acquiring lock "cinder-4159242e-86e9-4c19-8606-77bd49fbdf5d-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:46:50 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-7687bddf-e494-4c06-904f-94e3df2ebb58 tempest-SnapshotDependencyTests-2011846907 None] Lock "cinder-4159242e-86e9-4c19-8606-77bd49fbdf5d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:46:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1ead1b43-11e6-4f93-b82e-525eced5e511 tempest-VolumesSnapshotListTestJSON-747565511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:50 devstack sudo[102821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.info Aug 28 09:46:50 devstack sudo[102821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:50 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-7687bddf-e494-4c06-904f-94e3df2ebb58 tempest-SnapshotDependencyTests-2011846907 None] Acquiring lock "cinder-quobyte-4159242e-86e9-4c19-8606-77bd49fbdf5d" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:46:50 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-7687bddf-e494-4c06-904f-94e3df2ebb58 tempest-SnapshotDependencyTests-2011846907 None] Lock "cinder-quobyte-4159242e-86e9-4c19-8606-77bd49fbdf5d" acquired by "delete_volume" :: waited 0.019s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:46:50 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a99c35d-667b-479f-b76f-3e058d49c263]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:46:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7687bddf-e494-4c06-904f-94e3df2ebb58 tempest-SnapshotDependencyTests-2011846907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:50 devstack sudo[102823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d Aug 28 09:46:50 devstack sudo[102823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:50 devstack sudo[102821]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1ead1b43-11e6-4f93-b82e-525eced5e511 tempest-VolumesSnapshotListTestJSON-747565511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.info" returned: 0 in 0.288s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:50 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-1ead1b43-11e6-4f93-b82e-525eced5e511 tempest-VolumesSnapshotListTestJSON-747565511 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.info is being set with open permissions: ugo+rw Aug 28 09:46:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1ead1b43-11e6-4f93-b82e-525eced5e511 tempest-VolumesSnapshotListTestJSON-747565511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:50 devstack sudo[102826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.info Aug 28 09:46:50 devstack sudo[102826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:50 devstack sudo[102823]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7687bddf-e494-4c06-904f-94e3df2ebb58 tempest-SnapshotDependencyTests-2011846907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d" returned: 0 in 0.395s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7687bddf-e494-4c06-904f-94e3df2ebb58 tempest-SnapshotDependencyTests-2011846907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:50 devstack sudo[102832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d Aug 28 09:46:50 devstack sudo[102832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:50 devstack sudo[102826]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1ead1b43-11e6-4f93-b82e-525eced5e511 tempest-VolumesSnapshotListTestJSON-747565511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.info" returned: 0 in 0.276s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-1ead1b43-11e6-4f93-b82e-525eced5e511 tempest-VolumesSnapshotListTestJSON-747565511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.111s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:46:50 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-1ead1b43-11e6-4f93-b82e-525eced5e511 tempest-VolumesSnapshotListTestJSON-747565511 None] Create snapshot completed successfully Aug 28 09:46:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e3ab2b07-0b1d-45bb-93a2-f3a37a6e7aba tempest-TestImageHashVerification-67088554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:46:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e3ab2b07-0b1d-45bb-93a2-f3a37a6e7aba tempest-TestImageHashVerification-67088554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:46:50 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98c4721-75cb-4e6c-b82e-2a7cbfdb9792]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:46:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e3ab2b07-0b1d-45bb-93a2-f3a37a6e7aba tempest-TestImageHashVerification-67088554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fedbb5a5-ce00-41cd-a63f-f28d118dadd7 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:50 devstack sudo[102832]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7687bddf-e494-4c06-904f-94e3df2ebb58 tempest-SnapshotDependencyTests-2011846907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4159242e-86e9-4c19-8606-77bd49fbdf5d" returned: 0 in 0.275s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:50 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-7687bddf-e494-4c06-904f-94e3df2ebb58 tempest-SnapshotDependencyTests-2011846907 None] Lock "cinder-quobyte-4159242e-86e9-4c19-8606-77bd49fbdf5d" released by "delete_volume" :: held 0.728s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:46:51 devstack sudo[102835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fedbb5a5-ce00-41cd-a63f-f28d118dadd7 Aug 28 09:46:51 devstack sudo[102835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:51 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-7687bddf-e494-4c06-904f-94e3df2ebb58 tempest-SnapshotDependencyTests-2011846907 None] Created reservations ['c2540469-9321-4fa8-98ae-41e7906562d0', '968125e9-2430-4c44-97cb-4985171edc49', 'de15f42f-9738-444e-ab6b-0e90b8db0a04', '45c9fc3c-09d7-4c8a-a652-1e58150665b4'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:46:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-7687bddf-e494-4c06-904f-94e3df2ebb58 tempest-SnapshotDependencyTests-2011846907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:46:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-7687bddf-e494-4c06-904f-94e3df2ebb58 tempest-SnapshotDependencyTests-2011846907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:46:51 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-7687bddf-e494-4c06-904f-94e3df2ebb58 tempest-SnapshotDependencyTests-2011846907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:46:51 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-7687bddf-e494-4c06-904f-94e3df2ebb58 tempest-SnapshotDependencyTests-2011846907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:46:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-7687bddf-e494-4c06-904f-94e3df2ebb58 tempest-SnapshotDependencyTests-2011846907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:46:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7687bddf-e494-4c06-904f-94e3df2ebb58 tempest-SnapshotDependencyTests-2011846907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:51 devstack sudo[102838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:46:51 devstack sudo[102838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:51 devstack sudo[102835]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e3ab2b07-0b1d-45bb-93a2-f3a37a6e7aba tempest-TestImageHashVerification-67088554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fedbb5a5-ce00-41cd-a63f-f28d118dadd7" returned: 0 in 0.408s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:51 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09b18e2-0e18-4f94-ae50-7655d1e27c70]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:46:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e3ab2b07-0b1d-45bb-93a2-f3a37a6e7aba tempest-TestImageHashVerification-67088554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fedbb5a5-ce00-41cd-a63f-f28d118dadd7 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:51 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2c6dd6c5-2f74-4c9f-b8d8-22b41198962a tempest-SnapshotDependencyTests-2011846907 None] Acquiring lock "cinder-2a27ba79-91a5-436f-8366-414e15988b1c-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:46:51 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2c6dd6c5-2f74-4c9f-b8d8-22b41198962a tempest-SnapshotDependencyTests-2011846907 None] Lock "cinder-2a27ba79-91a5-436f-8366-414e15988b1c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:46:51 devstack sudo[102838]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7687bddf-e494-4c06-904f-94e3df2ebb58 tempest-SnapshotDependencyTests-2011846907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.299s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:51 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-7687bddf-e494-4c06-904f-94e3df2ebb58 tempest-SnapshotDependencyTests-2011846907 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:46:51 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2c6dd6c5-2f74-4c9f-b8d8-22b41198962a tempest-SnapshotDependencyTests-2011846907 None] Acquiring lock "cinder-quobyte-2a27ba79-91a5-436f-8366-414e15988b1c" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:46:51 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-7687bddf-e494-4c06-904f-94e3df2ebb58 tempest-SnapshotDependencyTests-2011846907 None] Deleted volume successfully. Aug 28 09:46:51 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2c6dd6c5-2f74-4c9f-b8d8-22b41198962a tempest-SnapshotDependencyTests-2011846907 None] Lock "cinder-quobyte-2a27ba79-91a5-436f-8366-414e15988b1c" acquired by "delete_volume" :: waited 0.030s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:46:51 devstack sudo[102844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fedbb5a5-ce00-41cd-a63f-f28d118dadd7 Aug 28 09:46:51 devstack sudo[102844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:51 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-7687bddf-e494-4c06-904f-94e3df2ebb58 tempest-SnapshotDependencyTests-2011846907 None] Lock "cinder-4159242e-86e9-4c19-8606-77bd49fbdf5d-delete_volume" released by "delete_volume" :: held 1.302s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:46:51 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[350d3092-e311-4e5e-894e-e631a844bcee]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:46:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2c6dd6c5-2f74-4c9f-b8d8-22b41198962a tempest-SnapshotDependencyTests-2011846907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2a27ba79-91a5-436f-8366-414e15988b1c {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:51 devstack sudo[102847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2a27ba79-91a5-436f-8366-414e15988b1c Aug 28 09:46:51 devstack sudo[102847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-7fe20893-abfd-4a12-97ae-b5fb978a68ed tempest-VolumesSnapshotListTestJSON-747565511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:46:51 devstack sudo[102844]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e3ab2b07-0b1d-45bb-93a2-f3a37a6e7aba tempest-TestImageHashVerification-67088554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fedbb5a5-ce00-41cd-a63f-f28d118dadd7" returned: 0 in 0.436s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e3ab2b07-0b1d-45bb-93a2-f3a37a6e7aba tempest-TestImageHashVerification-67088554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fedbb5a5-ce00-41cd-a63f-f28d118dadd7 /opt/stack/data/cinder/conversion/fedbb5a5-ce00-41cd-a63f-f28d118dadd7.temp_image.d26b2516-5966-4954-a397-14a6588b3d0dej3y3ylb.img {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:51 devstack sudo[102853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fedbb5a5-ce00-41cd-a63f-f28d118dadd7 /opt/stack/data/cinder/conversion/fedbb5a5-ce00-41cd-a63f-f28d118dadd7.temp_image.d26b2516-5966-4954-a397-14a6588b3d0dej3y3ylb.img Aug 28 09:46:51 devstack sudo[102853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:51 devstack sudo[102847]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2c6dd6c5-2f74-4c9f-b8d8-22b41198962a tempest-SnapshotDependencyTests-2011846907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2a27ba79-91a5-436f-8366-414e15988b1c" returned: 0 in 0.424s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2c6dd6c5-2f74-4c9f-b8d8-22b41198962a tempest-SnapshotDependencyTests-2011846907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2a27ba79-91a5-436f-8366-414e15988b1c {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:51 devstack sudo[102859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2a27ba79-91a5-436f-8366-414e15988b1c Aug 28 09:46:51 devstack sudo[102859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:52 devstack sudo[102859]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2c6dd6c5-2f74-4c9f-b8d8-22b41198962a tempest-SnapshotDependencyTests-2011846907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2a27ba79-91a5-436f-8366-414e15988b1c" returned: 0 in 0.343s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:52 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2c6dd6c5-2f74-4c9f-b8d8-22b41198962a tempest-SnapshotDependencyTests-2011846907 None] Lock "cinder-quobyte-2a27ba79-91a5-436f-8366-414e15988b1c" released by "delete_volume" :: held 0.836s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:46:52 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-2c6dd6c5-2f74-4c9f-b8d8-22b41198962a tempest-SnapshotDependencyTests-2011846907 None] Created reservations ['113ae28e-d346-4437-a41c-651b216bb8e8', '6c2486df-f8d7-4b98-9c76-e1a8ee0aee8b', 'ed9335b1-9d38-498b-967b-544e768350d4', 'da12643d-6975-4fba-8f42-5b9215792c38'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:46:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-2c6dd6c5-2f74-4c9f-b8d8-22b41198962a tempest-SnapshotDependencyTests-2011846907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:46:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-2c6dd6c5-2f74-4c9f-b8d8-22b41198962a tempest-SnapshotDependencyTests-2011846907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:46:52 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-2c6dd6c5-2f74-4c9f-b8d8-22b41198962a tempest-SnapshotDependencyTests-2011846907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:46:52 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-2c6dd6c5-2f74-4c9f-b8d8-22b41198962a tempest-SnapshotDependencyTests-2011846907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:46:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-2c6dd6c5-2f74-4c9f-b8d8-22b41198962a tempest-SnapshotDependencyTests-2011846907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:46:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2c6dd6c5-2f74-4c9f-b8d8-22b41198962a tempest-SnapshotDependencyTests-2011846907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:52 devstack sudo[102872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:46:52 devstack sudo[102872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:53 devstack sudo[102872]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2c6dd6c5-2f74-4c9f-b8d8-22b41198962a tempest-SnapshotDependencyTests-2011846907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.487s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:53 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-2c6dd6c5-2f74-4c9f-b8d8-22b41198962a tempest-SnapshotDependencyTests-2011846907 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:46:53 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-2c6dd6c5-2f74-4c9f-b8d8-22b41198962a tempest-SnapshotDependencyTests-2011846907 None] Deleted volume successfully. Aug 28 09:46:53 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2c6dd6c5-2f74-4c9f-b8d8-22b41198962a tempest-SnapshotDependencyTests-2011846907 None] Lock "cinder-2a27ba79-91a5-436f-8366-414e15988b1c-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:46:56 devstack sudo[102853]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e3ab2b07-0b1d-45bb-93a2-f3a37a6e7aba tempest-TestImageHashVerification-67088554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fedbb5a5-ce00-41cd-a63f-f28d118dadd7 /opt/stack/data/cinder/conversion/fedbb5a5-ce00-41cd-a63f-f28d118dadd7.temp_image.d26b2516-5966-4954-a397-14a6588b3d0dej3y3ylb.img" returned: 0 in 4.690s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:56 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[02765d95-009b-470a-a678-7369bd237dd9]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:46:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e3ab2b07-0b1d-45bb-93a2-f3a37a6e7aba tempest-TestImageHashVerification-67088554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fedbb5a5-ce00-41cd-a63f-f28d118dadd7 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:46:56 devstack sudo[102876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fedbb5a5-ce00-41cd-a63f-f28d118dadd7 Aug 28 09:46:56 devstack sudo[102876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:46:57 devstack sudo[102876]: pam_unix(sudo:session): session closed for user root Aug 28 09:46:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e3ab2b07-0b1d-45bb-93a2-f3a37a6e7aba tempest-TestImageHashVerification-67088554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fedbb5a5-ce00-41cd-a63f-f28d118dadd7" returned: 0 in 0.535s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:46:57 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-e3ab2b07-0b1d-45bb-93a2-f3a37a6e7aba tempest-TestImageHashVerification-67088554 None] Image conversion details: src /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fedbb5a5-ce00-41cd-a63f-f28d118dadd7, size 1024.00 MB, duration 4.69 sec, destination /opt/stack/data/cinder/conversion/fedbb5a5-ce00-41cd-a63f-f28d118dadd7.temp_image.d26b2516-5966-4954-a397-14a6588b3d0dej3y3ylb.img {{(pid=86081) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 09:46:57 devstack cinder-volume[86081]: INFO cinder.image.image_utils [None req-e3ab2b07-0b1d-45bb-93a2-f3a37a6e7aba tempest-TestImageHashVerification-67088554 None] Converted 1024.00 MB image at 218.31 MB/s Aug 28 09:46:57 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-e3ab2b07-0b1d-45bb-93a2-f3a37a6e7aba tempest-TestImageHashVerification-67088554 None] d26b2516-5966-4954-a397-14a6588b3d0d was raw, no need to convert to raw {{(pid=86081) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 28 09:47:07 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writing DB stats cinder:SELECT=20,cinder:UPDATE=35,cinder:DELETE=3,cinder:INSERT=6 {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:47:07 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writing DB stats cinder:SELECT=34,cinder:INSERT=10,cinder:UPDATE=29,cinder:DELETE=3 {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:47:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e3ab2b07-0b1d-45bb-93a2-f3a37a6e7aba tempest-TestImageHashVerification-67088554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.637s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:47:16 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e3ab2b07-0b1d-45bb-93a2-f3a37a6e7aba tempest-TestImageHashVerification-67088554 None] Uploaded volume to glance image-id: d26b2516-5966-4954-a397-14a6588b3d0d. {{(pid=86081) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 28 09:47:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-7fe20893-abfd-4a12-97ae-b5fb978a68ed tempest-VolumesSnapshotListTestJSON-747565511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 24.790s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:47:16 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-7fe20893-abfd-4a12-97ae-b5fb978a68ed tempest-VolumesSnapshotListTestJSON-747565511 None] Creating offline snapshot 7ac30c1c-d1e8-48f0-950d-49dc315509e1 of volume c45e9792-2cb2-4406-9da0-ff901d805195 {{(pid=86081) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:47:16 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-e3ab2b07-0b1d-45bb-93a2-f3a37a6e7aba tempest-TestImageHashVerification-67088554 None] Copy volume to image completed successfully. Aug 28 09:47:16 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[27af37d5-e1e2-4a9e-a75b-449e874c677b]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:47:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7fe20893-abfd-4a12-97ae-b5fb978a68ed tempest-VolumesSnapshotListTestJSON-747565511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.551680fe-00ef-46cf-b378-fe0373c36b0a {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:16 devstack sudo[102931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.551680fe-00ef-46cf-b378-fe0373c36b0a Aug 28 09:47:16 devstack sudo[102931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:16 devstack sudo[102931]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7fe20893-abfd-4a12-97ae-b5fb978a68ed tempest-VolumesSnapshotListTestJSON-747565511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.551680fe-00ef-46cf-b378-fe0373c36b0a" returned: 0 in 0.359s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:16 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-7fe20893-abfd-4a12-97ae-b5fb978a68ed tempest-VolumesSnapshotListTestJSON-747565511 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c45e9792-2cb2-4406-9da0-ff901d805195(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:47:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7fe20893-abfd-4a12-97ae-b5fb978a68ed tempest-VolumesSnapshotListTestJSON-747565511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.551680fe-00ef-46cf-b378-fe0373c36b0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.7ac30c1c-d1e8-48f0-950d-49dc315509e1 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:16 devstack sudo[102936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.551680fe-00ef-46cf-b378-fe0373c36b0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.7ac30c1c-d1e8-48f0-950d-49dc315509e1 1G Aug 28 09:47:16 devstack sudo[102936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:17 devstack sudo[102936]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7fe20893-abfd-4a12-97ae-b5fb978a68ed tempest-VolumesSnapshotListTestJSON-747565511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.551680fe-00ef-46cf-b378-fe0373c36b0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.7ac30c1c-d1e8-48f0-950d-49dc315509e1 1G" returned: 0 in 0.424s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7fe20893-abfd-4a12-97ae-b5fb978a68ed tempest-VolumesSnapshotListTestJSON-747565511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c45e9792-2cb2-4406-9da0-ff901d805195.551680fe-00ef-46cf-b378-fe0373c36b0a -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.7ac30c1c-d1e8-48f0-950d-49dc315509e1 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:17 devstack sudo[102941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c45e9792-2cb2-4406-9da0-ff901d805195.551680fe-00ef-46cf-b378-fe0373c36b0a -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.7ac30c1c-d1e8-48f0-950d-49dc315509e1 Aug 28 09:47:17 devstack sudo[102941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:17 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a91cf56f-542d-4a5c-b231-e9f6eaa46a08 tempest-TestImageHashVerification-67088554 None] Acquiring lock "cinder-fedbb5a5-ce00-41cd-a63f-f28d118dadd7-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:47:17 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a91cf56f-542d-4a5c-b231-e9f6eaa46a08 tempest-TestImageHashVerification-67088554 None] Lock "cinder-fedbb5a5-ce00-41cd-a63f-f28d118dadd7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:47:17 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a91cf56f-542d-4a5c-b231-e9f6eaa46a08 tempest-TestImageHashVerification-67088554 None] Acquiring lock "cinder-quobyte-fedbb5a5-ce00-41cd-a63f-f28d118dadd7" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:47:17 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a91cf56f-542d-4a5c-b231-e9f6eaa46a08 tempest-TestImageHashVerification-67088554 None] Lock "cinder-quobyte-fedbb5a5-ce00-41cd-a63f-f28d118dadd7" acquired by "delete_volume" :: waited 0.020s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:47:17 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b836757-c2e3-4b6c-9b1d-5ebc142e38f3]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:47:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a91cf56f-542d-4a5c-b231-e9f6eaa46a08 tempest-TestImageHashVerification-67088554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fedbb5a5-ce00-41cd-a63f-f28d118dadd7 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:17 devstack sudo[102941]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7fe20893-abfd-4a12-97ae-b5fb978a68ed tempest-VolumesSnapshotListTestJSON-747565511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c45e9792-2cb2-4406-9da0-ff901d805195.551680fe-00ef-46cf-b378-fe0373c36b0a -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.7ac30c1c-d1e8-48f0-950d-49dc315509e1" returned: 0 in 0.299s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:17 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-7fe20893-abfd-4a12-97ae-b5fb978a68ed tempest-VolumesSnapshotListTestJSON-747565511 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.7ac30c1c-d1e8-48f0-950d-49dc315509e1 is being set with open permissions: ugo+rw Aug 28 09:47:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7fe20893-abfd-4a12-97ae-b5fb978a68ed tempest-VolumesSnapshotListTestJSON-747565511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.7ac30c1c-d1e8-48f0-950d-49dc315509e1 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:17 devstack sudo[102948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.7ac30c1c-d1e8-48f0-950d-49dc315509e1 Aug 28 09:47:17 devstack sudo[102948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:17 devstack sudo[102946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fedbb5a5-ce00-41cd-a63f-f28d118dadd7 Aug 28 09:47:17 devstack sudo[102946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:17 devstack sudo[102948]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7fe20893-abfd-4a12-97ae-b5fb978a68ed tempest-VolumesSnapshotListTestJSON-747565511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.7ac30c1c-d1e8-48f0-950d-49dc315509e1" returned: 0 in 0.257s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-7fe20893-abfd-4a12-97ae-b5fb978a68ed tempest-VolumesSnapshotListTestJSON-747565511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.441s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:47:17 devstack sudo[102946]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a91cf56f-542d-4a5c-b231-e9f6eaa46a08 tempest-TestImageHashVerification-67088554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fedbb5a5-ce00-41cd-a63f-f28d118dadd7" returned: 0 in 0.370s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a91cf56f-542d-4a5c-b231-e9f6eaa46a08 tempest-TestImageHashVerification-67088554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fedbb5a5-ce00-41cd-a63f-f28d118dadd7 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:18 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-7fe20893-abfd-4a12-97ae-b5fb978a68ed tempest-VolumesSnapshotListTestJSON-747565511 None] Create snapshot completed successfully Aug 28 09:47:18 devstack sudo[102955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fedbb5a5-ce00-41cd-a63f-f28d118dadd7 Aug 28 09:47:18 devstack sudo[102955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:18 devstack sudo[102955]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a91cf56f-542d-4a5c-b231-e9f6eaa46a08 tempest-TestImageHashVerification-67088554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-fedbb5a5-ce00-41cd-a63f-f28d118dadd7" returned: 0 in 0.247s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:18 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a91cf56f-542d-4a5c-b231-e9f6eaa46a08 tempest-TestImageHashVerification-67088554 None] Lock "cinder-quobyte-fedbb5a5-ce00-41cd-a63f-f28d118dadd7" released by "delete_volume" :: held 0.653s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:47:18 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-a91cf56f-542d-4a5c-b231-e9f6eaa46a08 tempest-TestImageHashVerification-67088554 None] Created reservations ['8fb1e2c2-7e0d-4f28-bf4c-91dcc72f350b', 'aecdcbe5-6d67-4718-bfed-53b10ee5d634', 'e4c0632a-048a-4dad-a768-5a56071756ed', '439fbfbe-205d-4091-808e-4144537135e9'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:47:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a91cf56f-542d-4a5c-b231-e9f6eaa46a08 tempest-TestImageHashVerification-67088554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:47:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a91cf56f-542d-4a5c-b231-e9f6eaa46a08 tempest-TestImageHashVerification-67088554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:47:18 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-a91cf56f-542d-4a5c-b231-e9f6eaa46a08 tempest-TestImageHashVerification-67088554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:47:18 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-a91cf56f-542d-4a5c-b231-e9f6eaa46a08 tempest-TestImageHashVerification-67088554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:47:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a91cf56f-542d-4a5c-b231-e9f6eaa46a08 tempest-TestImageHashVerification-67088554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:47:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a91cf56f-542d-4a5c-b231-e9f6eaa46a08 tempest-TestImageHashVerification-67088554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:18 devstack sudo[102958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:47:18 devstack sudo[102958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:18 devstack sudo[102958]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a91cf56f-542d-4a5c-b231-e9f6eaa46a08 tempest-TestImageHashVerification-67088554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.237s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:18 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-a91cf56f-542d-4a5c-b231-e9f6eaa46a08 tempest-TestImageHashVerification-67088554 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:47:18 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-a91cf56f-542d-4a5c-b231-e9f6eaa46a08 tempest-TestImageHashVerification-67088554 None] Deleted volume successfully. Aug 28 09:47:18 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a91cf56f-542d-4a5c-b231-e9f6eaa46a08 tempest-TestImageHashVerification-67088554 None] Lock "cinder-fedbb5a5-ce00-41cd-a63f-f28d118dadd7-delete_volume" released by "delete_volume" :: held 1.095s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:47:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-692556f7-ace5-4bdf-8682-034554cd142e tempest-VolumesSnapshotListTestJSON-747565511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:47:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-692556f7-ace5-4bdf-8682-034554cd142e tempest-VolumesSnapshotListTestJSON-747565511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:47:19 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-692556f7-ace5-4bdf-8682-034554cd142e tempest-VolumesSnapshotListTestJSON-747565511 None] Creating offline snapshot e608563c-4071-447a-8294-3bd7038123e6 of volume c45e9792-2cb2-4406-9da0-ff901d805195 {{(pid=86081) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:47:19 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d50065-5002-4fe4-b02e-a744f3a260cc]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:47:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-692556f7-ace5-4bdf-8682-034554cd142e tempest-VolumesSnapshotListTestJSON-747565511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.7ac30c1c-d1e8-48f0-950d-49dc315509e1 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:19 devstack sudo[102963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.7ac30c1c-d1e8-48f0-950d-49dc315509e1 Aug 28 09:47:19 devstack sudo[102963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:19 devstack sudo[102963]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-692556f7-ace5-4bdf-8682-034554cd142e tempest-VolumesSnapshotListTestJSON-747565511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.7ac30c1c-d1e8-48f0-950d-49dc315509e1" returned: 0 in 0.410s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:19 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-692556f7-ace5-4bdf-8682-034554cd142e tempest-VolumesSnapshotListTestJSON-747565511 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c45e9792-2cb2-4406-9da0-ff901d805195(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:47:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-692556f7-ace5-4bdf-8682-034554cd142e tempest-VolumesSnapshotListTestJSON-747565511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.7ac30c1c-d1e8-48f0-950d-49dc315509e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.e608563c-4071-447a-8294-3bd7038123e6 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:19 devstack sudo[102969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.7ac30c1c-d1e8-48f0-950d-49dc315509e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.e608563c-4071-447a-8294-3bd7038123e6 1G Aug 28 09:47:19 devstack sudo[102969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:20 devstack sudo[102969]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-692556f7-ace5-4bdf-8682-034554cd142e tempest-VolumesSnapshotListTestJSON-747565511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.7ac30c1c-d1e8-48f0-950d-49dc315509e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.e608563c-4071-447a-8294-3bd7038123e6 1G" returned: 0 in 0.497s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-692556f7-ace5-4bdf-8682-034554cd142e tempest-VolumesSnapshotListTestJSON-747565511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c45e9792-2cb2-4406-9da0-ff901d805195.7ac30c1c-d1e8-48f0-950d-49dc315509e1 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.e608563c-4071-447a-8294-3bd7038123e6 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:20 devstack sudo[102975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c45e9792-2cb2-4406-9da0-ff901d805195.7ac30c1c-d1e8-48f0-950d-49dc315509e1 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.e608563c-4071-447a-8294-3bd7038123e6 Aug 28 09:47:20 devstack sudo[102975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:20 devstack sudo[102975]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-692556f7-ace5-4bdf-8682-034554cd142e tempest-VolumesSnapshotListTestJSON-747565511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c45e9792-2cb2-4406-9da0-ff901d805195.7ac30c1c-d1e8-48f0-950d-49dc315509e1 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.e608563c-4071-447a-8294-3bd7038123e6" returned: 0 in 0.327s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:20 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-692556f7-ace5-4bdf-8682-034554cd142e tempest-VolumesSnapshotListTestJSON-747565511 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.e608563c-4071-447a-8294-3bd7038123e6 is being set with open permissions: ugo+rw Aug 28 09:47:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-692556f7-ace5-4bdf-8682-034554cd142e tempest-VolumesSnapshotListTestJSON-747565511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.e608563c-4071-447a-8294-3bd7038123e6 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:20 devstack sudo[102982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.e608563c-4071-447a-8294-3bd7038123e6 Aug 28 09:47:20 devstack sudo[102982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:20 devstack sudo[102982]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-692556f7-ace5-4bdf-8682-034554cd142e tempest-VolumesSnapshotListTestJSON-747565511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.e608563c-4071-447a-8294-3bd7038123e6" returned: 0 in 0.248s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-692556f7-ace5-4bdf-8682-034554cd142e tempest-VolumesSnapshotListTestJSON-747565511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.583s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:47:20 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-692556f7-ace5-4bdf-8682-034554cd142e tempest-VolumesSnapshotListTestJSON-747565511 None] Create snapshot completed successfully Aug 28 09:47:21 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2c138005-6c3c-4f5d-8fd9-609199da05fd tempest-VolumesSnapshotListTestJSON-747565511 None] Acquiring lock "cinder-e608563c-4071-447a-8294-3bd7038123e6-delete_snapshot" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:47:21 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2c138005-6c3c-4f5d-8fd9-609199da05fd tempest-VolumesSnapshotListTestJSON-747565511 None] Lock "cinder-e608563c-4071-447a-8294-3bd7038123e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:47:21 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2c138005-6c3c-4f5d-8fd9-609199da05fd tempest-VolumesSnapshotListTestJSON-747565511 None] Acquiring lock "cinder-quobyte-c45e9792-2cb2-4406-9da0-ff901d805195" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:47:21 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2c138005-6c3c-4f5d-8fd9-609199da05fd tempest-VolumesSnapshotListTestJSON-747565511 None] Lock "cinder-quobyte-c45e9792-2cb2-4406-9da0-ff901d805195" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:47:21 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2c138005-6c3c-4f5d-8fd9-609199da05fd tempest-VolumesSnapshotListTestJSON-747565511 None] Acquiring lock "cinder-quobyte-e608563c-4071-447a-8294-3bd7038123e6" by "_delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:47:22 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2c138005-6c3c-4f5d-8fd9-609199da05fd tempest-VolumesSnapshotListTestJSON-747565511 None] Lock "cinder-quobyte-e608563c-4071-447a-8294-3bd7038123e6" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:47:22 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-2c138005-6c3c-4f5d-8fd9-609199da05fd tempest-VolumesSnapshotListTestJSON-747565511 None] Deleting offline snapshot e608563c-4071-447a-8294-3bd7038123e6 of volume c45e9792-2cb2-4406-9da0-ff901d805195 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:47:22 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-2c138005-6c3c-4f5d-8fd9-609199da05fd tempest-VolumesSnapshotListTestJSON-747565511 None] snapshot_file for this snap is: volume-c45e9792-2cb2-4406-9da0-ff901d805195.e608563c-4071-447a-8294-3bd7038123e6 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:47:22 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09d5916-b2d7-4891-a6fd-e2d256feb154]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:47:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2c138005-6c3c-4f5d-8fd9-609199da05fd tempest-VolumesSnapshotListTestJSON-747565511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.e608563c-4071-447a-8294-3bd7038123e6 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:22 devstack sudo[102985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.e608563c-4071-447a-8294-3bd7038123e6 Aug 28 09:47:22 devstack sudo[102985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:22 devstack sudo[102985]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2c138005-6c3c-4f5d-8fd9-609199da05fd tempest-VolumesSnapshotListTestJSON-747565511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.e608563c-4071-447a-8294-3bd7038123e6" returned: 0 in 0.408s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:22 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-2c138005-6c3c-4f5d-8fd9-609199da05fd tempest-VolumesSnapshotListTestJSON-747565511 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c45e9792-2cb2-4406-9da0-ff901d805195(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:47:22 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[12877e2e-c188-4a37-ad2b-97f0f914d491]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:47:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2c138005-6c3c-4f5d-8fd9-609199da05fd tempest-VolumesSnapshotListTestJSON-747565511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.7ac30c1c-d1e8-48f0-950d-49dc315509e1 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:22 devstack sudo[102990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.7ac30c1c-d1e8-48f0-950d-49dc315509e1 Aug 28 09:47:22 devstack sudo[102990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:22 devstack sudo[102990]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2c138005-6c3c-4f5d-8fd9-609199da05fd tempest-VolumesSnapshotListTestJSON-747565511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.7ac30c1c-d1e8-48f0-950d-49dc315509e1" returned: 0 in 0.365s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:22 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-2c138005-6c3c-4f5d-8fd9-609199da05fd tempest-VolumesSnapshotListTestJSON-747565511 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c45e9792-2cb2-4406-9da0-ff901d805195(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:47:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2c138005-6c3c-4f5d-8fd9-609199da05fd tempest-VolumesSnapshotListTestJSON-747565511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.e608563c-4071-447a-8294-3bd7038123e6 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:22 devstack sudo[102995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.e608563c-4071-447a-8294-3bd7038123e6 Aug 28 09:47:22 devstack sudo[102995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:23 devstack sudo[102995]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2c138005-6c3c-4f5d-8fd9-609199da05fd tempest-VolumesSnapshotListTestJSON-747565511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.e608563c-4071-447a-8294-3bd7038123e6" returned: 0 in 0.427s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2c138005-6c3c-4f5d-8fd9-609199da05fd tempest-VolumesSnapshotListTestJSON-747565511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.e608563c-4071-447a-8294-3bd7038123e6 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:23 devstack sudo[103002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.e608563c-4071-447a-8294-3bd7038123e6 Aug 28 09:47:23 devstack sudo[103002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:23 devstack sudo[103002]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2c138005-6c3c-4f5d-8fd9-609199da05fd tempest-VolumesSnapshotListTestJSON-747565511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.e608563c-4071-447a-8294-3bd7038123e6" returned: 0 in 0.253s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:23 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2c138005-6c3c-4f5d-8fd9-609199da05fd tempest-VolumesSnapshotListTestJSON-747565511 None] Lock "cinder-quobyte-e608563c-4071-447a-8294-3bd7038123e6" released by "_delete_snapshot" :: held 1.553s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:47:23 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2c138005-6c3c-4f5d-8fd9-609199da05fd tempest-VolumesSnapshotListTestJSON-747565511 None] Lock "cinder-quobyte-c45e9792-2cb2-4406-9da0-ff901d805195" released by "delete_snapshot" :: held 1.582s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:47:23 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-2c138005-6c3c-4f5d-8fd9-609199da05fd tempest-VolumesSnapshotListTestJSON-747565511 None] Created reservations ['d7853293-fc72-43fc-9697-2c07fade0d9e', 'bea1026c-55bd-4867-9a5c-bbf5c43c1523', 'd9690ede-3ed8-40bb-a11b-2ec30332240d', '33aa000e-2807-4499-8a05-d3b7f3718d90'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:47:23 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-2c138005-6c3c-4f5d-8fd9-609199da05fd tempest-VolumesSnapshotListTestJSON-747565511 None] Delete snapshot completed successfully. Aug 28 09:47:23 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2c138005-6c3c-4f5d-8fd9-609199da05fd tempest-VolumesSnapshotListTestJSON-747565511 None] Lock "cinder-e608563c-4071-447a-8294-3bd7038123e6-delete_snapshot" released by "delete_snapshot" :: held 1.721s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:47:24 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-28c420aa-e9c9-45f4-938d-b7bd94595625 tempest-VolumesSnapshotListTestJSON-747565511 None] Acquiring lock "cinder-7ac30c1c-d1e8-48f0-950d-49dc315509e1-delete_snapshot" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:47:24 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-28c420aa-e9c9-45f4-938d-b7bd94595625 tempest-VolumesSnapshotListTestJSON-747565511 None] Lock "cinder-7ac30c1c-d1e8-48f0-950d-49dc315509e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:47:24 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-28c420aa-e9c9-45f4-938d-b7bd94595625 tempest-VolumesSnapshotListTestJSON-747565511 None] Acquiring lock "cinder-quobyte-c45e9792-2cb2-4406-9da0-ff901d805195" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:47:24 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-28c420aa-e9c9-45f4-938d-b7bd94595625 tempest-VolumesSnapshotListTestJSON-747565511 None] Lock "cinder-quobyte-c45e9792-2cb2-4406-9da0-ff901d805195" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:47:24 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-28c420aa-e9c9-45f4-938d-b7bd94595625 tempest-VolumesSnapshotListTestJSON-747565511 None] Acquiring lock "cinder-quobyte-7ac30c1c-d1e8-48f0-950d-49dc315509e1" by "_delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:47:24 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-28c420aa-e9c9-45f4-938d-b7bd94595625 tempest-VolumesSnapshotListTestJSON-747565511 None] Lock "cinder-quobyte-7ac30c1c-d1e8-48f0-950d-49dc315509e1" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:47:24 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-28c420aa-e9c9-45f4-938d-b7bd94595625 tempest-VolumesSnapshotListTestJSON-747565511 None] Deleting offline snapshot 7ac30c1c-d1e8-48f0-950d-49dc315509e1 of volume c45e9792-2cb2-4406-9da0-ff901d805195 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:47:24 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-28c420aa-e9c9-45f4-938d-b7bd94595625 tempest-VolumesSnapshotListTestJSON-747565511 None] snapshot_file for this snap is: volume-c45e9792-2cb2-4406-9da0-ff901d805195.7ac30c1c-d1e8-48f0-950d-49dc315509e1 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:47:24 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f04d578-cdcd-4fe9-83fc-d46e39f37bc0]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:47:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-28c420aa-e9c9-45f4-938d-b7bd94595625 tempest-VolumesSnapshotListTestJSON-747565511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.7ac30c1c-d1e8-48f0-950d-49dc315509e1 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:24 devstack sudo[103005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.7ac30c1c-d1e8-48f0-950d-49dc315509e1 Aug 28 09:47:24 devstack sudo[103005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:24 devstack sudo[103005]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-28c420aa-e9c9-45f4-938d-b7bd94595625 tempest-VolumesSnapshotListTestJSON-747565511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.7ac30c1c-d1e8-48f0-950d-49dc315509e1" returned: 0 in 0.377s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:24 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-28c420aa-e9c9-45f4-938d-b7bd94595625 tempest-VolumesSnapshotListTestJSON-747565511 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c45e9792-2cb2-4406-9da0-ff901d805195(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:47:24 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[83411002-09d5-4ec8-87af-d19927455308]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:47:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-28c420aa-e9c9-45f4-938d-b7bd94595625 tempest-VolumesSnapshotListTestJSON-747565511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.551680fe-00ef-46cf-b378-fe0373c36b0a {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:24 devstack sudo[103011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.551680fe-00ef-46cf-b378-fe0373c36b0a Aug 28 09:47:24 devstack sudo[103011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:24 devstack sudo[103011]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-28c420aa-e9c9-45f4-938d-b7bd94595625 tempest-VolumesSnapshotListTestJSON-747565511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.551680fe-00ef-46cf-b378-fe0373c36b0a" returned: 0 in 0.346s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:24 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-28c420aa-e9c9-45f4-938d-b7bd94595625 tempest-VolumesSnapshotListTestJSON-747565511 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c45e9792-2cb2-4406-9da0-ff901d805195(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:47:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-28c420aa-e9c9-45f4-938d-b7bd94595625 tempest-VolumesSnapshotListTestJSON-747565511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.7ac30c1c-d1e8-48f0-950d-49dc315509e1 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:24 devstack sudo[103017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.7ac30c1c-d1e8-48f0-950d-49dc315509e1 Aug 28 09:47:24 devstack sudo[103017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:25 devstack sudo[103017]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-28c420aa-e9c9-45f4-938d-b7bd94595625 tempest-VolumesSnapshotListTestJSON-747565511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.7ac30c1c-d1e8-48f0-950d-49dc315509e1" returned: 0 in 0.406s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-28c420aa-e9c9-45f4-938d-b7bd94595625 tempest-VolumesSnapshotListTestJSON-747565511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.7ac30c1c-d1e8-48f0-950d-49dc315509e1 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:25 devstack sudo[103023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.7ac30c1c-d1e8-48f0-950d-49dc315509e1 Aug 28 09:47:25 devstack sudo[103023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:25 devstack sudo[103023]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-28c420aa-e9c9-45f4-938d-b7bd94595625 tempest-VolumesSnapshotListTestJSON-747565511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.7ac30c1c-d1e8-48f0-950d-49dc315509e1" returned: 0 in 0.275s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:25 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-28c420aa-e9c9-45f4-938d-b7bd94595625 tempest-VolumesSnapshotListTestJSON-747565511 None] Lock "cinder-quobyte-7ac30c1c-d1e8-48f0-950d-49dc315509e1" released by "_delete_snapshot" :: held 1.497s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:47:25 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-28c420aa-e9c9-45f4-938d-b7bd94595625 tempest-VolumesSnapshotListTestJSON-747565511 None] Lock "cinder-quobyte-c45e9792-2cb2-4406-9da0-ff901d805195" released by "delete_snapshot" :: held 1.518s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:47:25 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-28c420aa-e9c9-45f4-938d-b7bd94595625 tempest-VolumesSnapshotListTestJSON-747565511 None] Created reservations ['0aa67b8c-a763-4773-a9e6-e3748bf59151', 'fdc858b7-be02-4bdd-afb8-695daeb25b59', '5c2c9cc8-48fd-4c8f-97d4-3cd75141cc51', 'eb9d09e7-f575-4369-8f37-57f8e9cbccd5'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:47:25 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-28c420aa-e9c9-45f4-938d-b7bd94595625 tempest-VolumesSnapshotListTestJSON-747565511 None] Delete snapshot completed successfully. Aug 28 09:47:25 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-28c420aa-e9c9-45f4-938d-b7bd94595625 tempest-VolumesSnapshotListTestJSON-747565511 None] Lock "cinder-7ac30c1c-d1e8-48f0-950d-49dc315509e1-delete_snapshot" released by "delete_snapshot" :: held 1.645s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:47:26 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8f8bcc03-31cb-4fed-8971-173bb8128260 tempest-VolumesSnapshotListTestJSON-747565511 None] Acquiring lock "cinder-551680fe-00ef-46cf-b378-fe0373c36b0a-delete_snapshot" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:47:26 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8f8bcc03-31cb-4fed-8971-173bb8128260 tempest-VolumesSnapshotListTestJSON-747565511 None] Lock "cinder-551680fe-00ef-46cf-b378-fe0373c36b0a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:47:26 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8f8bcc03-31cb-4fed-8971-173bb8128260 tempest-VolumesSnapshotListTestJSON-747565511 None] Acquiring lock "cinder-quobyte-c45e9792-2cb2-4406-9da0-ff901d805195" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:47:26 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8f8bcc03-31cb-4fed-8971-173bb8128260 tempest-VolumesSnapshotListTestJSON-747565511 None] Lock "cinder-quobyte-c45e9792-2cb2-4406-9da0-ff901d805195" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:47:26 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8f8bcc03-31cb-4fed-8971-173bb8128260 tempest-VolumesSnapshotListTestJSON-747565511 None] Acquiring lock "cinder-quobyte-551680fe-00ef-46cf-b378-fe0373c36b0a" by "_delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:47:26 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8f8bcc03-31cb-4fed-8971-173bb8128260 tempest-VolumesSnapshotListTestJSON-747565511 None] Lock "cinder-quobyte-551680fe-00ef-46cf-b378-fe0373c36b0a" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:47:26 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-8f8bcc03-31cb-4fed-8971-173bb8128260 tempest-VolumesSnapshotListTestJSON-747565511 None] Deleting offline snapshot 551680fe-00ef-46cf-b378-fe0373c36b0a of volume c45e9792-2cb2-4406-9da0-ff901d805195 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:47:26 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-8f8bcc03-31cb-4fed-8971-173bb8128260 tempest-VolumesSnapshotListTestJSON-747565511 None] snapshot_file for this snap is: volume-c45e9792-2cb2-4406-9da0-ff901d805195.551680fe-00ef-46cf-b378-fe0373c36b0a {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:47:26 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[770628f0-c19f-4bde-9dcd-1966f4333b90]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:47:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8f8bcc03-31cb-4fed-8971-173bb8128260 tempest-VolumesSnapshotListTestJSON-747565511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.551680fe-00ef-46cf-b378-fe0373c36b0a {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:26 devstack sudo[103026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.551680fe-00ef-46cf-b378-fe0373c36b0a Aug 28 09:47:26 devstack sudo[103026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:26 devstack sudo[103026]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8f8bcc03-31cb-4fed-8971-173bb8128260 tempest-VolumesSnapshotListTestJSON-747565511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.551680fe-00ef-46cf-b378-fe0373c36b0a" returned: 0 in 0.416s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:26 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-8f8bcc03-31cb-4fed-8971-173bb8128260 tempest-VolumesSnapshotListTestJSON-747565511 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c45e9792-2cb2-4406-9da0-ff901d805195(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:47:26 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb54499b-21c3-4bc1-b9dc-36f636729fc4]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:47:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8f8bcc03-31cb-4fed-8971-173bb8128260 tempest-VolumesSnapshotListTestJSON-747565511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:26 devstack sudo[103031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195 Aug 28 09:47:26 devstack sudo[103031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:27 devstack sudo[103031]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8f8bcc03-31cb-4fed-8971-173bb8128260 tempest-VolumesSnapshotListTestJSON-747565511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195" returned: 0 in 0.402s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8f8bcc03-31cb-4fed-8971-173bb8128260 tempest-VolumesSnapshotListTestJSON-747565511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.551680fe-00ef-46cf-b378-fe0373c36b0a {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:27 devstack sudo[103038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.551680fe-00ef-46cf-b378-fe0373c36b0a Aug 28 09:47:27 devstack sudo[103038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:27 devstack sudo[103038]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8f8bcc03-31cb-4fed-8971-173bb8128260 tempest-VolumesSnapshotListTestJSON-747565511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.551680fe-00ef-46cf-b378-fe0373c36b0a" returned: 0 in 0.354s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8f8bcc03-31cb-4fed-8971-173bb8128260 tempest-VolumesSnapshotListTestJSON-747565511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.551680fe-00ef-46cf-b378-fe0373c36b0a {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:27 devstack sudo[103043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.551680fe-00ef-46cf-b378-fe0373c36b0a Aug 28 09:47:27 devstack sudo[103043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:27 devstack sudo[103043]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8f8bcc03-31cb-4fed-8971-173bb8128260 tempest-VolumesSnapshotListTestJSON-747565511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195.551680fe-00ef-46cf-b378-fe0373c36b0a" returned: 0 in 0.253s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:27 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8f8bcc03-31cb-4fed-8971-173bb8128260 tempest-VolumesSnapshotListTestJSON-747565511 None] Lock "cinder-quobyte-551680fe-00ef-46cf-b378-fe0373c36b0a" released by "_delete_snapshot" :: held 1.575s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:47:27 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8f8bcc03-31cb-4fed-8971-173bb8128260 tempest-VolumesSnapshotListTestJSON-747565511 None] Lock "cinder-quobyte-c45e9792-2cb2-4406-9da0-ff901d805195" released by "delete_snapshot" :: held 1.607s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:47:28 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-8f8bcc03-31cb-4fed-8971-173bb8128260 tempest-VolumesSnapshotListTestJSON-747565511 None] Created reservations ['dc27e60e-a5e0-456c-835e-7ca69dbea9c8', 'bd36b4cd-b868-427f-8a04-1470a28caa74', 'd2b81cc4-091f-400b-9822-93c79ef21472', 'fbe6a49c-4add-4efc-be80-ed0e9dfeff45'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:47:28 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-8f8bcc03-31cb-4fed-8971-173bb8128260 tempest-VolumesSnapshotListTestJSON-747565511 None] Delete snapshot completed successfully. Aug 28 09:47:28 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8f8bcc03-31cb-4fed-8971-173bb8128260 tempest-VolumesSnapshotListTestJSON-747565511 None] Lock "cinder-551680fe-00ef-46cf-b378-fe0373c36b0a-delete_snapshot" released by "delete_snapshot" :: held 1.800s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:47:28 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-3e954e2d-cf04-4926-beed-d86fe824976d tempest-VolumesSnapshotListTestJSON-747565511 None] Acquiring lock "cinder-c45e9792-2cb2-4406-9da0-ff901d805195-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:47:28 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-3e954e2d-cf04-4926-beed-d86fe824976d tempest-VolumesSnapshotListTestJSON-747565511 None] Lock "cinder-c45e9792-2cb2-4406-9da0-ff901d805195-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:47:28 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-3e954e2d-cf04-4926-beed-d86fe824976d tempest-VolumesSnapshotListTestJSON-747565511 None] Acquiring lock "cinder-quobyte-c45e9792-2cb2-4406-9da0-ff901d805195" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:47:28 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-3e954e2d-cf04-4926-beed-d86fe824976d tempest-VolumesSnapshotListTestJSON-747565511 None] Lock "cinder-quobyte-c45e9792-2cb2-4406-9da0-ff901d805195" acquired by "delete_volume" :: waited 0.016s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:47:28 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f422ace-4054-4b80-a656-abc1da07f9bf]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:47:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3e954e2d-cf04-4926-beed-d86fe824976d tempest-VolumesSnapshotListTestJSON-747565511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:28 devstack sudo[103046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195 Aug 28 09:47:28 devstack sudo[103046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:28 devstack sudo[103046]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3e954e2d-cf04-4926-beed-d86fe824976d tempest-VolumesSnapshotListTestJSON-747565511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195" returned: 0 in 0.387s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3e954e2d-cf04-4926-beed-d86fe824976d tempest-VolumesSnapshotListTestJSON-747565511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:29 devstack sudo[103051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195 Aug 28 09:47:29 devstack sudo[103051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:29 devstack sudo[103051]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3e954e2d-cf04-4926-beed-d86fe824976d tempest-VolumesSnapshotListTestJSON-747565511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c45e9792-2cb2-4406-9da0-ff901d805195" returned: 0 in 0.263s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:29 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-3e954e2d-cf04-4926-beed-d86fe824976d tempest-VolumesSnapshotListTestJSON-747565511 None] Lock "cinder-quobyte-c45e9792-2cb2-4406-9da0-ff901d805195" released by "delete_volume" :: held 0.714s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:47:29 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-3e954e2d-cf04-4926-beed-d86fe824976d tempest-VolumesSnapshotListTestJSON-747565511 None] Created reservations ['10d47f12-46e2-48df-b65d-717eea4684b2', '0b04156f-46ec-420a-8601-910d4b2d3d4a', '0a6c6441-b0da-4d88-8926-56781aa35be6', 'd31e3da9-c682-4bb0-9239-40ac90e8e467'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:47:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-3e954e2d-cf04-4926-beed-d86fe824976d tempest-VolumesSnapshotListTestJSON-747565511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:47:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-3e954e2d-cf04-4926-beed-d86fe824976d tempest-VolumesSnapshotListTestJSON-747565511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:47:29 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-3e954e2d-cf04-4926-beed-d86fe824976d tempest-VolumesSnapshotListTestJSON-747565511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:47:29 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-3e954e2d-cf04-4926-beed-d86fe824976d tempest-VolumesSnapshotListTestJSON-747565511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:47:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-3e954e2d-cf04-4926-beed-d86fe824976d tempest-VolumesSnapshotListTestJSON-747565511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:47:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3e954e2d-cf04-4926-beed-d86fe824976d tempest-VolumesSnapshotListTestJSON-747565511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:29 devstack sudo[103055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:47:29 devstack sudo[103055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:29 devstack sudo[103055]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3e954e2d-cf04-4926-beed-d86fe824976d tempest-VolumesSnapshotListTestJSON-747565511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.246s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:29 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-3e954e2d-cf04-4926-beed-d86fe824976d tempest-VolumesSnapshotListTestJSON-747565511 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:47:29 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-3e954e2d-cf04-4926-beed-d86fe824976d tempest-VolumesSnapshotListTestJSON-747565511 None] Deleted volume successfully. Aug 28 09:47:29 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-3e954e2d-cf04-4926-beed-d86fe824976d tempest-VolumesSnapshotListTestJSON-747565511 None] Lock "cinder-c45e9792-2cb2-4406-9da0-ff901d805195-delete_volume" released by "delete_volume" :: held 1.163s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:47:32 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-918cb3d9-3752-4663-91f7-f0951c3d36c8 tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:47:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-918cb3d9-3752-4663-91f7-f0951c3d36c8 tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Flow 'volume_create_manager' (1702e824-6eb9-4dd0-9e3a-0cea7ebd4a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:47:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-918cb3d9-3752-4663-91f7-f0951c3d36c8 tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce5d5e2b-921a-4646-9517-57e7475c6f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:47:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-918cb3d9-3752-4663-91f7-f0951c3d36c8 tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce5d5e2b-921a-4646-9517-57e7475c6f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:47:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-964199691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3caf42ea-75e9-4c6a-9bb7-ef9289be93dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='295e89e8d62b4428acfed27658f03792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:47:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:47:33Z,use_quota=True,user_id='af3da33a0a1a4ec488b16c8e2e4db379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:47:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-918cb3d9-3752-4663-91f7-f0951c3d36c8 tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a7e50c0-452f-4818-8388-43975245a5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:47:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-918cb3d9-3752-4663-91f7-f0951c3d36c8 tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a7e50c0-452f-4818-8388-43975245a5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:47:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-918cb3d9-3752-4663-91f7-f0951c3d36c8 tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8ddeb51-e7b9-459c-aa1a-c636765f3b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:47:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-918cb3d9-3752-4663-91f7-f0951c3d36c8 tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8ddeb51-e7b9-459c-aa1a-c636765f3b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3caf42ea-75e9-4c6a-9bb7-ef9289be93dc', 'volume_name': 'volume-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc', 'volume_size': 2}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:47:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-918cb3d9-3752-4663-91f7-f0951c3d36c8 tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcbd672f-93c3-49a3-b811-6db60c5ea23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:47:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-918cb3d9-3752-4663-91f7-f0951c3d36c8 tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcbd672f-93c3-49a3-b811-6db60c5ea23f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:47:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-918cb3d9-3752-4663-91f7-f0951c3d36c8 tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29f1ec58-21ca-4a02-aa3f-6268cc42bd35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:47:32 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-918cb3d9-3752-4663-91f7-f0951c3d36c8 tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Volume 3caf42ea-75e9-4c6a-9bb7-ef9289be93dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc', 'volume_size': 2} Aug 28 09:47:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-918cb3d9-3752-4663-91f7-f0951c3d36c8 tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:47:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-918cb3d9-3752-4663-91f7-f0951c3d36c8 tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:47:32 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-918cb3d9-3752-4663-91f7-f0951c3d36c8 tempest-VolumesSnapshotNegativeTestJSON-481590459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:47:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-964199691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3caf42ea-75e9-4c6a-9bb7-ef9289be93dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='295e89e8d62b4428acfed27658f03792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:47:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:47:33Z,use_quota=True,user_id='af3da33a0a1a4ec488b16c8e2e4db379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:47:32 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-918cb3d9-3752-4663-91f7-f0951c3d36c8 tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Creating volume 3caf42ea-75e9-4c6a-9bb7-ef9289be93dc {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:47:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-918cb3d9-3752-4663-91f7-f0951c3d36c8 tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:47:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-918cb3d9-3752-4663-91f7-f0951c3d36c8 tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:47:32 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-918cb3d9-3752-4663-91f7-f0951c3d36c8 tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:47:32 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-918cb3d9-3752-4663-91f7-f0951c3d36c8 tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:47:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-918cb3d9-3752-4663-91f7-f0951c3d36c8 tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:47:32 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-918cb3d9-3752-4663-91f7-f0951c3d36c8 tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:47:32 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-918cb3d9-3752-4663-91f7-f0951c3d36c8 tempest-VolumesSnapshotNegativeTestJSON-481590459 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:47:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-918cb3d9-3752-4663-91f7-f0951c3d36c8 tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc 2147483648 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:32 devstack sudo[103058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc 2147483648 Aug 28 09:47:32 devstack sudo[103058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:33 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:47:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] Flow 'volume_create_manager' (4c5a4f48-f366-4568-acf6-86e2b888bb23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:47:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49904f18-186f-4971-8f86-cc2f4813fe30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:47:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49904f18-186f-4971-8f86-cc2f4813fe30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:47:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afcc8921-4aaf-4c11-acf7-6def4408a964,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03e7245d2b4847c2b3dd002ac073b3e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:47:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:47:33Z,use_quota=True,user_id='a1353062678147ee9155cf1a3683d1fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:47:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2e64235-8808-498b-a69d-c31df45c5ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:47:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2e64235-8808-498b-a69d-c31df45c5ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:47:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3cd7217-6c85-46c5-99ba-8ba39840d5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:47:33 devstack cinder-volume[86081]: DEBUG cinder.image.glance [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] Creating Keystone auth plugin from conf {{(pid=86081) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 28 09:47:33 devstack sudo[103058]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-918cb3d9-3752-4663-91f7-f0951c3d36c8 tempest-VolumesSnapshotNegativeTestJSON-481590459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc 2147483648" returned: 0 in 0.503s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-918cb3d9-3752-4663-91f7-f0951c3d36c8 tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:33 devstack sudo[103064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc Aug 28 09:47:33 devstack sudo[103064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3cd7217-6c85-46c5-99ba-8ba39840d5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'afcc8921-4aaf-4c11-acf7-6def4408a964', 'volume_name': 'volume-afcc8921-4aaf-4c11-acf7-6def4408a964', 'volume_size': 1, 'image_id': '1910cd8d-880a-4555-9aef-fa43eb5f361f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1910cd8d-880a-4555-9aef-fa43eb5f361f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ba387619a37107a5ee321faac7992bb2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '03e7245d2b4847c2b3dd002ac073b3e6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9972087df751993016e393783865b458b5ad66ff28d8e7071acc158356f4d15d49de2f7fd4c2ba2e8238755b9584ac4564d0ae9996894a4b3d2abfa8757a0fdd', 'id': '1910cd8d-880a-4555-9aef-fa43eb5f361f', 'created_at': datetime.datetime(2026, 8, 28, 7, 47, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 7, 47, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1910cd8d-880a-4555-9aef-fa43eb5f361f/file', 'properties': {}}, 'image_service': }' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:47:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf9753af-817c-4046-ba8a-513b000ecbec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:47:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf9753af-817c-4046-ba8a-513b000ecbec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:47:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dcbd25d-d476-498d-b433-8bb5b1e63c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:47:33 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] Volume afcc8921-4aaf-4c11-acf7-6def4408a964: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-afcc8921-4aaf-4c11-acf7-6def4408a964', 'volume_size': 1, 'image_id': '1910cd8d-880a-4555-9aef-fa43eb5f361f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1910cd8d-880a-4555-9aef-fa43eb5f361f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ba387619a37107a5ee321faac7992bb2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '03e7245d2b4847c2b3dd002ac073b3e6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9972087df751993016e393783865b458b5ad66ff28d8e7071acc158356f4d15d49de2f7fd4c2ba2e8238755b9584ac4564d0ae9996894a4b3d2abfa8757a0fdd', 'id': '1910cd8d-880a-4555-9aef-fa43eb5f361f', 'created_at': datetime.datetime(2026, 8, 28, 7, 47, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 7, 47, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1910cd8d-880a-4555-9aef-fa43eb5f361f/file', 'properties': {}}, 'image_service': } Aug 28 09:47:33 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] Trying to clone afcc8921-4aaf-4c11-acf7-6def4408a964 from image 1910cd8d-880a-4555-9aef-fa43eb5f361f at location (None, [{'url': 'file:///opt/stack/data/glance/images/1910cd8d-880a-4555-9aef-fa43eb5f361f', 'metadata': {}}]). {{(pid=86081) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 28 09:47:33 devstack sudo[103064]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-918cb3d9-3752-4663-91f7-f0951c3d36c8 tempest-VolumesSnapshotNegativeTestJSON-481590459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc" returned: 0 in 0.261s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:33 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-918cb3d9-3752-4663-91f7-f0951c3d36c8 tempest-VolumesSnapshotNegativeTestJSON-481590459 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:47:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-918cb3d9-3752-4663-91f7-f0951c3d36c8 tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:47:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-918cb3d9-3752-4663-91f7-f0951c3d36c8 tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29f1ec58-21ca-4a02-aa3f-6268cc42bd35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc', 'volume_size': 2}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:47:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-918cb3d9-3752-4663-91f7-f0951c3d36c8 tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (141713d9-32b0-4c14-9d4e-38d016da28fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:47:33 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1910cd8d-880a-4555-9aef-fa43eb5f361f_9dhbpzd7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86081) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 28 09:47:33 devstack cinder-volume[86081]: INFO cinder.image.image_utils [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] Image download 0.00 MB at 0.00 MB/s Aug 28 09:47:33 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-918cb3d9-3752-4663-91f7-f0951c3d36c8 tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Volume volume-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc (3caf42ea-75e9-4c6a-9bb7-ef9289be93dc): created successfully Aug 28 09:47:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-918cb3d9-3752-4663-91f7-f0951c3d36c8 tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (141713d9-32b0-4c14-9d4e-38d016da28fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:47:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-918cb3d9-3752-4663-91f7-f0951c3d36c8 tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Flow 'volume_create_manager' (1702e824-6eb9-4dd0-9e3a-0cea7ebd4a1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:47:33 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-918cb3d9-3752-4663-91f7-f0951c3d36c8 tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Created volume successfully. Aug 28 09:47:33 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[9887fa6a-c1f4-41aa-92ff-f05dff6e4bd7]: (4, 'raw') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:47:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1910cd8d-880a-4555-9aef-fa43eb5f361f_9dhbpzd7devstack@QuobyteHD {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:33 devstack sudo[103067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1910cd8d-880a-4555-9aef-fa43eb5f361f_9dhbpzd7devstack@QuobyteHD Aug 28 09:47:33 devstack sudo[103067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:33 devstack sudo[103067]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1910cd8d-880a-4555-9aef-fa43eb5f361f_9dhbpzd7devstack@QuobyteHD" returned: 0 in 0.343s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1910cd8d-880a-4555-9aef-fa43eb5f361f_9dhbpzd7devstack@QuobyteHD {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:34 devstack sudo[103071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1910cd8d-880a-4555-9aef-fa43eb5f361f_9dhbpzd7devstack@QuobyteHD Aug 28 09:47:34 devstack sudo[103071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:34 devstack sudo[103071]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1910cd8d-880a-4555-9aef-fa43eb5f361f_9dhbpzd7devstack@QuobyteHD" returned: 1 in 0.325s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1910cd8d-880a-4555-9aef-fa43eb5f361f_9dhbpzd7devstack@QuobyteHD' failed. Not Retrying. {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 09:47:34 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] Temporary image 1910cd8d-880a-4555-9aef-fa43eb5f361f is fetched for user a1353062678147ee9155cf1a3683d1fb. {{(pid=86081) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 28 09:47:34 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2edfdb1-5dc8-4170-93a2-01c07ab27ecf]: (4, 'raw') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:47:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1910cd8d-880a-4555-9aef-fa43eb5f361f_9dhbpzd7devstack@QuobyteHD {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:34 devstack sudo[103076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1910cd8d-880a-4555-9aef-fa43eb5f361f_9dhbpzd7devstack@QuobyteHD Aug 28 09:47:34 devstack sudo[103076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:34 devstack sudo[103076]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1910cd8d-880a-4555-9aef-fa43eb5f361f_9dhbpzd7devstack@QuobyteHD" returned: 0 in 0.322s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1910cd8d-880a-4555-9aef-fa43eb5f361f_9dhbpzd7devstack@QuobyteHD {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:34 devstack sudo[103080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1910cd8d-880a-4555-9aef-fa43eb5f361f_9dhbpzd7devstack@QuobyteHD Aug 28 09:47:34 devstack sudo[103080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-23744088-599c-4733-b723-10a9442b882b tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:47:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-23744088-599c-4733-b723-10a9442b882b tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:47:34 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-23744088-599c-4733-b723-10a9442b882b tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Creating offline snapshot 6dfb8974-0b3b-4530-89a0-a689e39ba67c of volume 3caf42ea-75e9-4c6a-9bb7-ef9289be93dc {{(pid=86081) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:47:34 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2489ae5-025d-4793-8a0a-a2a6066cc52d]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:47:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-23744088-599c-4733-b723-10a9442b882b tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:34 devstack sudo[103080]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1910cd8d-880a-4555-9aef-fa43eb5f361f_9dhbpzd7devstack@QuobyteHD" returned: 1 in 0.334s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1910cd8d-880a-4555-9aef-fa43eb5f361f_9dhbpzd7devstack@QuobyteHD' failed. Not Retrying. {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 09:47:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:47:35 devstack sudo[103082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc Aug 28 09:47:35 devstack sudo[103082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:35 devstack sudo[103082]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-23744088-599c-4733-b723-10a9442b882b tempest-VolumesSnapshotNegativeTestJSON-481590459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc" returned: 0 in 0.354s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-23744088-599c-4733-b723-10a9442b882b tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc.6dfb8974-0b3b-4530-89a0-a689e39ba67c 2G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:35 devstack sudo[103090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc.6dfb8974-0b3b-4530-89a0-a689e39ba67c 2G Aug 28 09:47:35 devstack sudo[103090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:35 devstack sudo[103090]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-23744088-599c-4733-b723-10a9442b882b tempest-VolumesSnapshotNegativeTestJSON-481590459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc.6dfb8974-0b3b-4530-89a0-a689e39ba67c 2G" returned: 0 in 0.369s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-23744088-599c-4733-b723-10a9442b882b tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc.6dfb8974-0b3b-4530-89a0-a689e39ba67c {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:35 devstack sudo[103095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc.6dfb8974-0b3b-4530-89a0-a689e39ba67c Aug 28 09:47:35 devstack sudo[103095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:35 devstack sudo[103095]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-23744088-599c-4733-b723-10a9442b882b tempest-VolumesSnapshotNegativeTestJSON-481590459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc.6dfb8974-0b3b-4530-89a0-a689e39ba67c" returned: 0 in 0.289s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:35 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-23744088-599c-4733-b723-10a9442b882b tempest-VolumesSnapshotNegativeTestJSON-481590459 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc.6dfb8974-0b3b-4530-89a0-a689e39ba67c is being set with open permissions: ugo+rw Aug 28 09:47:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-23744088-599c-4733-b723-10a9442b882b tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc.6dfb8974-0b3b-4530-89a0-a689e39ba67c {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:35 devstack sudo[103100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc.6dfb8974-0b3b-4530-89a0-a689e39ba67c Aug 28 09:47:35 devstack sudo[103100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:36 devstack sudo[103100]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-23744088-599c-4733-b723-10a9442b882b tempest-VolumesSnapshotNegativeTestJSON-481590459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc.6dfb8974-0b3b-4530-89a0-a689e39ba67c" returned: 0 in 0.243s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-23744088-599c-4733-b723-10a9442b882b tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:36 devstack sudo[103103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc.info Aug 28 09:47:36 devstack sudo[103103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:36 devstack sudo[103103]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-23744088-599c-4733-b723-10a9442b882b tempest-VolumesSnapshotNegativeTestJSON-481590459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc.info" returned: 0 in 0.247s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:36 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-23744088-599c-4733-b723-10a9442b882b tempest-VolumesSnapshotNegativeTestJSON-481590459 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc.info is being set with open permissions: ugo+rw Aug 28 09:47:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-23744088-599c-4733-b723-10a9442b882b tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:36 devstack sudo[103106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc.info Aug 28 09:47:36 devstack sudo[103106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:36 devstack sudo[103106]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-23744088-599c-4733-b723-10a9442b882b tempest-VolumesSnapshotNegativeTestJSON-481590459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc.info" returned: 0 in 0.232s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-23744088-599c-4733-b723-10a9442b882b tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.818s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:47:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.716s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:47:36 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:47:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afcc8921-4aaf-4c11-acf7-6def4408a964,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03e7245d2b4847c2b3dd002ac073b3e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:47:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:47:33Z,use_quota=True,user_id='a1353062678147ee9155cf1a3683d1fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:47:36 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] Creating volume afcc8921-4aaf-4c11-acf7-6def4408a964 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:47:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:47:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:47:36 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:47:36 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:47:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:47:36 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:47:36 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:47:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-afcc8921-4aaf-4c11-acf7-6def4408a964 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:36 devstack sudo[103109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-afcc8921-4aaf-4c11-acf7-6def4408a964 1073741824 Aug 28 09:47:36 devstack sudo[103109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:36 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-23744088-599c-4733-b723-10a9442b882b tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Create snapshot completed successfully Aug 28 09:47:37 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4a1c1ebe-93af-49ba-ba15-cfb5624b8b0b tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Acquiring lock "cinder-6dfb8974-0b3b-4530-89a0-a689e39ba67c-delete_snapshot" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:47:37 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4a1c1ebe-93af-49ba-ba15-cfb5624b8b0b tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Lock "cinder-6dfb8974-0b3b-4530-89a0-a689e39ba67c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:47:37 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4a1c1ebe-93af-49ba-ba15-cfb5624b8b0b tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Acquiring lock "cinder-quobyte-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:47:37 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4a1c1ebe-93af-49ba-ba15-cfb5624b8b0b tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Lock "cinder-quobyte-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:47:37 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4a1c1ebe-93af-49ba-ba15-cfb5624b8b0b tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Acquiring lock "cinder-quobyte-6dfb8974-0b3b-4530-89a0-a689e39ba67c" by "_delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:47:37 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4a1c1ebe-93af-49ba-ba15-cfb5624b8b0b tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Lock "cinder-quobyte-6dfb8974-0b3b-4530-89a0-a689e39ba67c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:47:37 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-4a1c1ebe-93af-49ba-ba15-cfb5624b8b0b tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Deleting offline snapshot 6dfb8974-0b3b-4530-89a0-a689e39ba67c of volume 3caf42ea-75e9-4c6a-9bb7-ef9289be93dc {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:47:37 devstack sudo[103109]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:37 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-4a1c1ebe-93af-49ba-ba15-cfb5624b8b0b tempest-VolumesSnapshotNegativeTestJSON-481590459 None] snapshot_file for this snap is: volume-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc.6dfb8974-0b3b-4530-89a0-a689e39ba67c {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:47:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-afcc8921-4aaf-4c11-acf7-6def4408a964 1073741824" returned: 0 in 0.470s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:37 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86cc4d0-3e42-4128-99d8-766aa39f2934]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:47:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4a1c1ebe-93af-49ba-ba15-cfb5624b8b0b tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc.6dfb8974-0b3b-4530-89a0-a689e39ba67c {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-afcc8921-4aaf-4c11-acf7-6def4408a964 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:37 devstack sudo[103116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-afcc8921-4aaf-4c11-acf7-6def4408a964 Aug 28 09:47:37 devstack sudo[103116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:37 devstack sudo[103115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc.6dfb8974-0b3b-4530-89a0-a689e39ba67c Aug 28 09:47:37 devstack sudo[103115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:37 devstack sudo[103116]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-afcc8921-4aaf-4c11-acf7-6def4408a964" returned: 0 in 0.253s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:37 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:47:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:47:37 devstack cinder-volume[86081]: DEBUG cinder.volume.volume_utils [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] Attempting download of 1910cd8d-880a-4555-9aef-fa43eb5f361f ((None, [{'url': 'file:///opt/stack/data/glance/images/1910cd8d-880a-4555-9aef-fa43eb5f361f', 'metadata': {}}])) to volume afcc8921-4aaf-4c11-acf7-6def4408a964. {{(pid=86081) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 28 09:47:37 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a68bf1-3ca1-4eb5-a697-20a4a1b54107]: (4, 'raw') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:47:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1910cd8d-880a-4555-9aef-fa43eb5f361f_ojpzno5s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:37 devstack sudo[103115]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4a1c1ebe-93af-49ba-ba15-cfb5624b8b0b tempest-VolumesSnapshotNegativeTestJSON-481590459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc.6dfb8974-0b3b-4530-89a0-a689e39ba67c" returned: 0 in 0.370s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:37 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-4a1c1ebe-93af-49ba-ba15-cfb5624b8b0b tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:47:37 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[b594360d-cc70-46db-98f4-0dffa0b51d68]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:47:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4a1c1ebe-93af-49ba-ba15-cfb5624b8b0b tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:37 devstack sudo[103123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1910cd8d-880a-4555-9aef-fa43eb5f361f_ojpzno5s Aug 28 09:47:37 devstack sudo[103123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:37 devstack sudo[103124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc Aug 28 09:47:37 devstack sudo[103124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:37 devstack sudo[103123]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1910cd8d-880a-4555-9aef-fa43eb5f361f_ojpzno5s" returned: 0 in 0.321s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1910cd8d-880a-4555-9aef-fa43eb5f361f_ojpzno5s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:37 devstack sudo[103124]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4a1c1ebe-93af-49ba-ba15-cfb5624b8b0b tempest-VolumesSnapshotNegativeTestJSON-481590459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc" returned: 0 in 0.369s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4a1c1ebe-93af-49ba-ba15-cfb5624b8b0b tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc.6dfb8974-0b3b-4530-89a0-a689e39ba67c {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:38 devstack sudo[103133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc.6dfb8974-0b3b-4530-89a0-a689e39ba67c Aug 28 09:47:38 devstack sudo[103130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1910cd8d-880a-4555-9aef-fa43eb5f361f_ojpzno5s Aug 28 09:47:38 devstack sudo[103130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:38 devstack sudo[103133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:38 devstack cinder-volume[86081]: DEBUG oslo_service.periodic_task [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86081) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:47:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:47:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:47:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:47:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:47:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:47:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:38 devstack sudo[103136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:47:38 devstack sudo[103136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:38 devstack sudo[103130]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1910cd8d-880a-4555-9aef-fa43eb5f361f_ojpzno5s" returned: 1 in 0.354s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1910cd8d-880a-4555-9aef-fa43eb5f361f_ojpzno5s' failed. Not Retrying. {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 09:47:38 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc13d38b-a176-4eea-80c2-ce36b0d122d5]: (4, 'raw') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:47:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1910cd8d-880a-4555-9aef-fa43eb5f361f_9dhbpzd7devstack@QuobyteHD {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:38 devstack sudo[103136]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.260s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:38 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:47:38 devstack sudo[103133]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4a1c1ebe-93af-49ba-ba15-cfb5624b8b0b tempest-VolumesSnapshotNegativeTestJSON-481590459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc.6dfb8974-0b3b-4530-89a0-a689e39ba67c" returned: 0 in 0.374s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4a1c1ebe-93af-49ba-ba15-cfb5624b8b0b tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc.6dfb8974-0b3b-4530-89a0-a689e39ba67c {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:38 devstack cinder-volume[86081]: DEBUG oslo_service.periodic_task [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running periodic task VolumeManager._thread_info {{(pid=86081) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:47:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] thread count: 28 {{(pid=86081) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 09:47:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] thread info: [<_MainThread(MainThread, started 129914189705344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86081) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 09:47:38 devstack sudo[103143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1910cd8d-880a-4555-9aef-fa43eb5f361f_9dhbpzd7devstack@QuobyteHD Aug 28 09:47:38 devstack sudo[103143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:38 devstack sudo[103145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc.6dfb8974-0b3b-4530-89a0-a689e39ba67c Aug 28 09:47:38 devstack sudo[103145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:38 devstack sudo[103143]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1910cd8d-880a-4555-9aef-fa43eb5f361f_9dhbpzd7devstack@QuobyteHD" returned: 0 in 0.340s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1910cd8d-880a-4555-9aef-fa43eb5f361f_9dhbpzd7devstack@QuobyteHD {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:38 devstack sudo[103145]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4a1c1ebe-93af-49ba-ba15-cfb5624b8b0b tempest-VolumesSnapshotNegativeTestJSON-481590459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc.6dfb8974-0b3b-4530-89a0-a689e39ba67c" returned: 0 in 0.264s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:38 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4a1c1ebe-93af-49ba-ba15-cfb5624b8b0b tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Lock "cinder-quobyte-6dfb8974-0b3b-4530-89a0-a689e39ba67c" released by "_delete_snapshot" :: held 1.501s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:47:38 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4a1c1ebe-93af-49ba-ba15-cfb5624b8b0b tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Lock "cinder-quobyte-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc" released by "delete_snapshot" :: held 1.536s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:47:38 devstack sudo[103151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1910cd8d-880a-4555-9aef-fa43eb5f361f_9dhbpzd7devstack@QuobyteHD Aug 28 09:47:38 devstack sudo[103151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:38 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-4a1c1ebe-93af-49ba-ba15-cfb5624b8b0b tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Created reservations ['e3290190-3a7f-4745-84c7-2d668350e7c8', 'a4c1fd7d-1607-4193-a2c2-2a5e0a29b32b', 'b25bbe29-0ed1-49aa-a582-5e3c61aed9e4', 'cc21caf0-1e07-44e9-b5e8-acd3b11a4505'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:47:38 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-4a1c1ebe-93af-49ba-ba15-cfb5624b8b0b tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Delete snapshot completed successfully. Aug 28 09:47:38 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4a1c1ebe-93af-49ba-ba15-cfb5624b8b0b tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Lock "cinder-6dfb8974-0b3b-4530-89a0-a689e39ba67c-delete_snapshot" released by "delete_snapshot" :: held 1.737s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:47:38 devstack sudo[103151]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1910cd8d-880a-4555-9aef-fa43eb5f361f_9dhbpzd7devstack@QuobyteHD" returned: 1 in 0.347s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1910cd8d-880a-4555-9aef-fa43eb5f361f_9dhbpzd7devstack@QuobyteHD' failed. Not Retrying. {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 09:47:38 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] 1910cd8d-880a-4555-9aef-fa43eb5f361f was raw, converting to qcow2 {{(pid=86081) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 28 09:47:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1910cd8d-880a-4555-9aef-fa43eb5f361f_9dhbpzd7devstack@QuobyteHD /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-afcc8921-4aaf-4c11-acf7-6def4408a964 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:38 devstack sudo[103157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1910cd8d-880a-4555-9aef-fa43eb5f361f_9dhbpzd7devstack@QuobyteHD /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-afcc8921-4aaf-4c11-acf7-6def4408a964 Aug 28 09:47:38 devstack sudo[103157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:39 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-34749f72-3fe1-4dbf-a7d9-d9a7d9e8cd03 tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Acquiring lock "cinder-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:47:39 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-34749f72-3fe1-4dbf-a7d9-d9a7d9e8cd03 tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Lock "cinder-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:47:39 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-34749f72-3fe1-4dbf-a7d9-d9a7d9e8cd03 tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Acquiring lock "cinder-quobyte-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:47:39 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-34749f72-3fe1-4dbf-a7d9-d9a7d9e8cd03 tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Lock "cinder-quobyte-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc" acquired by "delete_volume" :: waited 0.026s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:47:39 devstack sudo[103157]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1910cd8d-880a-4555-9aef-fa43eb5f361f_9dhbpzd7devstack@QuobyteHD /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-afcc8921-4aaf-4c11-acf7-6def4408a964" returned: 0 in 0.496s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:39 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1910cd8d-880a-4555-9aef-fa43eb5f361f_9dhbpzd7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-afcc8921-4aaf-4c11-acf7-6def4408a964 {{(pid=86081) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 09:47:39 devstack cinder-volume[86081]: INFO cinder.image.image_utils [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] Converted 0.00 MB image at 0.00 MB/s Aug 28 09:47:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-afcc8921-4aaf-4c11-acf7-6def4408a964 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:39 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad36b1cc-5258-43c2-bbd7-8672ae44c5ba]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:47:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-34749f72-3fe1-4dbf-a7d9-d9a7d9e8cd03 tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:39 devstack sudo[103164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-afcc8921-4aaf-4c11-acf7-6def4408a964 1G Aug 28 09:47:39 devstack sudo[103164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:39 devstack sudo[103165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc Aug 28 09:47:39 devstack sudo[103165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:39 devstack sudo[103164]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-afcc8921-4aaf-4c11-acf7-6def4408a964 1G" returned: 0 in 0.311s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:39 devstack cinder-volume[86081]: DEBUG cinder.volume.volume_utils [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] Downloaded image 1910cd8d-880a-4555-9aef-fa43eb5f361f ((None, [{'url': 'file:///opt/stack/data/glance/images/1910cd8d-880a-4555-9aef-fa43eb5f361f', 'metadata': {}}])) to volume afcc8921-4aaf-4c11-acf7-6def4408a964 successfully. {{(pid=86081) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 28 09:47:39 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] Temporary image 1910cd8d-880a-4555-9aef-fa43eb5f361f for user a1353062678147ee9155cf1a3683d1fb is deleted. {{(pid=86081) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 28 09:47:39 devstack cinder-volume[86081]: DEBUG cinder.volume.volume_utils [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] Marking volume afcc8921-4aaf-4c11-acf7-6def4408a964 as bootable. {{(pid=86081) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 28 09:47:39 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] Copying metadata from image 1910cd8d-880a-4555-9aef-fa43eb5f361f to afcc8921-4aaf-4c11-acf7-6def4408a964. {{(pid=86081) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 28 09:47:39 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] Creating volume glance metadata for volume afcc8921-4aaf-4c11-acf7-6def4408a964 backed by image 1910cd8d-880a-4555-9aef-fa43eb5f361f with: {'image_id': '1910cd8d-880a-4555-9aef-fa43eb5f361f', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'ba387619a37107a5ee321faac7992bb2', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86081) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 28 09:47:39 devstack sudo[103165]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:39 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dcbd25d-d476-498d-b433-8bb5b1e63c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afcc8921-4aaf-4c11-acf7-6def4408a964', 'volume_size': 1, 'image_id': '1910cd8d-880a-4555-9aef-fa43eb5f361f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1910cd8d-880a-4555-9aef-fa43eb5f361f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ba387619a37107a5ee321faac7992bb2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '03e7245d2b4847c2b3dd002ac073b3e6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9972087df751993016e393783865b458b5ad66ff28d8e7071acc158356f4d15d49de2f7fd4c2ba2e8238755b9584ac4564d0ae9996894a4b3d2abfa8757a0fdd', 'id': '1910cd8d-880a-4555-9aef-fa43eb5f361f', 'created_at': datetime.datetime(2026, 8, 28, 7, 47, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 7, 47, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1910cd8d-880a-4555-9aef-fa43eb5f361f/file', 'properties': {}}, 'image_service': }' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:47:39 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08eacf1f-4274-46b2-9e2c-8be81937d7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:47:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-34749f72-3fe1-4dbf-a7d9-d9a7d9e8cd03 tempest-VolumesSnapshotNegativeTestJSON-481590459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc" returned: 0 in 0.386s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-34749f72-3fe1-4dbf-a7d9-d9a7d9e8cd03 tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:39 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] Volume volume-afcc8921-4aaf-4c11-acf7-6def4408a964 (afcc8921-4aaf-4c11-acf7-6def4408a964): created successfully Aug 28 09:47:39 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08eacf1f-4274-46b2-9e2c-8be81937d7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:47:39 devstack sudo[103174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc Aug 28 09:47:39 devstack sudo[103174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:39 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] Flow 'volume_create_manager' (4c5a4f48-f366-4568-acf6-86e2b888bb23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:47:39 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-fe25ed8b-4db5-4af0-997c-6caedded5d7b tempest-VolumeImageDependencyTests-1337895187 None] Created volume successfully. Aug 28 09:47:40 devstack sudo[103174]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-34749f72-3fe1-4dbf-a7d9-d9a7d9e8cd03 tempest-VolumesSnapshotNegativeTestJSON-481590459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc" returned: 0 in 0.237s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:40 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-34749f72-3fe1-4dbf-a7d9-d9a7d9e8cd03 tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Lock "cinder-quobyte-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc" released by "delete_volume" :: held 0.685s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:47:40 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-34749f72-3fe1-4dbf-a7d9-d9a7d9e8cd03 tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Created reservations ['8438a29f-311b-4932-b824-07b212cfb16c', '723c6f2e-1f3a-41ce-aee4-954b1623de37', 'c3f0e1ed-a7f3-4a49-a01b-69c48ffa0997', 'bb1f24bb-79f7-41e4-b0b0-9fd430188bfa'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:47:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-34749f72-3fe1-4dbf-a7d9-d9a7d9e8cd03 tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:47:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-34749f72-3fe1-4dbf-a7d9-d9a7d9e8cd03 tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:47:40 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-34749f72-3fe1-4dbf-a7d9-d9a7d9e8cd03 tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:47:40 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-34749f72-3fe1-4dbf-a7d9-d9a7d9e8cd03 tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:47:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-34749f72-3fe1-4dbf-a7d9-d9a7d9e8cd03 tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:47:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-34749f72-3fe1-4dbf-a7d9-d9a7d9e8cd03 tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:40 devstack sudo[103177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:47:40 devstack sudo[103177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:40 devstack sudo[103177]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-34749f72-3fe1-4dbf-a7d9-d9a7d9e8cd03 tempest-VolumesSnapshotNegativeTestJSON-481590459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.272s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:40 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-34749f72-3fe1-4dbf-a7d9-d9a7d9e8cd03 tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:47:40 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-34749f72-3fe1-4dbf-a7d9-d9a7d9e8cd03 tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Deleted volume successfully. Aug 28 09:47:40 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-34749f72-3fe1-4dbf-a7d9-d9a7d9e8cd03 tempest-VolumesSnapshotNegativeTestJSON-481590459 None] Lock "cinder-3caf42ea-75e9-4c6a-9bb7-ef9289be93dc-delete_volume" released by "delete_volume" :: held 1.165s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:47:40 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-79abd502-afc8-420a-9a1a-2d93805ac310 tempest-VolumeImageDependencyTests-1337895187 None] Acquiring lock "cinder-afcc8921-4aaf-4c11-acf7-6def4408a964-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:47:40 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-79abd502-afc8-420a-9a1a-2d93805ac310 tempest-VolumeImageDependencyTests-1337895187 None] Lock "cinder-afcc8921-4aaf-4c11-acf7-6def4408a964-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:47:40 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-79abd502-afc8-420a-9a1a-2d93805ac310 tempest-VolumeImageDependencyTests-1337895187 None] Acquiring lock "cinder-quobyte-afcc8921-4aaf-4c11-acf7-6def4408a964" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:47:40 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-79abd502-afc8-420a-9a1a-2d93805ac310 tempest-VolumeImageDependencyTests-1337895187 None] Lock "cinder-quobyte-afcc8921-4aaf-4c11-acf7-6def4408a964" acquired by "delete_volume" :: waited 0.017s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:47:40 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7196c9-f3f1-461f-945a-edf6a5508526]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:47:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-79abd502-afc8-420a-9a1a-2d93805ac310 tempest-VolumeImageDependencyTests-1337895187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-afcc8921-4aaf-4c11-acf7-6def4408a964 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:40 devstack sudo[103180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-afcc8921-4aaf-4c11-acf7-6def4408a964 Aug 28 09:47:40 devstack sudo[103180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:41 devstack sudo[103180]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-79abd502-afc8-420a-9a1a-2d93805ac310 tempest-VolumeImageDependencyTests-1337895187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-afcc8921-4aaf-4c11-acf7-6def4408a964" returned: 0 in 0.375s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-79abd502-afc8-420a-9a1a-2d93805ac310 tempest-VolumeImageDependencyTests-1337895187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-afcc8921-4aaf-4c11-acf7-6def4408a964 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:41 devstack sudo[103185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-afcc8921-4aaf-4c11-acf7-6def4408a964 Aug 28 09:47:41 devstack sudo[103185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:41 devstack sudo[103185]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-79abd502-afc8-420a-9a1a-2d93805ac310 tempest-VolumeImageDependencyTests-1337895187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-afcc8921-4aaf-4c11-acf7-6def4408a964" returned: 0 in 0.270s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:41 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-79abd502-afc8-420a-9a1a-2d93805ac310 tempest-VolumeImageDependencyTests-1337895187 None] Lock "cinder-quobyte-afcc8921-4aaf-4c11-acf7-6def4408a964" released by "delete_volume" :: held 0.683s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:47:41 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-79abd502-afc8-420a-9a1a-2d93805ac310 tempest-VolumeImageDependencyTests-1337895187 None] Created reservations ['17283060-dd1d-469a-98c2-f6a1cef84e2d', '481af7ca-685a-43dd-87cc-5ca1392a05e9', '4271447b-82d4-45f9-8531-c5f9cb7dee8d', 'e2a8649a-55c8-47ef-ac43-fd8616a5d6ff'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:47:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-79abd502-afc8-420a-9a1a-2d93805ac310 tempest-VolumeImageDependencyTests-1337895187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:47:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-79abd502-afc8-420a-9a1a-2d93805ac310 tempest-VolumeImageDependencyTests-1337895187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:47:41 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-79abd502-afc8-420a-9a1a-2d93805ac310 tempest-VolumeImageDependencyTests-1337895187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:47:41 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-79abd502-afc8-420a-9a1a-2d93805ac310 tempest-VolumeImageDependencyTests-1337895187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:47:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-79abd502-afc8-420a-9a1a-2d93805ac310 tempest-VolumeImageDependencyTests-1337895187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:47:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-79abd502-afc8-420a-9a1a-2d93805ac310 tempest-VolumeImageDependencyTests-1337895187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:41 devstack sudo[103188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:47:41 devstack sudo[103188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:41 devstack sudo[103188]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-79abd502-afc8-420a-9a1a-2d93805ac310 tempest-VolumeImageDependencyTests-1337895187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.271s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:41 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-79abd502-afc8-420a-9a1a-2d93805ac310 tempest-VolumeImageDependencyTests-1337895187 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:47:41 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-79abd502-afc8-420a-9a1a-2d93805ac310 tempest-VolumeImageDependencyTests-1337895187 None] Deleted volume successfully. Aug 28 09:47:41 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-79abd502-afc8-420a-9a1a-2d93805ac310 tempest-VolumeImageDependencyTests-1337895187 None] Lock "cinder-afcc8921-4aaf-4c11-acf7-6def4408a964-delete_volume" released by "delete_volume" :: held 1.170s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:47:51 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writing DB stats cinder:SELECT=63,cinder:INSERT=20,cinder:UPDATE=60,cinder:DELETE=3 {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:47:51 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writing DB stats cinder:SELECT=53,cinder:UPDATE=70,cinder:DELETE=6,cinder:INSERT=24 {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:47:55 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e9600a6-5ace-4328-91ce-4ff3e6e6affd tempest-ProjectReaderTests-510010164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:47:55 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5e9600a6-5ace-4328-91ce-4ff3e6e6affd tempest-ProjectReaderTests-510010164 None] Flow 'volume_create_manager' (85f8bf69-fd09-4320-ba6b-4be5aa118f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:47:55 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5e9600a6-5ace-4328-91ce-4ff3e6e6affd tempest-ProjectReaderTests-510010164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efe582c5-f918-4cc1-8734-f2f38ca89807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:47:55 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5e9600a6-5ace-4328-91ce-4ff3e6e6affd tempest-ProjectReaderTests-510010164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efe582c5-f918-4cc1-8734-f2f38ca89807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:47:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1481591736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71ce6d0a-77be-4a3b-8d2f-28b85274031e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83291eebdbbe4ac787503c10bc97dbfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:47:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:47:55Z,use_quota=True,user_id='45de25b9c57e4ee39033d69b4af92639',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:47:55 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5e9600a6-5ace-4328-91ce-4ff3e6e6affd tempest-ProjectReaderTests-510010164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ada1eeaa-40b9-4ec3-8f21-c2dc33d262a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:47:55 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5e9600a6-5ace-4328-91ce-4ff3e6e6affd tempest-ProjectReaderTests-510010164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ada1eeaa-40b9-4ec3-8f21-c2dc33d262a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:47:55 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5e9600a6-5ace-4328-91ce-4ff3e6e6affd tempest-ProjectReaderTests-510010164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (594418c6-9aed-4e6b-94d1-bd486dc526b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:47:55 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5e9600a6-5ace-4328-91ce-4ff3e6e6affd tempest-ProjectReaderTests-510010164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (594418c6-9aed-4e6b-94d1-bd486dc526b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71ce6d0a-77be-4a3b-8d2f-28b85274031e', 'volume_name': 'volume-71ce6d0a-77be-4a3b-8d2f-28b85274031e', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:47:55 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5e9600a6-5ace-4328-91ce-4ff3e6e6affd tempest-ProjectReaderTests-510010164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e15a0a36-1bef-4f4a-86b7-9a2b89e1f53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:47:55 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5e9600a6-5ace-4328-91ce-4ff3e6e6affd tempest-ProjectReaderTests-510010164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e15a0a36-1bef-4f4a-86b7-9a2b89e1f53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:47:55 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5e9600a6-5ace-4328-91ce-4ff3e6e6affd tempest-ProjectReaderTests-510010164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8efc14b6-801c-4b06-962e-611f4feafcdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:47:55 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-5e9600a6-5ace-4328-91ce-4ff3e6e6affd tempest-ProjectReaderTests-510010164 None] Volume 71ce6d0a-77be-4a3b-8d2f-28b85274031e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71ce6d0a-77be-4a3b-8d2f-28b85274031e', 'volume_size': 1} Aug 28 09:47:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-5e9600a6-5ace-4328-91ce-4ff3e6e6affd tempest-ProjectReaderTests-510010164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:47:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-5e9600a6-5ace-4328-91ce-4ff3e6e6affd tempest-ProjectReaderTests-510010164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:47:55 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-5e9600a6-5ace-4328-91ce-4ff3e6e6affd tempest-ProjectReaderTests-510010164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:47:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1481591736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71ce6d0a-77be-4a3b-8d2f-28b85274031e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83291eebdbbe4ac787503c10bc97dbfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:47:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:47:55Z,use_quota=True,user_id='45de25b9c57e4ee39033d69b4af92639',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:47:55 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-5e9600a6-5ace-4328-91ce-4ff3e6e6affd tempest-ProjectReaderTests-510010164 None] Creating volume 71ce6d0a-77be-4a3b-8d2f-28b85274031e {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:47:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-5e9600a6-5ace-4328-91ce-4ff3e6e6affd tempest-ProjectReaderTests-510010164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:47:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-5e9600a6-5ace-4328-91ce-4ff3e6e6affd tempest-ProjectReaderTests-510010164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:47:55 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-5e9600a6-5ace-4328-91ce-4ff3e6e6affd tempest-ProjectReaderTests-510010164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:47:55 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-5e9600a6-5ace-4328-91ce-4ff3e6e6affd tempest-ProjectReaderTests-510010164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:47:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-5e9600a6-5ace-4328-91ce-4ff3e6e6affd tempest-ProjectReaderTests-510010164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:47:55 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-5e9600a6-5ace-4328-91ce-4ff3e6e6affd tempest-ProjectReaderTests-510010164 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:47:55 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-5e9600a6-5ace-4328-91ce-4ff3e6e6affd tempest-ProjectReaderTests-510010164 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:47:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5e9600a6-5ace-4328-91ce-4ff3e6e6affd tempest-ProjectReaderTests-510010164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-71ce6d0a-77be-4a3b-8d2f-28b85274031e 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:55 devstack sudo[103193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-71ce6d0a-77be-4a3b-8d2f-28b85274031e 1073741824 Aug 28 09:47:55 devstack sudo[103193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:56 devstack sudo[103193]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5e9600a6-5ace-4328-91ce-4ff3e6e6affd tempest-ProjectReaderTests-510010164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-71ce6d0a-77be-4a3b-8d2f-28b85274031e 1073741824" returned: 0 in 0.487s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5e9600a6-5ace-4328-91ce-4ff3e6e6affd tempest-ProjectReaderTests-510010164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-71ce6d0a-77be-4a3b-8d2f-28b85274031e {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:56 devstack sudo[103199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-71ce6d0a-77be-4a3b-8d2f-28b85274031e Aug 28 09:47:56 devstack sudo[103199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:56 devstack sudo[103199]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5e9600a6-5ace-4328-91ce-4ff3e6e6affd tempest-ProjectReaderTests-510010164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-71ce6d0a-77be-4a3b-8d2f-28b85274031e" returned: 0 in 0.243s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:56 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-5e9600a6-5ace-4328-91ce-4ff3e6e6affd tempest-ProjectReaderTests-510010164 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:47:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-5e9600a6-5ace-4328-91ce-4ff3e6e6affd tempest-ProjectReaderTests-510010164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:47:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5e9600a6-5ace-4328-91ce-4ff3e6e6affd tempest-ProjectReaderTests-510010164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8efc14b6-801c-4b06-962e-611f4feafcdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71ce6d0a-77be-4a3b-8d2f-28b85274031e', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:47:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5e9600a6-5ace-4328-91ce-4ff3e6e6affd tempest-ProjectReaderTests-510010164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a29c1f2-e6b1-4ec8-b274-00c68e53ad4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:47:56 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-5e9600a6-5ace-4328-91ce-4ff3e6e6affd tempest-ProjectReaderTests-510010164 None] Volume volume-71ce6d0a-77be-4a3b-8d2f-28b85274031e (71ce6d0a-77be-4a3b-8d2f-28b85274031e): created successfully Aug 28 09:47:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5e9600a6-5ace-4328-91ce-4ff3e6e6affd tempest-ProjectReaderTests-510010164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a29c1f2-e6b1-4ec8-b274-00c68e53ad4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:47:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5e9600a6-5ace-4328-91ce-4ff3e6e6affd tempest-ProjectReaderTests-510010164 None] Flow 'volume_create_manager' (85f8bf69-fd09-4320-ba6b-4be5aa118f56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:47:56 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-5e9600a6-5ace-4328-91ce-4ff3e6e6affd tempest-ProjectReaderTests-510010164 None] Created volume successfully. Aug 28 09:47:57 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4d169a7f-465a-47cb-a5d6-1c872a1f7f9b tempest-ProjectReaderTests-510010164 None] Acquiring lock "cinder-71ce6d0a-77be-4a3b-8d2f-28b85274031e-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:47:57 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4d169a7f-465a-47cb-a5d6-1c872a1f7f9b tempest-ProjectReaderTests-510010164 None] Lock "cinder-71ce6d0a-77be-4a3b-8d2f-28b85274031e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:47:57 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4d169a7f-465a-47cb-a5d6-1c872a1f7f9b tempest-ProjectReaderTests-510010164 None] Acquiring lock "cinder-quobyte-71ce6d0a-77be-4a3b-8d2f-28b85274031e" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:47:57 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4d169a7f-465a-47cb-a5d6-1c872a1f7f9b tempest-ProjectReaderTests-510010164 None] Lock "cinder-quobyte-71ce6d0a-77be-4a3b-8d2f-28b85274031e" acquired by "delete_volume" :: waited 0.018s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:47:57 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e52c7c-d38f-4096-ae76-3640a43b8a96]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:47:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4d169a7f-465a-47cb-a5d6-1c872a1f7f9b tempest-ProjectReaderTests-510010164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-71ce6d0a-77be-4a3b-8d2f-28b85274031e {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:58 devstack sudo[103202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-71ce6d0a-77be-4a3b-8d2f-28b85274031e Aug 28 09:47:58 devstack sudo[103202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:58 devstack sudo[103202]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4d169a7f-465a-47cb-a5d6-1c872a1f7f9b tempest-ProjectReaderTests-510010164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-71ce6d0a-77be-4a3b-8d2f-28b85274031e" returned: 0 in 0.357s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4d169a7f-465a-47cb-a5d6-1c872a1f7f9b tempest-ProjectReaderTests-510010164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-71ce6d0a-77be-4a3b-8d2f-28b85274031e {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:58 devstack sudo[103207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-71ce6d0a-77be-4a3b-8d2f-28b85274031e Aug 28 09:47:58 devstack sudo[103207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:58 devstack sudo[103207]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4d169a7f-465a-47cb-a5d6-1c872a1f7f9b tempest-ProjectReaderTests-510010164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-71ce6d0a-77be-4a3b-8d2f-28b85274031e" returned: 0 in 0.247s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:58 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4d169a7f-465a-47cb-a5d6-1c872a1f7f9b tempest-ProjectReaderTests-510010164 None] Lock "cinder-quobyte-71ce6d0a-77be-4a3b-8d2f-28b85274031e" released by "delete_volume" :: held 0.655s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:47:58 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-4d169a7f-465a-47cb-a5d6-1c872a1f7f9b tempest-ProjectReaderTests-510010164 None] Created reservations ['0a352816-e9c7-4329-a103-b8f290b47520', 'de694c12-f676-4b65-a298-c152a62577c6', 'ce79f44d-96e4-42ca-8932-6b1a021abf43', '581e78af-a56c-476c-9f4f-ce4e5871e46a'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:47:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-4d169a7f-465a-47cb-a5d6-1c872a1f7f9b tempest-ProjectReaderTests-510010164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:47:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-4d169a7f-465a-47cb-a5d6-1c872a1f7f9b tempest-ProjectReaderTests-510010164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:47:58 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-4d169a7f-465a-47cb-a5d6-1c872a1f7f9b tempest-ProjectReaderTests-510010164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:47:58 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-4d169a7f-465a-47cb-a5d6-1c872a1f7f9b tempest-ProjectReaderTests-510010164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:47:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-4d169a7f-465a-47cb-a5d6-1c872a1f7f9b tempest-ProjectReaderTests-510010164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:47:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4d169a7f-465a-47cb-a5d6-1c872a1f7f9b tempest-ProjectReaderTests-510010164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:58 devstack sudo[103210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:47:58 devstack sudo[103210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:47:58 devstack sudo[103210]: pam_unix(sudo:session): session closed for user root Aug 28 09:47:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4d169a7f-465a-47cb-a5d6-1c872a1f7f9b tempest-ProjectReaderTests-510010164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.309s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:47:58 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-4d169a7f-465a-47cb-a5d6-1c872a1f7f9b tempest-ProjectReaderTests-510010164 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:47:58 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-4d169a7f-465a-47cb-a5d6-1c872a1f7f9b tempest-ProjectReaderTests-510010164 None] Deleted volume successfully. Aug 28 09:47:59 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4d169a7f-465a-47cb-a5d6-1c872a1f7f9b tempest-ProjectReaderTests-510010164 None] Lock "cinder-71ce6d0a-77be-4a3b-8d2f-28b85274031e-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:47:59 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7e15398-a9ca-4bfc-856f-ba5d99d49fcc tempest-ProjectReaderTests-510010164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:47:59 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b7e15398-a9ca-4bfc-856f-ba5d99d49fcc tempest-ProjectReaderTests-510010164 None] Flow 'volume_create_manager' (fd0c2ca2-634f-46e7-b983-d2c956ca2941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:47:59 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b7e15398-a9ca-4bfc-856f-ba5d99d49fcc tempest-ProjectReaderTests-510010164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c59eaf7-f0f1-4590-8ed7-6d1f6d163c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:47:59 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b7e15398-a9ca-4bfc-856f-ba5d99d49fcc tempest-ProjectReaderTests-510010164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c59eaf7-f0f1-4590-8ed7-6d1f6d163c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:47:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-990901431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d717ad09-222e-43fc-afb6-2a5c16f0c044,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83291eebdbbe4ac787503c10bc97dbfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:48:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:48:00Z,use_quota=True,user_id='45de25b9c57e4ee39033d69b4af92639',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:47:59 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b7e15398-a9ca-4bfc-856f-ba5d99d49fcc tempest-ProjectReaderTests-510010164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5fc18c9-8b1f-49c5-a020-5df14e0e1db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:47:59 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b7e15398-a9ca-4bfc-856f-ba5d99d49fcc tempest-ProjectReaderTests-510010164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5fc18c9-8b1f-49c5-a020-5df14e0e1db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:47:59 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b7e15398-a9ca-4bfc-856f-ba5d99d49fcc tempest-ProjectReaderTests-510010164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be03b81b-cf8b-4637-a3c8-002cb8e0e44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:47:59 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b7e15398-a9ca-4bfc-856f-ba5d99d49fcc tempest-ProjectReaderTests-510010164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be03b81b-cf8b-4637-a3c8-002cb8e0e44f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd717ad09-222e-43fc-afb6-2a5c16f0c044', 'volume_name': 'volume-d717ad09-222e-43fc-afb6-2a5c16f0c044', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:47:59 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b7e15398-a9ca-4bfc-856f-ba5d99d49fcc tempest-ProjectReaderTests-510010164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dc2cbf9-414a-4a64-bbd1-54c900ff25ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:47:59 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b7e15398-a9ca-4bfc-856f-ba5d99d49fcc tempest-ProjectReaderTests-510010164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dc2cbf9-414a-4a64-bbd1-54c900ff25ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:47:59 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b7e15398-a9ca-4bfc-856f-ba5d99d49fcc tempest-ProjectReaderTests-510010164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4839a8e7-c3b0-4759-b163-094e9754bdc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:47:59 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-b7e15398-a9ca-4bfc-856f-ba5d99d49fcc tempest-ProjectReaderTests-510010164 None] Volume d717ad09-222e-43fc-afb6-2a5c16f0c044: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d717ad09-222e-43fc-afb6-2a5c16f0c044', 'volume_size': 1} Aug 28 09:47:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b7e15398-a9ca-4bfc-856f-ba5d99d49fcc tempest-ProjectReaderTests-510010164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:47:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b7e15398-a9ca-4bfc-856f-ba5d99d49fcc tempest-ProjectReaderTests-510010164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:47:59 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-b7e15398-a9ca-4bfc-856f-ba5d99d49fcc tempest-ProjectReaderTests-510010164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:47:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-990901431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d717ad09-222e-43fc-afb6-2a5c16f0c044,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83291eebdbbe4ac787503c10bc97dbfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:48:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:48:00Z,use_quota=True,user_id='45de25b9c57e4ee39033d69b4af92639',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:47:59 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-b7e15398-a9ca-4bfc-856f-ba5d99d49fcc tempest-ProjectReaderTests-510010164 None] Creating volume d717ad09-222e-43fc-afb6-2a5c16f0c044 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:47:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b7e15398-a9ca-4bfc-856f-ba5d99d49fcc tempest-ProjectReaderTests-510010164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:47:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b7e15398-a9ca-4bfc-856f-ba5d99d49fcc tempest-ProjectReaderTests-510010164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:47:59 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-b7e15398-a9ca-4bfc-856f-ba5d99d49fcc tempest-ProjectReaderTests-510010164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:47:59 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-b7e15398-a9ca-4bfc-856f-ba5d99d49fcc tempest-ProjectReaderTests-510010164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:47:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b7e15398-a9ca-4bfc-856f-ba5d99d49fcc tempest-ProjectReaderTests-510010164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:47:59 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-b7e15398-a9ca-4bfc-856f-ba5d99d49fcc tempest-ProjectReaderTests-510010164 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:47:59 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-b7e15398-a9ca-4bfc-856f-ba5d99d49fcc tempest-ProjectReaderTests-510010164 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:47:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b7e15398-a9ca-4bfc-856f-ba5d99d49fcc tempest-ProjectReaderTests-510010164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d717ad09-222e-43fc-afb6-2a5c16f0c044 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:47:59 devstack sudo[103214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d717ad09-222e-43fc-afb6-2a5c16f0c044 1073741824 Aug 28 09:47:59 devstack sudo[103214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:48:00 devstack sudo[103214]: pam_unix(sudo:session): session closed for user root Aug 28 09:48:00 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b7e15398-a9ca-4bfc-856f-ba5d99d49fcc tempest-ProjectReaderTests-510010164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d717ad09-222e-43fc-afb6-2a5c16f0c044 1073741824" returned: 0 in 0.464s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:48:00 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b7e15398-a9ca-4bfc-856f-ba5d99d49fcc tempest-ProjectReaderTests-510010164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d717ad09-222e-43fc-afb6-2a5c16f0c044 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:48:00 devstack sudo[103220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d717ad09-222e-43fc-afb6-2a5c16f0c044 Aug 28 09:48:00 devstack sudo[103220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:48:00 devstack sudo[103220]: pam_unix(sudo:session): session closed for user root Aug 28 09:48:00 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b7e15398-a9ca-4bfc-856f-ba5d99d49fcc tempest-ProjectReaderTests-510010164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d717ad09-222e-43fc-afb6-2a5c16f0c044" returned: 0 in 0.278s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:48:00 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-b7e15398-a9ca-4bfc-856f-ba5d99d49fcc tempest-ProjectReaderTests-510010164 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:48:00 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b7e15398-a9ca-4bfc-856f-ba5d99d49fcc tempest-ProjectReaderTests-510010164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:48:00 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b7e15398-a9ca-4bfc-856f-ba5d99d49fcc tempest-ProjectReaderTests-510010164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4839a8e7-c3b0-4759-b163-094e9754bdc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d717ad09-222e-43fc-afb6-2a5c16f0c044', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:48:00 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b7e15398-a9ca-4bfc-856f-ba5d99d49fcc tempest-ProjectReaderTests-510010164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5de62db-9fe5-46cb-a9c4-ad9804f067c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:48:00 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-b7e15398-a9ca-4bfc-856f-ba5d99d49fcc tempest-ProjectReaderTests-510010164 None] Volume volume-d717ad09-222e-43fc-afb6-2a5c16f0c044 (d717ad09-222e-43fc-afb6-2a5c16f0c044): created successfully Aug 28 09:48:00 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b7e15398-a9ca-4bfc-856f-ba5d99d49fcc tempest-ProjectReaderTests-510010164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5de62db-9fe5-46cb-a9c4-ad9804f067c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:48:00 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b7e15398-a9ca-4bfc-856f-ba5d99d49fcc tempest-ProjectReaderTests-510010164 None] Flow 'volume_create_manager' (fd0c2ca2-634f-46e7-b983-d2c956ca2941) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:48:00 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-b7e15398-a9ca-4bfc-856f-ba5d99d49fcc tempest-ProjectReaderTests-510010164 None] Created volume successfully. Aug 28 09:48:01 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-beb4b8c3-33aa-42ac-92b6-a0547b79f997 tempest-ProjectReaderTests-510010164 None] Acquiring lock "cinder-d717ad09-222e-43fc-afb6-2a5c16f0c044-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:48:01 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-beb4b8c3-33aa-42ac-92b6-a0547b79f997 tempest-ProjectReaderTests-510010164 None] Lock "cinder-d717ad09-222e-43fc-afb6-2a5c16f0c044-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:48:01 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-beb4b8c3-33aa-42ac-92b6-a0547b79f997 tempest-ProjectReaderTests-510010164 None] Acquiring lock "cinder-quobyte-d717ad09-222e-43fc-afb6-2a5c16f0c044" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:48:01 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-beb4b8c3-33aa-42ac-92b6-a0547b79f997 tempest-ProjectReaderTests-510010164 None] Lock "cinder-quobyte-d717ad09-222e-43fc-afb6-2a5c16f0c044" acquired by "delete_volume" :: waited 0.025s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:48:01 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae95432-4954-407c-a4d4-0984b735f73b]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:48:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-beb4b8c3-33aa-42ac-92b6-a0547b79f997 tempest-ProjectReaderTests-510010164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d717ad09-222e-43fc-afb6-2a5c16f0c044 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:48:01 devstack sudo[103223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d717ad09-222e-43fc-afb6-2a5c16f0c044 Aug 28 09:48:01 devstack sudo[103223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:48:02 devstack sudo[103223]: pam_unix(sudo:session): session closed for user root Aug 28 09:48:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-beb4b8c3-33aa-42ac-92b6-a0547b79f997 tempest-ProjectReaderTests-510010164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d717ad09-222e-43fc-afb6-2a5c16f0c044" returned: 0 in 0.398s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:48:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-beb4b8c3-33aa-42ac-92b6-a0547b79f997 tempest-ProjectReaderTests-510010164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d717ad09-222e-43fc-afb6-2a5c16f0c044 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:48:02 devstack sudo[103228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d717ad09-222e-43fc-afb6-2a5c16f0c044 Aug 28 09:48:02 devstack sudo[103228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:48:02 devstack sudo[103228]: pam_unix(sudo:session): session closed for user root Aug 28 09:48:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-beb4b8c3-33aa-42ac-92b6-a0547b79f997 tempest-ProjectReaderTests-510010164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d717ad09-222e-43fc-afb6-2a5c16f0c044" returned: 0 in 0.264s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:48:02 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-beb4b8c3-33aa-42ac-92b6-a0547b79f997 tempest-ProjectReaderTests-510010164 None] Lock "cinder-quobyte-d717ad09-222e-43fc-afb6-2a5c16f0c044" released by "delete_volume" :: held 0.706s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:48:02 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-beb4b8c3-33aa-42ac-92b6-a0547b79f997 tempest-ProjectReaderTests-510010164 None] Created reservations ['52dbf5e7-7504-4870-8f5d-8ec3b5e4ebbd', '4bae7749-06cd-49d7-95fa-f5bf6ce9ab2a', '4a62406f-e37e-4442-a15b-8446c35651d8', '464c30a8-7586-4ab3-bab9-44d59edc305d'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:48:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-beb4b8c3-33aa-42ac-92b6-a0547b79f997 tempest-ProjectReaderTests-510010164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:48:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-beb4b8c3-33aa-42ac-92b6-a0547b79f997 tempest-ProjectReaderTests-510010164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:48:02 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-beb4b8c3-33aa-42ac-92b6-a0547b79f997 tempest-ProjectReaderTests-510010164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:48:02 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-beb4b8c3-33aa-42ac-92b6-a0547b79f997 tempest-ProjectReaderTests-510010164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:48:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-beb4b8c3-33aa-42ac-92b6-a0547b79f997 tempest-ProjectReaderTests-510010164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:48:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-beb4b8c3-33aa-42ac-92b6-a0547b79f997 tempest-ProjectReaderTests-510010164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:48:02 devstack sudo[103231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:48:02 devstack sudo[103231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:48:02 devstack sudo[103231]: pam_unix(sudo:session): session closed for user root Aug 28 09:48:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-beb4b8c3-33aa-42ac-92b6-a0547b79f997 tempest-ProjectReaderTests-510010164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.303s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:48:02 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-beb4b8c3-33aa-42ac-92b6-a0547b79f997 tempest-ProjectReaderTests-510010164 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:48:02 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-beb4b8c3-33aa-42ac-92b6-a0547b79f997 tempest-ProjectReaderTests-510010164 None] Deleted volume successfully. Aug 28 09:48:03 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-beb4b8c3-33aa-42ac-92b6-a0547b79f997 tempest-ProjectReaderTests-510010164 None] Lock "cinder-d717ad09-222e-43fc-afb6-2a5c16f0c044-delete_volume" released by "delete_volume" :: held 1.275s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:48:03 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eaa71e0-e313-4f0e-af12-ce92bbc0dde5 tempest-ProjectReaderTests-510010164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:48:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7eaa71e0-e313-4f0e-af12-ce92bbc0dde5 tempest-ProjectReaderTests-510010164 None] Flow 'volume_create_manager' (1e6a4839-89c8-4a04-aebd-46b2a7367406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:48:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7eaa71e0-e313-4f0e-af12-ce92bbc0dde5 tempest-ProjectReaderTests-510010164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (633e683b-8a66-4a53-bc11-3b451b870e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:48:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7eaa71e0-e313-4f0e-af12-ce92bbc0dde5 tempest-ProjectReaderTests-510010164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (633e683b-8a66-4a53-bc11-3b451b870e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:48:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-178783257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9aeaf1f-8e5a-4a79-8c8e-78d197bab3e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83291eebdbbe4ac787503c10bc97dbfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:48:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:48:03Z,use_quota=True,user_id='45de25b9c57e4ee39033d69b4af92639',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:48:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7eaa71e0-e313-4f0e-af12-ce92bbc0dde5 tempest-ProjectReaderTests-510010164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (232f9477-ef42-44a5-8c94-9fdc3cf4e967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:48:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7eaa71e0-e313-4f0e-af12-ce92bbc0dde5 tempest-ProjectReaderTests-510010164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (232f9477-ef42-44a5-8c94-9fdc3cf4e967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:48:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7eaa71e0-e313-4f0e-af12-ce92bbc0dde5 tempest-ProjectReaderTests-510010164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (459c402c-e954-4336-9f99-86d2d2005bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:48:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7eaa71e0-e313-4f0e-af12-ce92bbc0dde5 tempest-ProjectReaderTests-510010164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (459c402c-e954-4336-9f99-86d2d2005bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9aeaf1f-8e5a-4a79-8c8e-78d197bab3e0', 'volume_name': 'volume-f9aeaf1f-8e5a-4a79-8c8e-78d197bab3e0', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:48:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7eaa71e0-e313-4f0e-af12-ce92bbc0dde5 tempest-ProjectReaderTests-510010164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (888fe45d-802d-4160-8b55-4710699340c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:48:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7eaa71e0-e313-4f0e-af12-ce92bbc0dde5 tempest-ProjectReaderTests-510010164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (888fe45d-802d-4160-8b55-4710699340c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:48:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7eaa71e0-e313-4f0e-af12-ce92bbc0dde5 tempest-ProjectReaderTests-510010164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ea92440-a735-43a0-ab7e-86ca41ed53dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:48:03 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-7eaa71e0-e313-4f0e-af12-ce92bbc0dde5 tempest-ProjectReaderTests-510010164 None] Volume f9aeaf1f-8e5a-4a79-8c8e-78d197bab3e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9aeaf1f-8e5a-4a79-8c8e-78d197bab3e0', 'volume_size': 1} Aug 28 09:48:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-7eaa71e0-e313-4f0e-af12-ce92bbc0dde5 tempest-ProjectReaderTests-510010164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:48:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-7eaa71e0-e313-4f0e-af12-ce92bbc0dde5 tempest-ProjectReaderTests-510010164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:48:03 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-7eaa71e0-e313-4f0e-af12-ce92bbc0dde5 tempest-ProjectReaderTests-510010164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:48:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-178783257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9aeaf1f-8e5a-4a79-8c8e-78d197bab3e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83291eebdbbe4ac787503c10bc97dbfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:48:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:48:03Z,use_quota=True,user_id='45de25b9c57e4ee39033d69b4af92639',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:48:03 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-7eaa71e0-e313-4f0e-af12-ce92bbc0dde5 tempest-ProjectReaderTests-510010164 None] Creating volume f9aeaf1f-8e5a-4a79-8c8e-78d197bab3e0 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:48:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-7eaa71e0-e313-4f0e-af12-ce92bbc0dde5 tempest-ProjectReaderTests-510010164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:48:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-7eaa71e0-e313-4f0e-af12-ce92bbc0dde5 tempest-ProjectReaderTests-510010164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:48:03 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-7eaa71e0-e313-4f0e-af12-ce92bbc0dde5 tempest-ProjectReaderTests-510010164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:48:03 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-7eaa71e0-e313-4f0e-af12-ce92bbc0dde5 tempest-ProjectReaderTests-510010164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:48:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-7eaa71e0-e313-4f0e-af12-ce92bbc0dde5 tempest-ProjectReaderTests-510010164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:48:03 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-7eaa71e0-e313-4f0e-af12-ce92bbc0dde5 tempest-ProjectReaderTests-510010164 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:48:03 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-7eaa71e0-e313-4f0e-af12-ce92bbc0dde5 tempest-ProjectReaderTests-510010164 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:48:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7eaa71e0-e313-4f0e-af12-ce92bbc0dde5 tempest-ProjectReaderTests-510010164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f9aeaf1f-8e5a-4a79-8c8e-78d197bab3e0 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:48:03 devstack sudo[103234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f9aeaf1f-8e5a-4a79-8c8e-78d197bab3e0 1073741824 Aug 28 09:48:03 devstack sudo[103234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:48:04 devstack sudo[103234]: pam_unix(sudo:session): session closed for user root Aug 28 09:48:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7eaa71e0-e313-4f0e-af12-ce92bbc0dde5 tempest-ProjectReaderTests-510010164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f9aeaf1f-8e5a-4a79-8c8e-78d197bab3e0 1073741824" returned: 0 in 0.458s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:48:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7eaa71e0-e313-4f0e-af12-ce92bbc0dde5 tempest-ProjectReaderTests-510010164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f9aeaf1f-8e5a-4a79-8c8e-78d197bab3e0 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:48:04 devstack sudo[103240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f9aeaf1f-8e5a-4a79-8c8e-78d197bab3e0 Aug 28 09:48:04 devstack sudo[103240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:48:04 devstack sudo[103240]: pam_unix(sudo:session): session closed for user root Aug 28 09:48:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-7eaa71e0-e313-4f0e-af12-ce92bbc0dde5 tempest-ProjectReaderTests-510010164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f9aeaf1f-8e5a-4a79-8c8e-78d197bab3e0" returned: 0 in 0.287s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:48:04 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-7eaa71e0-e313-4f0e-af12-ce92bbc0dde5 tempest-ProjectReaderTests-510010164 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:48:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-7eaa71e0-e313-4f0e-af12-ce92bbc0dde5 tempest-ProjectReaderTests-510010164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:48:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7eaa71e0-e313-4f0e-af12-ce92bbc0dde5 tempest-ProjectReaderTests-510010164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ea92440-a735-43a0-ab7e-86ca41ed53dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9aeaf1f-8e5a-4a79-8c8e-78d197bab3e0', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:48:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7eaa71e0-e313-4f0e-af12-ce92bbc0dde5 tempest-ProjectReaderTests-510010164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7415822d-4e3e-41ef-b036-409b55513377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:48:04 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-7eaa71e0-e313-4f0e-af12-ce92bbc0dde5 tempest-ProjectReaderTests-510010164 None] Volume volume-f9aeaf1f-8e5a-4a79-8c8e-78d197bab3e0 (f9aeaf1f-8e5a-4a79-8c8e-78d197bab3e0): created successfully Aug 28 09:48:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7eaa71e0-e313-4f0e-af12-ce92bbc0dde5 tempest-ProjectReaderTests-510010164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7415822d-4e3e-41ef-b036-409b55513377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:48:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-7eaa71e0-e313-4f0e-af12-ce92bbc0dde5 tempest-ProjectReaderTests-510010164 None] Flow 'volume_create_manager' (1e6a4839-89c8-4a04-aebd-46b2a7367406) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:48:04 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-7eaa71e0-e313-4f0e-af12-ce92bbc0dde5 tempest-ProjectReaderTests-510010164 None] Created volume successfully. Aug 28 09:48:05 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-318a3f08-69a9-4e21-b017-15687ce3275b tempest-ProjectReaderTests-510010164 None] Acquiring lock "cinder-f9aeaf1f-8e5a-4a79-8c8e-78d197bab3e0-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:48:05 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-318a3f08-69a9-4e21-b017-15687ce3275b tempest-ProjectReaderTests-510010164 None] Lock "cinder-f9aeaf1f-8e5a-4a79-8c8e-78d197bab3e0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:48:05 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-318a3f08-69a9-4e21-b017-15687ce3275b tempest-ProjectReaderTests-510010164 None] Acquiring lock "cinder-quobyte-f9aeaf1f-8e5a-4a79-8c8e-78d197bab3e0" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:48:05 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-318a3f08-69a9-4e21-b017-15687ce3275b tempest-ProjectReaderTests-510010164 None] Lock "cinder-quobyte-f9aeaf1f-8e5a-4a79-8c8e-78d197bab3e0" acquired by "delete_volume" :: waited 0.022s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:48:05 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d10c69-b397-421e-8ed2-2e7bdabbe489]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:48:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-318a3f08-69a9-4e21-b017-15687ce3275b tempest-ProjectReaderTests-510010164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f9aeaf1f-8e5a-4a79-8c8e-78d197bab3e0 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:48:05 devstack sudo[103249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f9aeaf1f-8e5a-4a79-8c8e-78d197bab3e0 Aug 28 09:48:05 devstack sudo[103249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:48:06 devstack sudo[103249]: pam_unix(sudo:session): session closed for user root Aug 28 09:48:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-318a3f08-69a9-4e21-b017-15687ce3275b tempest-ProjectReaderTests-510010164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f9aeaf1f-8e5a-4a79-8c8e-78d197bab3e0" returned: 0 in 0.429s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:48:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-318a3f08-69a9-4e21-b017-15687ce3275b tempest-ProjectReaderTests-510010164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f9aeaf1f-8e5a-4a79-8c8e-78d197bab3e0 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:48:06 devstack sudo[103255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f9aeaf1f-8e5a-4a79-8c8e-78d197bab3e0 Aug 28 09:48:06 devstack sudo[103255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:48:06 devstack sudo[103255]: pam_unix(sudo:session): session closed for user root Aug 28 09:48:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-318a3f08-69a9-4e21-b017-15687ce3275b tempest-ProjectReaderTests-510010164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f9aeaf1f-8e5a-4a79-8c8e-78d197bab3e0" returned: 0 in 0.271s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:48:06 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-318a3f08-69a9-4e21-b017-15687ce3275b tempest-ProjectReaderTests-510010164 None] Lock "cinder-quobyte-f9aeaf1f-8e5a-4a79-8c8e-78d197bab3e0" released by "delete_volume" :: held 0.747s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:48:06 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-318a3f08-69a9-4e21-b017-15687ce3275b tempest-ProjectReaderTests-510010164 None] Created reservations ['becc27af-6869-4925-afab-dd72b0c5a6f8', '6d2d37f3-3b38-4578-a477-e048bd449fda', 'adbbe609-3ed6-4e4c-9bd3-535f07d99cfd', 'e4a47733-6ea7-48de-bc40-7f95e1b9dd95'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:48:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-318a3f08-69a9-4e21-b017-15687ce3275b tempest-ProjectReaderTests-510010164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:48:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-318a3f08-69a9-4e21-b017-15687ce3275b tempest-ProjectReaderTests-510010164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:48:06 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-318a3f08-69a9-4e21-b017-15687ce3275b tempest-ProjectReaderTests-510010164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:48:06 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-318a3f08-69a9-4e21-b017-15687ce3275b tempest-ProjectReaderTests-510010164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:48:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-318a3f08-69a9-4e21-b017-15687ce3275b tempest-ProjectReaderTests-510010164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:48:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-318a3f08-69a9-4e21-b017-15687ce3275b tempest-ProjectReaderTests-510010164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:48:06 devstack sudo[103258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:48:06 devstack sudo[103258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:48:06 devstack sudo[103258]: pam_unix(sudo:session): session closed for user root Aug 28 09:48:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-318a3f08-69a9-4e21-b017-15687ce3275b tempest-ProjectReaderTests-510010164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.310s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:48:06 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-318a3f08-69a9-4e21-b017-15687ce3275b tempest-ProjectReaderTests-510010164 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:48:06 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-318a3f08-69a9-4e21-b017-15687ce3275b tempest-ProjectReaderTests-510010164 None] Deleted volume successfully. Aug 28 09:48:06 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-318a3f08-69a9-4e21-b017-15687ce3275b tempest-ProjectReaderTests-510010164 None] Lock "cinder-f9aeaf1f-8e5a-4a79-8c8e-78d197bab3e0-delete_volume" released by "delete_volume" :: held 1.307s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:48:07 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6b86595-4f47-4ebc-8535-e5caf35f790d tempest-ProjectReaderTests-510010164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:48:07 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f6b86595-4f47-4ebc-8535-e5caf35f790d tempest-ProjectReaderTests-510010164 None] Flow 'volume_create_manager' (1e138f7a-7b37-4c93-afb6-b4dc467bb508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:48:07 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f6b86595-4f47-4ebc-8535-e5caf35f790d tempest-ProjectReaderTests-510010164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97dd330d-ed9e-4b98-9a33-e5a463fc72f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:48:07 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f6b86595-4f47-4ebc-8535-e5caf35f790d tempest-ProjectReaderTests-510010164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97dd330d-ed9e-4b98-9a33-e5a463fc72f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:48:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1758375303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a2d768e-93e1-4134-ad50-1c0298e9e27f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83291eebdbbe4ac787503c10bc97dbfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:48:07Z,use_quota=True,user_id='45de25b9c57e4ee39033d69b4af92639',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:48:07 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f6b86595-4f47-4ebc-8535-e5caf35f790d tempest-ProjectReaderTests-510010164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fef9b07-b02f-408b-862a-62eddb7f6672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:48:07 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f6b86595-4f47-4ebc-8535-e5caf35f790d tempest-ProjectReaderTests-510010164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fef9b07-b02f-408b-862a-62eddb7f6672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:48:07 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f6b86595-4f47-4ebc-8535-e5caf35f790d tempest-ProjectReaderTests-510010164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89f42c08-7a74-4729-9d80-cd6c971b2fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:48:07 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f6b86595-4f47-4ebc-8535-e5caf35f790d tempest-ProjectReaderTests-510010164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89f42c08-7a74-4729-9d80-cd6c971b2fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a2d768e-93e1-4134-ad50-1c0298e9e27f', 'volume_name': 'volume-1a2d768e-93e1-4134-ad50-1c0298e9e27f', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:48:07 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f6b86595-4f47-4ebc-8535-e5caf35f790d tempest-ProjectReaderTests-510010164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59c070ef-363b-4c63-b83d-d4506eeb405e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:48:07 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f6b86595-4f47-4ebc-8535-e5caf35f790d tempest-ProjectReaderTests-510010164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59c070ef-363b-4c63-b83d-d4506eeb405e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:48:07 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f6b86595-4f47-4ebc-8535-e5caf35f790d tempest-ProjectReaderTests-510010164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c199617-3ab0-4bb4-9f4a-2a043d19bff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:48:07 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-f6b86595-4f47-4ebc-8535-e5caf35f790d tempest-ProjectReaderTests-510010164 None] Volume 1a2d768e-93e1-4134-ad50-1c0298e9e27f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a2d768e-93e1-4134-ad50-1c0298e9e27f', 'volume_size': 1} Aug 28 09:48:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f6b86595-4f47-4ebc-8535-e5caf35f790d tempest-ProjectReaderTests-510010164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:48:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f6b86595-4f47-4ebc-8535-e5caf35f790d tempest-ProjectReaderTests-510010164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:48:07 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-f6b86595-4f47-4ebc-8535-e5caf35f790d tempest-ProjectReaderTests-510010164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:48:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1758375303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a2d768e-93e1-4134-ad50-1c0298e9e27f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83291eebdbbe4ac787503c10bc97dbfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:48:07Z,use_quota=True,user_id='45de25b9c57e4ee39033d69b4af92639',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:48:07 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-f6b86595-4f47-4ebc-8535-e5caf35f790d tempest-ProjectReaderTests-510010164 None] Creating volume 1a2d768e-93e1-4134-ad50-1c0298e9e27f {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:48:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f6b86595-4f47-4ebc-8535-e5caf35f790d tempest-ProjectReaderTests-510010164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:48:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f6b86595-4f47-4ebc-8535-e5caf35f790d tempest-ProjectReaderTests-510010164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:48:07 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-f6b86595-4f47-4ebc-8535-e5caf35f790d tempest-ProjectReaderTests-510010164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:48:07 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-f6b86595-4f47-4ebc-8535-e5caf35f790d tempest-ProjectReaderTests-510010164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:48:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f6b86595-4f47-4ebc-8535-e5caf35f790d tempest-ProjectReaderTests-510010164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:48:07 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-f6b86595-4f47-4ebc-8535-e5caf35f790d tempest-ProjectReaderTests-510010164 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:48:07 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-f6b86595-4f47-4ebc-8535-e5caf35f790d tempest-ProjectReaderTests-510010164 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:48:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f6b86595-4f47-4ebc-8535-e5caf35f790d tempest-ProjectReaderTests-510010164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1a2d768e-93e1-4134-ad50-1c0298e9e27f 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:48:07 devstack sudo[103261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1a2d768e-93e1-4134-ad50-1c0298e9e27f 1073741824 Aug 28 09:48:07 devstack sudo[103261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:48:07 devstack sudo[103261]: pam_unix(sudo:session): session closed for user root Aug 28 09:48:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f6b86595-4f47-4ebc-8535-e5caf35f790d tempest-ProjectReaderTests-510010164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1a2d768e-93e1-4134-ad50-1c0298e9e27f 1073741824" returned: 0 in 0.492s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:48:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f6b86595-4f47-4ebc-8535-e5caf35f790d tempest-ProjectReaderTests-510010164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1a2d768e-93e1-4134-ad50-1c0298e9e27f {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:48:08 devstack sudo[103267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1a2d768e-93e1-4134-ad50-1c0298e9e27f Aug 28 09:48:08 devstack sudo[103267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:48:08 devstack sudo[103267]: pam_unix(sudo:session): session closed for user root Aug 28 09:48:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f6b86595-4f47-4ebc-8535-e5caf35f790d tempest-ProjectReaderTests-510010164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1a2d768e-93e1-4134-ad50-1c0298e9e27f" returned: 0 in 0.254s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:48:08 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-f6b86595-4f47-4ebc-8535-e5caf35f790d tempest-ProjectReaderTests-510010164 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:48:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f6b86595-4f47-4ebc-8535-e5caf35f790d tempest-ProjectReaderTests-510010164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:48:08 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f6b86595-4f47-4ebc-8535-e5caf35f790d tempest-ProjectReaderTests-510010164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c199617-3ab0-4bb4-9f4a-2a043d19bff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a2d768e-93e1-4134-ad50-1c0298e9e27f', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:48:08 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f6b86595-4f47-4ebc-8535-e5caf35f790d tempest-ProjectReaderTests-510010164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d76357c9-5eda-4bb1-922d-bfacca00096e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:48:08 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-f6b86595-4f47-4ebc-8535-e5caf35f790d tempest-ProjectReaderTests-510010164 None] Volume volume-1a2d768e-93e1-4134-ad50-1c0298e9e27f (1a2d768e-93e1-4134-ad50-1c0298e9e27f): created successfully Aug 28 09:48:08 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f6b86595-4f47-4ebc-8535-e5caf35f790d tempest-ProjectReaderTests-510010164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d76357c9-5eda-4bb1-922d-bfacca00096e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:48:08 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f6b86595-4f47-4ebc-8535-e5caf35f790d tempest-ProjectReaderTests-510010164 None] Flow 'volume_create_manager' (1e138f7a-7b37-4c93-afb6-b4dc467bb508) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:48:08 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-f6b86595-4f47-4ebc-8535-e5caf35f790d tempest-ProjectReaderTests-510010164 None] Created volume successfully. Aug 28 09:48:09 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-057f9b15-abf1-41a3-85ce-1e77625474fd tempest-ProjectReaderTests-510010164 None] Acquiring lock "cinder-1a2d768e-93e1-4134-ad50-1c0298e9e27f-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:48:09 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-057f9b15-abf1-41a3-85ce-1e77625474fd tempest-ProjectReaderTests-510010164 None] Lock "cinder-1a2d768e-93e1-4134-ad50-1c0298e9e27f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:48:09 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-057f9b15-abf1-41a3-85ce-1e77625474fd tempest-ProjectReaderTests-510010164 None] Acquiring lock "cinder-quobyte-1a2d768e-93e1-4134-ad50-1c0298e9e27f" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:48:09 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-057f9b15-abf1-41a3-85ce-1e77625474fd tempest-ProjectReaderTests-510010164 None] Lock "cinder-quobyte-1a2d768e-93e1-4134-ad50-1c0298e9e27f" acquired by "delete_volume" :: waited 0.018s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:48:09 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13d3a7c-fac4-4dda-9ef9-600c657ecc9c]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:48:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-057f9b15-abf1-41a3-85ce-1e77625474fd tempest-ProjectReaderTests-510010164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1a2d768e-93e1-4134-ad50-1c0298e9e27f {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:48:09 devstack sudo[103274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1a2d768e-93e1-4134-ad50-1c0298e9e27f Aug 28 09:48:09 devstack sudo[103274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:48:10 devstack sudo[103274]: pam_unix(sudo:session): session closed for user root Aug 28 09:48:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-057f9b15-abf1-41a3-85ce-1e77625474fd tempest-ProjectReaderTests-510010164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1a2d768e-93e1-4134-ad50-1c0298e9e27f" returned: 0 in 0.462s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:48:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-057f9b15-abf1-41a3-85ce-1e77625474fd tempest-ProjectReaderTests-510010164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1a2d768e-93e1-4134-ad50-1c0298e9e27f {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:48:10 devstack sudo[103280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1a2d768e-93e1-4134-ad50-1c0298e9e27f Aug 28 09:48:10 devstack sudo[103280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:48:10 devstack sudo[103280]: pam_unix(sudo:session): session closed for user root Aug 28 09:48:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-057f9b15-abf1-41a3-85ce-1e77625474fd tempest-ProjectReaderTests-510010164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1a2d768e-93e1-4134-ad50-1c0298e9e27f" returned: 0 in 0.292s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:48:10 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-057f9b15-abf1-41a3-85ce-1e77625474fd tempest-ProjectReaderTests-510010164 None] Lock "cinder-quobyte-1a2d768e-93e1-4134-ad50-1c0298e9e27f" released by "delete_volume" :: held 0.801s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:48:10 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-057f9b15-abf1-41a3-85ce-1e77625474fd tempest-ProjectReaderTests-510010164 None] Created reservations ['78de219f-01ac-485e-92f9-aba13c211f94', '223e84be-ce6b-4204-aa82-e8ddd20f4266', '4b7d6456-f7aa-4e8b-b89a-317b1104da85', 'ea3658e1-c2df-49fb-af5a-b51b7a2d2ce7'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:48:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-057f9b15-abf1-41a3-85ce-1e77625474fd tempest-ProjectReaderTests-510010164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:48:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-057f9b15-abf1-41a3-85ce-1e77625474fd tempest-ProjectReaderTests-510010164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:48:10 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-057f9b15-abf1-41a3-85ce-1e77625474fd tempest-ProjectReaderTests-510010164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:48:10 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-057f9b15-abf1-41a3-85ce-1e77625474fd tempest-ProjectReaderTests-510010164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:48:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-057f9b15-abf1-41a3-85ce-1e77625474fd tempest-ProjectReaderTests-510010164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:48:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-057f9b15-abf1-41a3-85ce-1e77625474fd tempest-ProjectReaderTests-510010164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:48:10 devstack sudo[103294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:48:10 devstack sudo[103294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:48:10 devstack sudo[103294]: pam_unix(sudo:session): session closed for user root Aug 28 09:48:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-057f9b15-abf1-41a3-85ce-1e77625474fd tempest-ProjectReaderTests-510010164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.398s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:48:10 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-057f9b15-abf1-41a3-85ce-1e77625474fd tempest-ProjectReaderTests-510010164 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:48:10 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-057f9b15-abf1-41a3-85ce-1e77625474fd tempest-ProjectReaderTests-510010164 None] Deleted volume successfully. Aug 28 09:48:11 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-057f9b15-abf1-41a3-85ce-1e77625474fd tempest-ProjectReaderTests-510010164 None] Lock "cinder-1a2d768e-93e1-4134-ad50-1c0298e9e27f-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:48:20 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writing DB stats cinder:SELECT=33,cinder:UPDATE=44,cinder:INSERT=9,cinder:DELETE=3 {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:48:21 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writing DB stats cinder:UPDATE=44,cinder:SELECT=23,cinder:DELETE=5,cinder:INSERT=11 {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:48:31 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writing DB stats cinder:SELECT=1 {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:48:31 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writing DB stats cinder:UPDATE=1 {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:48:38 devstack cinder-volume[86081]: DEBUG oslo_service.periodic_task [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86081) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:48:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:48:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:48:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:48:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:48:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:48:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:48:38 devstack sudo[103429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:48:38 devstack sudo[103429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:48:38 devstack sudo[103429]: pam_unix(sudo:session): session closed for user root Aug 28 09:48:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.295s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:48:38 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:48:38 devstack cinder-volume[86081]: DEBUG oslo_service.periodic_task [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running periodic task VolumeManager._thread_info {{(pid=86081) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:48:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] thread count: 28 {{(pid=86081) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 09:48:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] thread info: [<_MainThread(MainThread, started 129914189705344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86081) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 09:48:38 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-64be2530-27ce-4c30-b577-e7f887986c70 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:48:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-64be2530-27ce-4c30-b577-e7f887986c70 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] Flow 'volume_create_manager' (17a0e1f7-9a01-4c7b-8d55-8f133d7ca4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:48:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-64be2530-27ce-4c30-b577-e7f887986c70 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fdd7e46-f21b-47d8-98c2-66b982779800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:48:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-64be2530-27ce-4c30-b577-e7f887986c70 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fdd7e46-f21b-47d8-98c2-66b982779800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:48:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-90598840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c26dba3-98af-4a88-866c-52b7330dab04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57685d1edfc44f33abc74d189bffd3b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:48:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:48:39Z,use_quota=True,user_id='1aac998488cd4798ac055e834095d0ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:48:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-64be2530-27ce-4c30-b577-e7f887986c70 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a83d519d-d85c-467f-a37d-dfd14fa6835a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:48:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-64be2530-27ce-4c30-b577-e7f887986c70 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a83d519d-d85c-467f-a37d-dfd14fa6835a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:48:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-64be2530-27ce-4c30-b577-e7f887986c70 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4692ef27-b809-4a6f-86da-6575594dc12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:48:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-64be2530-27ce-4c30-b577-e7f887986c70 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4692ef27-b809-4a6f-86da-6575594dc12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c26dba3-98af-4a88-866c-52b7330dab04', 'volume_name': 'volume-2c26dba3-98af-4a88-866c-52b7330dab04', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:48:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-64be2530-27ce-4c30-b577-e7f887986c70 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f855806-0c50-484a-9992-2a347a7ce194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:48:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-64be2530-27ce-4c30-b577-e7f887986c70 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f855806-0c50-484a-9992-2a347a7ce194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:48:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-64be2530-27ce-4c30-b577-e7f887986c70 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f7f8125-a650-40db-bbfd-fc9b46cc25d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:48:38 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-64be2530-27ce-4c30-b577-e7f887986c70 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] Volume 2c26dba3-98af-4a88-866c-52b7330dab04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c26dba3-98af-4a88-866c-52b7330dab04', 'volume_size': 1} Aug 28 09:48:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-64be2530-27ce-4c30-b577-e7f887986c70 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:48:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-64be2530-27ce-4c30-b577-e7f887986c70 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:48:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-64be2530-27ce-4c30-b577-e7f887986c70 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:48:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-90598840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c26dba3-98af-4a88-866c-52b7330dab04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57685d1edfc44f33abc74d189bffd3b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:48:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:48:39Z,use_quota=True,user_id='1aac998488cd4798ac055e834095d0ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:48:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-64be2530-27ce-4c30-b577-e7f887986c70 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] Creating volume 2c26dba3-98af-4a88-866c-52b7330dab04 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:48:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-64be2530-27ce-4c30-b577-e7f887986c70 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:48:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-64be2530-27ce-4c30-b577-e7f887986c70 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:48:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-64be2530-27ce-4c30-b577-e7f887986c70 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:48:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-64be2530-27ce-4c30-b577-e7f887986c70 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:48:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-64be2530-27ce-4c30-b577-e7f887986c70 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:48:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-64be2530-27ce-4c30-b577-e7f887986c70 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:48:38 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-64be2530-27ce-4c30-b577-e7f887986c70 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:48:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-64be2530-27ce-4c30-b577-e7f887986c70 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2c26dba3-98af-4a88-866c-52b7330dab04 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:48:38 devstack sudo[103437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2c26dba3-98af-4a88-866c-52b7330dab04 1073741824 Aug 28 09:48:38 devstack sudo[103437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:48:39 devstack sudo[103437]: pam_unix(sudo:session): session closed for user root Aug 28 09:48:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-64be2530-27ce-4c30-b577-e7f887986c70 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2c26dba3-98af-4a88-866c-52b7330dab04 1073741824" returned: 0 in 0.464s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:48:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-64be2530-27ce-4c30-b577-e7f887986c70 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2c26dba3-98af-4a88-866c-52b7330dab04 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:48:39 devstack sudo[103447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2c26dba3-98af-4a88-866c-52b7330dab04 Aug 28 09:48:39 devstack sudo[103447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:48:39 devstack sudo[103447]: pam_unix(sudo:session): session closed for user root Aug 28 09:48:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-64be2530-27ce-4c30-b577-e7f887986c70 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2c26dba3-98af-4a88-866c-52b7330dab04" returned: 0 in 0.257s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:48:39 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-64be2530-27ce-4c30-b577-e7f887986c70 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:48:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-64be2530-27ce-4c30-b577-e7f887986c70 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:48:39 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-64be2530-27ce-4c30-b577-e7f887986c70 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f7f8125-a650-40db-bbfd-fc9b46cc25d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c26dba3-98af-4a88-866c-52b7330dab04', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:48:39 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-64be2530-27ce-4c30-b577-e7f887986c70 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37d04e0d-4b61-4d13-bc3c-14d2671d96ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:48:39 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-64be2530-27ce-4c30-b577-e7f887986c70 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] Volume volume-2c26dba3-98af-4a88-866c-52b7330dab04 (2c26dba3-98af-4a88-866c-52b7330dab04): created successfully Aug 28 09:48:39 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-64be2530-27ce-4c30-b577-e7f887986c70 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37d04e0d-4b61-4d13-bc3c-14d2671d96ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:48:39 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-64be2530-27ce-4c30-b577-e7f887986c70 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] Flow 'volume_create_manager' (17a0e1f7-9a01-4c7b-8d55-8f133d7ca4a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:48:39 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-64be2530-27ce-4c30-b577-e7f887986c70 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] Created volume successfully. Aug 28 09:48:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-4e08e285-0357-4cae-bddd-fcfb07d155e1 req-c0924060-10ab-45c6-a1d3-d83695afd1ce tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:48:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-4e08e285-0357-4cae-bddd-fcfb07d155e1 req-c0924060-10ab-45c6-a1d3-d83695afd1ce tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:48:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [req-4e08e285-0357-4cae-bddd-fcfb07d155e1 req-c0924060-10ab-45c6-a1d3-d83695afd1ce tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:48:41 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-4e08e285-0357-4cae-bddd-fcfb07d155e1 req-c0924060-10ab-45c6-a1d3-d83695afd1ce tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b', 'name': 'volume-2c26dba3-98af-4a88-866c-52b7330dab04', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2788ff5d-42ab-4135-af47-ab278fb1ca44', 'enforce_multipath': True} {{(pid=86081) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 09:48:41 devstack cinder-volume[86081]: INFO cinder.volume.manager [req-4e08e285-0357-4cae-bddd-fcfb07d155e1 req-c0924060-10ab-45c6-a1d3-d83695afd1ce tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] attachment_update completed successfully. Aug 28 09:48:43 devstack cinder-volume[86081]: INFO cinder.volume.manager [req-1f2877cb-3ca2-4fb6-abed-ccab8e099e0c req-bb8a6b6e-e7ae-44dd-9df0-827a8b478a96 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] Terminate volume connection completed successfully. Aug 28 09:48:43 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [req-1f2877cb-3ca2-4fb6-abed-ccab8e099e0c req-bb8a6b6e-e7ae-44dd-9df0-827a8b478a96 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] Deleting attachment 2788ff5d-42ab-4135-af47-ab278fb1ca44. {{(pid=86081) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 09:48:44 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-bf81421e-1940-4a36-b806-55f97fe19008 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] Acquiring lock "cinder-2c26dba3-98af-4a88-866c-52b7330dab04-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:48:44 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-bf81421e-1940-4a36-b806-55f97fe19008 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] Lock "cinder-2c26dba3-98af-4a88-866c-52b7330dab04-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:48:44 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-bf81421e-1940-4a36-b806-55f97fe19008 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] Acquiring lock "cinder-quobyte-2c26dba3-98af-4a88-866c-52b7330dab04" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:48:44 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-bf81421e-1940-4a36-b806-55f97fe19008 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] Lock "cinder-quobyte-2c26dba3-98af-4a88-866c-52b7330dab04" acquired by "delete_volume" :: waited 0.013s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:48:44 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[1301764a-73a4-466d-b567-4e5e41432632]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:48:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bf81421e-1940-4a36-b806-55f97fe19008 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2c26dba3-98af-4a88-866c-52b7330dab04 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:48:44 devstack sudo[103871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2c26dba3-98af-4a88-866c-52b7330dab04 Aug 28 09:48:44 devstack sudo[103871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:48:45 devstack sudo[103871]: pam_unix(sudo:session): session closed for user root Aug 28 09:48:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bf81421e-1940-4a36-b806-55f97fe19008 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2c26dba3-98af-4a88-866c-52b7330dab04" returned: 0 in 0.358s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:48:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bf81421e-1940-4a36-b806-55f97fe19008 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2c26dba3-98af-4a88-866c-52b7330dab04 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:48:45 devstack sudo[103876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2c26dba3-98af-4a88-866c-52b7330dab04 Aug 28 09:48:45 devstack sudo[103876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:48:45 devstack sudo[103876]: pam_unix(sudo:session): session closed for user root Aug 28 09:48:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bf81421e-1940-4a36-b806-55f97fe19008 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2c26dba3-98af-4a88-866c-52b7330dab04" returned: 0 in 0.262s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:48:45 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-bf81421e-1940-4a36-b806-55f97fe19008 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] Lock "cinder-quobyte-2c26dba3-98af-4a88-866c-52b7330dab04" released by "delete_volume" :: held 0.658s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:48:45 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-bf81421e-1940-4a36-b806-55f97fe19008 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] Created reservations ['96dbfe4c-37b9-46e0-b219-4768c5da7ce3', 'df1570aa-0510-4fc8-92e8-a14a0fdecc21', '0479082d-99e0-4043-a545-85f168772323', 'dee1e798-4ed7-4354-894b-b0b136a31fe6'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:48:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-bf81421e-1940-4a36-b806-55f97fe19008 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:48:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-bf81421e-1940-4a36-b806-55f97fe19008 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:48:45 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-bf81421e-1940-4a36-b806-55f97fe19008 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:48:45 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-bf81421e-1940-4a36-b806-55f97fe19008 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:48:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-bf81421e-1940-4a36-b806-55f97fe19008 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:48:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bf81421e-1940-4a36-b806-55f97fe19008 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:48:45 devstack sudo[103879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:48:45 devstack sudo[103879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:48:45 devstack sudo[103879]: pam_unix(sudo:session): session closed for user root Aug 28 09:48:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bf81421e-1940-4a36-b806-55f97fe19008 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.235s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:48:45 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-bf81421e-1940-4a36-b806-55f97fe19008 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:48:45 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-bf81421e-1940-4a36-b806-55f97fe19008 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] Deleted volume successfully. Aug 28 09:48:45 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-bf81421e-1940-4a36-b806-55f97fe19008 tempest-TestServerVolumeAttachScenarioOldVersion-1260012863 None] Lock "cinder-2c26dba3-98af-4a88-866c-52b7330dab04-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:48:55 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writing DB stats cinder:SELECT=15,cinder:UPDATE=12,cinder:INSERT=3 {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:48:55 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writing DB stats cinder:UPDATE=13,cinder:SELECT=14,cinder:DELETE=2,cinder:INSERT=2 {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:49:00 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ee21815-3343-4d54-87ee-04a6ff1168ac tempest-ProjectReaderTests-456281769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:49:00 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1ee21815-3343-4d54-87ee-04a6ff1168ac tempest-ProjectReaderTests-456281769 None] Flow 'volume_create_manager' (37ff138c-efa2-479c-a815-6b098d767b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:49:00 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1ee21815-3343-4d54-87ee-04a6ff1168ac tempest-ProjectReaderTests-456281769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (948f3d0a-cfd8-41e0-bf64-e3d699529a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:00 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1ee21815-3343-4d54-87ee-04a6ff1168ac tempest-ProjectReaderTests-456281769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (948f3d0a-cfd8-41e0-bf64-e3d699529a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-418530697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a21ce9ab-9595-40f5-8f72-ff079e1806e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d40fa3944ade441fba05705623dd8964',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:00Z,use_quota=True,user_id='4d43805f6fe04c53b4932b0f4a6dc8aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:00 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1ee21815-3343-4d54-87ee-04a6ff1168ac tempest-ProjectReaderTests-456281769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5f6877b-4999-45bd-a31c-76254b5bdba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:00 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1ee21815-3343-4d54-87ee-04a6ff1168ac tempest-ProjectReaderTests-456281769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5f6877b-4999-45bd-a31c-76254b5bdba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:00 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1ee21815-3343-4d54-87ee-04a6ff1168ac tempest-ProjectReaderTests-456281769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (389988d2-f282-46bb-9dc9-c52c6c633a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:00 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1ee21815-3343-4d54-87ee-04a6ff1168ac tempest-ProjectReaderTests-456281769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (389988d2-f282-46bb-9dc9-c52c6c633a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a21ce9ab-9595-40f5-8f72-ff079e1806e3', 'volume_name': 'volume-a21ce9ab-9595-40f5-8f72-ff079e1806e3', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:00 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1ee21815-3343-4d54-87ee-04a6ff1168ac tempest-ProjectReaderTests-456281769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbaa894d-e60d-471b-9001-4b288e10828b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:00 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1ee21815-3343-4d54-87ee-04a6ff1168ac tempest-ProjectReaderTests-456281769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbaa894d-e60d-471b-9001-4b288e10828b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:00 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1ee21815-3343-4d54-87ee-04a6ff1168ac tempest-ProjectReaderTests-456281769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9e68dc2-fd60-47a1-839f-76fdfa31bbc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:00 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-1ee21815-3343-4d54-87ee-04a6ff1168ac tempest-ProjectReaderTests-456281769 None] Volume a21ce9ab-9595-40f5-8f72-ff079e1806e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a21ce9ab-9595-40f5-8f72-ff079e1806e3', 'volume_size': 1} Aug 28 09:49:00 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-1ee21815-3343-4d54-87ee-04a6ff1168ac tempest-ProjectReaderTests-456281769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:00 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-1ee21815-3343-4d54-87ee-04a6ff1168ac tempest-ProjectReaderTests-456281769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:00 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-1ee21815-3343-4d54-87ee-04a6ff1168ac tempest-ProjectReaderTests-456281769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-418530697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a21ce9ab-9595-40f5-8f72-ff079e1806e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d40fa3944ade441fba05705623dd8964',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:00Z,use_quota=True,user_id='4d43805f6fe04c53b4932b0f4a6dc8aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:49:00 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-1ee21815-3343-4d54-87ee-04a6ff1168ac tempest-ProjectReaderTests-456281769 None] Creating volume a21ce9ab-9595-40f5-8f72-ff079e1806e3 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:49:00 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-1ee21815-3343-4d54-87ee-04a6ff1168ac tempest-ProjectReaderTests-456281769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:00 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-1ee21815-3343-4d54-87ee-04a6ff1168ac tempest-ProjectReaderTests-456281769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:00 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-1ee21815-3343-4d54-87ee-04a6ff1168ac tempest-ProjectReaderTests-456281769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:49:00 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-1ee21815-3343-4d54-87ee-04a6ff1168ac tempest-ProjectReaderTests-456281769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:49:00 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-1ee21815-3343-4d54-87ee-04a6ff1168ac tempest-ProjectReaderTests-456281769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:00 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-1ee21815-3343-4d54-87ee-04a6ff1168ac tempest-ProjectReaderTests-456281769 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:49:00 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-1ee21815-3343-4d54-87ee-04a6ff1168ac tempest-ProjectReaderTests-456281769 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:49:00 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1ee21815-3343-4d54-87ee-04a6ff1168ac tempest-ProjectReaderTests-456281769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a21ce9ab-9595-40f5-8f72-ff079e1806e3 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:00 devstack sudo[103915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a21ce9ab-9595-40f5-8f72-ff079e1806e3 1073741824 Aug 28 09:49:00 devstack sudo[103915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:00 devstack sudo[103915]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:00 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1ee21815-3343-4d54-87ee-04a6ff1168ac tempest-ProjectReaderTests-456281769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a21ce9ab-9595-40f5-8f72-ff079e1806e3 1073741824" returned: 0 in 0.402s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1ee21815-3343-4d54-87ee-04a6ff1168ac tempest-ProjectReaderTests-456281769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a21ce9ab-9595-40f5-8f72-ff079e1806e3 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:01 devstack sudo[103920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a21ce9ab-9595-40f5-8f72-ff079e1806e3 Aug 28 09:49:01 devstack sudo[103920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:01 devstack sudo[103920]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1ee21815-3343-4d54-87ee-04a6ff1168ac tempest-ProjectReaderTests-456281769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a21ce9ab-9595-40f5-8f72-ff079e1806e3" returned: 0 in 0.239s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:01 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-1ee21815-3343-4d54-87ee-04a6ff1168ac tempest-ProjectReaderTests-456281769 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:49:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-1ee21815-3343-4d54-87ee-04a6ff1168ac tempest-ProjectReaderTests-456281769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:01 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1ee21815-3343-4d54-87ee-04a6ff1168ac tempest-ProjectReaderTests-456281769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9e68dc2-fd60-47a1-839f-76fdfa31bbc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a21ce9ab-9595-40f5-8f72-ff079e1806e3', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:01 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1ee21815-3343-4d54-87ee-04a6ff1168ac tempest-ProjectReaderTests-456281769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f01bc715-e23f-41cd-9677-b2123a44cfc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:01 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-1ee21815-3343-4d54-87ee-04a6ff1168ac tempest-ProjectReaderTests-456281769 None] Volume volume-a21ce9ab-9595-40f5-8f72-ff079e1806e3 (a21ce9ab-9595-40f5-8f72-ff079e1806e3): created successfully Aug 28 09:49:01 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1ee21815-3343-4d54-87ee-04a6ff1168ac tempest-ProjectReaderTests-456281769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f01bc715-e23f-41cd-9677-b2123a44cfc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:01 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1ee21815-3343-4d54-87ee-04a6ff1168ac tempest-ProjectReaderTests-456281769 None] Flow 'volume_create_manager' (37ff138c-efa2-479c-a815-6b098d767b99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:49:01 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-1ee21815-3343-4d54-87ee-04a6ff1168ac tempest-ProjectReaderTests-456281769 None] Created volume successfully. Aug 28 09:49:01 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-5100965e-8572-48e1-9403-f519bd68435a tempest-ProjectReaderTests-456281769 None] Acquiring lock "cinder-a21ce9ab-9595-40f5-8f72-ff079e1806e3-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:49:01 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-5100965e-8572-48e1-9403-f519bd68435a tempest-ProjectReaderTests-456281769 None] Lock "cinder-a21ce9ab-9595-40f5-8f72-ff079e1806e3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:49:01 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-5100965e-8572-48e1-9403-f519bd68435a tempest-ProjectReaderTests-456281769 None] Acquiring lock "cinder-quobyte-a21ce9ab-9595-40f5-8f72-ff079e1806e3" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:49:01 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-5100965e-8572-48e1-9403-f519bd68435a tempest-ProjectReaderTests-456281769 None] Lock "cinder-quobyte-a21ce9ab-9595-40f5-8f72-ff079e1806e3" acquired by "delete_volume" :: waited 0.014s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:49:01 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f70445-01be-433b-99ad-2b0c2a41de19]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:49:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5100965e-8572-48e1-9403-f519bd68435a tempest-ProjectReaderTests-456281769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a21ce9ab-9595-40f5-8f72-ff079e1806e3 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:01 devstack sudo[103923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a21ce9ab-9595-40f5-8f72-ff079e1806e3 Aug 28 09:49:01 devstack sudo[103923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:02 devstack sudo[103923]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5100965e-8572-48e1-9403-f519bd68435a tempest-ProjectReaderTests-456281769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a21ce9ab-9595-40f5-8f72-ff079e1806e3" returned: 0 in 0.340s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5100965e-8572-48e1-9403-f519bd68435a tempest-ProjectReaderTests-456281769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a21ce9ab-9595-40f5-8f72-ff079e1806e3 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:02 devstack sudo[103928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a21ce9ab-9595-40f5-8f72-ff079e1806e3 Aug 28 09:49:02 devstack sudo[103928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:02 devstack sudo[103928]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5100965e-8572-48e1-9403-f519bd68435a tempest-ProjectReaderTests-456281769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a21ce9ab-9595-40f5-8f72-ff079e1806e3" returned: 0 in 0.242s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:02 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-5100965e-8572-48e1-9403-f519bd68435a tempest-ProjectReaderTests-456281769 None] Lock "cinder-quobyte-a21ce9ab-9595-40f5-8f72-ff079e1806e3" released by "delete_volume" :: held 0.621s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:49:02 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-5100965e-8572-48e1-9403-f519bd68435a tempest-ProjectReaderTests-456281769 None] Created reservations ['e1351951-d1db-4375-9b58-b2c0dfb555eb', '1f661e4d-3f49-4b48-9637-576dd58a82e4', '805d4f90-9148-4d0f-8d69-cbccf18bc3e6', '7a6d93f5-69c2-4f00-a9d7-92a081cb85a9'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:49:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-5100965e-8572-48e1-9403-f519bd68435a tempest-ProjectReaderTests-456281769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-5100965e-8572-48e1-9403-f519bd68435a tempest-ProjectReaderTests-456281769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:02 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-5100965e-8572-48e1-9403-f519bd68435a tempest-ProjectReaderTests-456281769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:49:02 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-5100965e-8572-48e1-9403-f519bd68435a tempest-ProjectReaderTests-456281769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:49:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-5100965e-8572-48e1-9403-f519bd68435a tempest-ProjectReaderTests-456281769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5100965e-8572-48e1-9403-f519bd68435a tempest-ProjectReaderTests-456281769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:02 devstack sudo[103931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:49:02 devstack sudo[103931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:02 devstack sudo[103931]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5100965e-8572-48e1-9403-f519bd68435a tempest-ProjectReaderTests-456281769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.237s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:02 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-5100965e-8572-48e1-9403-f519bd68435a tempest-ProjectReaderTests-456281769 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:49:02 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-5100965e-8572-48e1-9403-f519bd68435a tempest-ProjectReaderTests-456281769 None] Deleted volume successfully. Aug 28 09:49:02 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-5100965e-8572-48e1-9403-f519bd68435a tempest-ProjectReaderTests-456281769 None] Lock "cinder-a21ce9ab-9595-40f5-8f72-ff079e1806e3-delete_volume" released by "delete_volume" :: held 1.034s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:49:03 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd8a5520-7942-47b5-bdc2-e486cd05ae29 tempest-ProjectReaderTests-456281769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:49:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-fd8a5520-7942-47b5-bdc2-e486cd05ae29 tempest-ProjectReaderTests-456281769 None] Flow 'volume_create_manager' (3f56aa78-2725-44d4-b3ba-d6081a1abf5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:49:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-fd8a5520-7942-47b5-bdc2-e486cd05ae29 tempest-ProjectReaderTests-456281769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (814a6783-191a-4655-a68b-ad99e9480ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-fd8a5520-7942-47b5-bdc2-e486cd05ae29 tempest-ProjectReaderTests-456281769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (814a6783-191a-4655-a68b-ad99e9480ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-81397023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88793da0-9fc4-40d8-935c-7170f7a38487,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d40fa3944ade441fba05705623dd8964',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:03Z,use_quota=True,user_id='4d43805f6fe04c53b4932b0f4a6dc8aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-fd8a5520-7942-47b5-bdc2-e486cd05ae29 tempest-ProjectReaderTests-456281769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ce9c186-5546-4897-aa4f-0feeb9003d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-fd8a5520-7942-47b5-bdc2-e486cd05ae29 tempest-ProjectReaderTests-456281769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ce9c186-5546-4897-aa4f-0feeb9003d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-fd8a5520-7942-47b5-bdc2-e486cd05ae29 tempest-ProjectReaderTests-456281769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c775df31-e5a3-4b67-976d-25d519fdbd04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-fd8a5520-7942-47b5-bdc2-e486cd05ae29 tempest-ProjectReaderTests-456281769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c775df31-e5a3-4b67-976d-25d519fdbd04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88793da0-9fc4-40d8-935c-7170f7a38487', 'volume_name': 'volume-88793da0-9fc4-40d8-935c-7170f7a38487', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-fd8a5520-7942-47b5-bdc2-e486cd05ae29 tempest-ProjectReaderTests-456281769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00dce3b7-45cd-4d45-82b0-c0e20de816b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-fd8a5520-7942-47b5-bdc2-e486cd05ae29 tempest-ProjectReaderTests-456281769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00dce3b7-45cd-4d45-82b0-c0e20de816b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-fd8a5520-7942-47b5-bdc2-e486cd05ae29 tempest-ProjectReaderTests-456281769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (505fbd24-cf6b-4845-8a36-7bffa3f3ed85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:03 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-fd8a5520-7942-47b5-bdc2-e486cd05ae29 tempest-ProjectReaderTests-456281769 None] Volume 88793da0-9fc4-40d8-935c-7170f7a38487: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88793da0-9fc4-40d8-935c-7170f7a38487', 'volume_size': 1} Aug 28 09:49:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-fd8a5520-7942-47b5-bdc2-e486cd05ae29 tempest-ProjectReaderTests-456281769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-fd8a5520-7942-47b5-bdc2-e486cd05ae29 tempest-ProjectReaderTests-456281769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:03 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-fd8a5520-7942-47b5-bdc2-e486cd05ae29 tempest-ProjectReaderTests-456281769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-81397023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88793da0-9fc4-40d8-935c-7170f7a38487,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d40fa3944ade441fba05705623dd8964',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:03Z,use_quota=True,user_id='4d43805f6fe04c53b4932b0f4a6dc8aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:49:03 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-fd8a5520-7942-47b5-bdc2-e486cd05ae29 tempest-ProjectReaderTests-456281769 None] Creating volume 88793da0-9fc4-40d8-935c-7170f7a38487 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:49:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-fd8a5520-7942-47b5-bdc2-e486cd05ae29 tempest-ProjectReaderTests-456281769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-fd8a5520-7942-47b5-bdc2-e486cd05ae29 tempest-ProjectReaderTests-456281769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:03 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-fd8a5520-7942-47b5-bdc2-e486cd05ae29 tempest-ProjectReaderTests-456281769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:49:03 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-fd8a5520-7942-47b5-bdc2-e486cd05ae29 tempest-ProjectReaderTests-456281769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:49:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-fd8a5520-7942-47b5-bdc2-e486cd05ae29 tempest-ProjectReaderTests-456281769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:03 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-fd8a5520-7942-47b5-bdc2-e486cd05ae29 tempest-ProjectReaderTests-456281769 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:49:03 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-fd8a5520-7942-47b5-bdc2-e486cd05ae29 tempest-ProjectReaderTests-456281769 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:49:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fd8a5520-7942-47b5-bdc2-e486cd05ae29 tempest-ProjectReaderTests-456281769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-88793da0-9fc4-40d8-935c-7170f7a38487 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:03 devstack sudo[103934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-88793da0-9fc4-40d8-935c-7170f7a38487 1073741824 Aug 28 09:49:03 devstack sudo[103934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:03 devstack sudo[103934]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fd8a5520-7942-47b5-bdc2-e486cd05ae29 tempest-ProjectReaderTests-456281769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-88793da0-9fc4-40d8-935c-7170f7a38487 1073741824" returned: 0 in 0.400s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fd8a5520-7942-47b5-bdc2-e486cd05ae29 tempest-ProjectReaderTests-456281769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-88793da0-9fc4-40d8-935c-7170f7a38487 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:03 devstack sudo[103940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-88793da0-9fc4-40d8-935c-7170f7a38487 Aug 28 09:49:03 devstack sudo[103940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:03 devstack sudo[103940]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fd8a5520-7942-47b5-bdc2-e486cd05ae29 tempest-ProjectReaderTests-456281769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-88793da0-9fc4-40d8-935c-7170f7a38487" returned: 0 in 0.235s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:03 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-fd8a5520-7942-47b5-bdc2-e486cd05ae29 tempest-ProjectReaderTests-456281769 None] <== create_volume: return (676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:49:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-fd8a5520-7942-47b5-bdc2-e486cd05ae29 tempest-ProjectReaderTests-456281769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-fd8a5520-7942-47b5-bdc2-e486cd05ae29 tempest-ProjectReaderTests-456281769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (505fbd24-cf6b-4845-8a36-7bffa3f3ed85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88793da0-9fc4-40d8-935c-7170f7a38487', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-fd8a5520-7942-47b5-bdc2-e486cd05ae29 tempest-ProjectReaderTests-456281769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (500d7e06-c33e-4c74-b54c-b8121f633368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:04 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-fd8a5520-7942-47b5-bdc2-e486cd05ae29 tempest-ProjectReaderTests-456281769 None] Volume volume-88793da0-9fc4-40d8-935c-7170f7a38487 (88793da0-9fc4-40d8-935c-7170f7a38487): created successfully Aug 28 09:49:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-fd8a5520-7942-47b5-bdc2-e486cd05ae29 tempest-ProjectReaderTests-456281769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (500d7e06-c33e-4c74-b54c-b8121f633368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-fd8a5520-7942-47b5-bdc2-e486cd05ae29 tempest-ProjectReaderTests-456281769 None] Flow 'volume_create_manager' (3f56aa78-2725-44d4-b3ba-d6081a1abf5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:49:04 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-fd8a5520-7942-47b5-bdc2-e486cd05ae29 tempest-ProjectReaderTests-456281769 None] Created volume successfully. Aug 28 09:49:04 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-9dcb6c0a-a559-4101-82b4-cf9f366e1a62 tempest-ProjectReaderTests-456281769 None] Acquiring lock "cinder-88793da0-9fc4-40d8-935c-7170f7a38487-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:49:04 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-9dcb6c0a-a559-4101-82b4-cf9f366e1a62 tempest-ProjectReaderTests-456281769 None] Lock "cinder-88793da0-9fc4-40d8-935c-7170f7a38487-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:49:04 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-9dcb6c0a-a559-4101-82b4-cf9f366e1a62 tempest-ProjectReaderTests-456281769 None] Acquiring lock "cinder-quobyte-88793da0-9fc4-40d8-935c-7170f7a38487" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:49:04 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-9dcb6c0a-a559-4101-82b4-cf9f366e1a62 tempest-ProjectReaderTests-456281769 None] Lock "cinder-quobyte-88793da0-9fc4-40d8-935c-7170f7a38487" acquired by "delete_volume" :: waited 0.012s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:49:04 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee1feed-6484-44dd-b1ee-3950c1c7d58c]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:49:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9dcb6c0a-a559-4101-82b4-cf9f366e1a62 tempest-ProjectReaderTests-456281769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-88793da0-9fc4-40d8-935c-7170f7a38487 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:04 devstack sudo[103943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-88793da0-9fc4-40d8-935c-7170f7a38487 Aug 28 09:49:04 devstack sudo[103943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:04 devstack sudo[103943]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9dcb6c0a-a559-4101-82b4-cf9f366e1a62 tempest-ProjectReaderTests-456281769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-88793da0-9fc4-40d8-935c-7170f7a38487" returned: 0 in 0.360s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9dcb6c0a-a559-4101-82b4-cf9f366e1a62 tempest-ProjectReaderTests-456281769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-88793da0-9fc4-40d8-935c-7170f7a38487 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:04 devstack sudo[103954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-88793da0-9fc4-40d8-935c-7170f7a38487 Aug 28 09:49:04 devstack sudo[103954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:04 devstack sudo[103954]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9dcb6c0a-a559-4101-82b4-cf9f366e1a62 tempest-ProjectReaderTests-456281769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-88793da0-9fc4-40d8-935c-7170f7a38487" returned: 0 in 0.240s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:04 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-9dcb6c0a-a559-4101-82b4-cf9f366e1a62 tempest-ProjectReaderTests-456281769 None] Lock "cinder-quobyte-88793da0-9fc4-40d8-935c-7170f7a38487" released by "delete_volume" :: held 0.637s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:49:05 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-9dcb6c0a-a559-4101-82b4-cf9f366e1a62 tempest-ProjectReaderTests-456281769 None] Created reservations ['a57e8a12-6db7-455c-b041-765f1e7b0234', 'bf5297ce-5156-48b3-9ff6-da3af299e1b3', '4338a976-00aa-4829-8ba7-5fa45c4e497e', '88c68fc2-fb7a-4ba7-8fa2-1f2331422808'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:49:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-9dcb6c0a-a559-4101-82b4-cf9f366e1a62 tempest-ProjectReaderTests-456281769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-9dcb6c0a-a559-4101-82b4-cf9f366e1a62 tempest-ProjectReaderTests-456281769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:05 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-9dcb6c0a-a559-4101-82b4-cf9f366e1a62 tempest-ProjectReaderTests-456281769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:49:05 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-9dcb6c0a-a559-4101-82b4-cf9f366e1a62 tempest-ProjectReaderTests-456281769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:49:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-9dcb6c0a-a559-4101-82b4-cf9f366e1a62 tempest-ProjectReaderTests-456281769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9dcb6c0a-a559-4101-82b4-cf9f366e1a62 tempest-ProjectReaderTests-456281769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:05 devstack sudo[103957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:49:05 devstack sudo[103957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:05 devstack sudo[103957]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9dcb6c0a-a559-4101-82b4-cf9f366e1a62 tempest-ProjectReaderTests-456281769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.244s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:05 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-9dcb6c0a-a559-4101-82b4-cf9f366e1a62 tempest-ProjectReaderTests-456281769 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:49:05 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-9dcb6c0a-a559-4101-82b4-cf9f366e1a62 tempest-ProjectReaderTests-456281769 None] Deleted volume successfully. Aug 28 09:49:05 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-9dcb6c0a-a559-4101-82b4-cf9f366e1a62 tempest-ProjectReaderTests-456281769 None] Lock "cinder-88793da0-9fc4-40d8-935c-7170f7a38487-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:49:15 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writing DB stats cinder:SELECT=15,cinder:UPDATE=20,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:49:15 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writing DB stats cinder:SELECT=13,cinder:INSERT=4,cinder:UPDATE=24,cinder:DELETE=3 {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:49:17 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c2f8603-731a-4349-90a3-c809c48dca4a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:49:17 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1c2f8603-731a-4349-90a3-c809c48dca4a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Flow 'volume_create_manager' (8cb218c2-10ab-4f50-aff9-fd0d3424dd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:49:17 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1c2f8603-731a-4349-90a3-c809c48dca4a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acbff2fe-be86-43a3-9e89-bbdd9f690d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:17 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1c2f8603-731a-4349-90a3-c809c48dca4a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acbff2fe-be86-43a3-9e89-bbdd9f690d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-653911250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c744b2e7-9858-4a3a-87dc-7786d5f6f257,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0965f0d4cc2d4de48d3a9c94319ada7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:18Z,use_quota=True,user_id='c5054c9a36544491af674273388073ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:17 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1c2f8603-731a-4349-90a3-c809c48dca4a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be7fe08b-c880-4cfe-adee-a01923628b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:17 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1c2f8603-731a-4349-90a3-c809c48dca4a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be7fe08b-c880-4cfe-adee-a01923628b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:17 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1c2f8603-731a-4349-90a3-c809c48dca4a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2ad590c-1b46-44be-b5f3-2c2a0aaa2930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:17 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1c2f8603-731a-4349-90a3-c809c48dca4a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2ad590c-1b46-44be-b5f3-2c2a0aaa2930) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c744b2e7-9858-4a3a-87dc-7786d5f6f257', 'volume_name': 'volume-c744b2e7-9858-4a3a-87dc-7786d5f6f257', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:17 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1c2f8603-731a-4349-90a3-c809c48dca4a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97daedbf-713a-4c8e-8637-72a9a0460003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:17 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1c2f8603-731a-4349-90a3-c809c48dca4a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97daedbf-713a-4c8e-8637-72a9a0460003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:17 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1c2f8603-731a-4349-90a3-c809c48dca4a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (911d5ed2-792b-4d2a-9bc3-5b5c10f6fd47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:17 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-1c2f8603-731a-4349-90a3-c809c48dca4a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Volume c744b2e7-9858-4a3a-87dc-7786d5f6f257: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c744b2e7-9858-4a3a-87dc-7786d5f6f257', 'volume_size': 1} Aug 28 09:49:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-1c2f8603-731a-4349-90a3-c809c48dca4a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-1c2f8603-731a-4349-90a3-c809c48dca4a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:17 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-1c2f8603-731a-4349-90a3-c809c48dca4a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-653911250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c744b2e7-9858-4a3a-87dc-7786d5f6f257,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0965f0d4cc2d4de48d3a9c94319ada7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:18Z,use_quota=True,user_id='c5054c9a36544491af674273388073ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:49:17 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-1c2f8603-731a-4349-90a3-c809c48dca4a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Creating volume c744b2e7-9858-4a3a-87dc-7786d5f6f257 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:49:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-1c2f8603-731a-4349-90a3-c809c48dca4a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-1c2f8603-731a-4349-90a3-c809c48dca4a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:17 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-1c2f8603-731a-4349-90a3-c809c48dca4a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:49:17 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-1c2f8603-731a-4349-90a3-c809c48dca4a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:49:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-1c2f8603-731a-4349-90a3-c809c48dca4a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:17 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-1c2f8603-731a-4349-90a3-c809c48dca4a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:49:17 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-1c2f8603-731a-4349-90a3-c809c48dca4a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:49:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1c2f8603-731a-4349-90a3-c809c48dca4a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c744b2e7-9858-4a3a-87dc-7786d5f6f257 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:17 devstack sudo[104034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c744b2e7-9858-4a3a-87dc-7786d5f6f257 1073741824 Aug 28 09:49:17 devstack sudo[104034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:18 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-2804a1e3-b57e-4ef0-b1fe-fe325713710f tempest-CreateVolumesFromImageTest-539314689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:49:18 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2804a1e3-b57e-4ef0-b1fe-fe325713710f tempest-CreateVolumesFromImageTest-539314689 None] Flow 'volume_create_manager' (3f8349c7-907d-46dd-97a8-e085949b0f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:49:18 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2804a1e3-b57e-4ef0-b1fe-fe325713710f tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdff74f6-ed3b-49f0-9b3e-fdd215262784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:18 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2804a1e3-b57e-4ef0-b1fe-fe325713710f tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdff74f6-ed3b-49f0-9b3e-fdd215262784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-501301067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=458933f0-eaa0-422f-918d-bddf4dbc96e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f95e2218e7648acabd8dc4874ac9e13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:18Z,use_quota=True,user_id='af9d8bba355644b99bdad851f7de3281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:18 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2804a1e3-b57e-4ef0-b1fe-fe325713710f tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6a18b94-cdbb-4777-9406-64bf0e9393b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:18 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2804a1e3-b57e-4ef0-b1fe-fe325713710f tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6a18b94-cdbb-4777-9406-64bf0e9393b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:18 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2804a1e3-b57e-4ef0-b1fe-fe325713710f tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0b733bf-15e5-476d-9671-e2cd4332ef5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:18 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2804a1e3-b57e-4ef0-b1fe-fe325713710f tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0b733bf-15e5-476d-9671-e2cd4332ef5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '458933f0-eaa0-422f-918d-bddf4dbc96e0', 'volume_name': 'volume-458933f0-eaa0-422f-918d-bddf4dbc96e0', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:18 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2804a1e3-b57e-4ef0-b1fe-fe325713710f tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72a9ecd2-080e-4832-bb7c-7a810005b4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:18 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2804a1e3-b57e-4ef0-b1fe-fe325713710f tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72a9ecd2-080e-4832-bb7c-7a810005b4c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:18 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2804a1e3-b57e-4ef0-b1fe-fe325713710f tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb7450af-0090-4107-a736-6ed4d3557646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:18 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-2804a1e3-b57e-4ef0-b1fe-fe325713710f tempest-CreateVolumesFromImageTest-539314689 None] Volume 458933f0-eaa0-422f-918d-bddf4dbc96e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-458933f0-eaa0-422f-918d-bddf4dbc96e0', 'volume_size': 1} Aug 28 09:49:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-2804a1e3-b57e-4ef0-b1fe-fe325713710f tempest-CreateVolumesFromImageTest-539314689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:18 devstack sudo[104034]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1c2f8603-731a-4349-90a3-c809c48dca4a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c744b2e7-9858-4a3a-87dc-7786d5f6f257 1073741824" returned: 0 in 0.678s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:18 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-374b025a-ebeb-42dd-a217-ef75851dfa8a tempest-CreateVolumesFromImageTest-539314689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:49:18 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-374b025a-ebeb-42dd-a217-ef75851dfa8a tempest-CreateVolumesFromImageTest-539314689 None] Flow 'volume_create_manager' (7fa7fdc5-5448-4085-9979-c79456dfde33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:49:18 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-374b025a-ebeb-42dd-a217-ef75851dfa8a tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0fea241-1a09-44bd-9652-03993ec62da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:18 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-374b025a-ebeb-42dd-a217-ef75851dfa8a tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0fea241-1a09-44bd-9652-03993ec62da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-515413158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ac330f9-065e-4199-81af-1d7e58858063,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f95e2218e7648acabd8dc4874ac9e13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:18Z,use_quota=True,user_id='af9d8bba355644b99bdad851f7de3281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:18 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-374b025a-ebeb-42dd-a217-ef75851dfa8a tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc6d547e-3982-4593-ab20-843272ce2aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:18 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-374b025a-ebeb-42dd-a217-ef75851dfa8a tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc6d547e-3982-4593-ab20-843272ce2aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:18 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-374b025a-ebeb-42dd-a217-ef75851dfa8a tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (559899e6-d18e-4079-9b93-924573d69651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:18 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-374b025a-ebeb-42dd-a217-ef75851dfa8a tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (559899e6-d18e-4079-9b93-924573d69651) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ac330f9-065e-4199-81af-1d7e58858063', 'volume_name': 'volume-4ac330f9-065e-4199-81af-1d7e58858063', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:18 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-374b025a-ebeb-42dd-a217-ef75851dfa8a tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a2b34eb-c410-445f-80c0-8527e006bb26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:18 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-374b025a-ebeb-42dd-a217-ef75851dfa8a tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a2b34eb-c410-445f-80c0-8527e006bb26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:18 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-374b025a-ebeb-42dd-a217-ef75851dfa8a tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1832c261-0d22-4ae6-9047-9e5bd7e88613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:18 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-374b025a-ebeb-42dd-a217-ef75851dfa8a tempest-CreateVolumesFromImageTest-539314689 None] Volume 4ac330f9-065e-4199-81af-1d7e58858063: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ac330f9-065e-4199-81af-1d7e58858063', 'volume_size': 1} Aug 28 09:49:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-374b025a-ebeb-42dd-a217-ef75851dfa8a tempest-CreateVolumesFromImageTest-539314689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1c2f8603-731a-4349-90a3-c809c48dca4a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c744b2e7-9858-4a3a-87dc-7786d5f6f257 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:18 devstack sudo[104040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c744b2e7-9858-4a3a-87dc-7786d5f6f257 Aug 28 09:49:18 devstack sudo[104040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:19 devstack sudo[104040]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1c2f8603-731a-4349-90a3-c809c48dca4a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c744b2e7-9858-4a3a-87dc-7786d5f6f257" returned: 0 in 0.298s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:19 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-1c2f8603-731a-4349-90a3-c809c48dca4a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:49:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-1c2f8603-731a-4349-90a3-c809c48dca4a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-2804a1e3-b57e-4ef0-b1fe-fe325713710f tempest-CreateVolumesFromImageTest-539314689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.875s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:19 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-2804a1e3-b57e-4ef0-b1fe-fe325713710f tempest-CreateVolumesFromImageTest-539314689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-501301067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=458933f0-eaa0-422f-918d-bddf4dbc96e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f95e2218e7648acabd8dc4874ac9e13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:18Z,use_quota=True,user_id='af9d8bba355644b99bdad851f7de3281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:49:19 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-2804a1e3-b57e-4ef0-b1fe-fe325713710f tempest-CreateVolumesFromImageTest-539314689 None] Creating volume 458933f0-eaa0-422f-918d-bddf4dbc96e0 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:49:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-2804a1e3-b57e-4ef0-b1fe-fe325713710f tempest-CreateVolumesFromImageTest-539314689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-2804a1e3-b57e-4ef0-b1fe-fe325713710f tempest-CreateVolumesFromImageTest-539314689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:19 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-2804a1e3-b57e-4ef0-b1fe-fe325713710f tempest-CreateVolumesFromImageTest-539314689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:49:19 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-2804a1e3-b57e-4ef0-b1fe-fe325713710f tempest-CreateVolumesFromImageTest-539314689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:49:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-2804a1e3-b57e-4ef0-b1fe-fe325713710f tempest-CreateVolumesFromImageTest-539314689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:19 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-2804a1e3-b57e-4ef0-b1fe-fe325713710f tempest-CreateVolumesFromImageTest-539314689 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:49:19 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-2804a1e3-b57e-4ef0-b1fe-fe325713710f tempest-CreateVolumesFromImageTest-539314689 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:49:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2804a1e3-b57e-4ef0-b1fe-fe325713710f tempest-CreateVolumesFromImageTest-539314689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-458933f0-eaa0-422f-918d-bddf4dbc96e0 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1c2f8603-731a-4349-90a3-c809c48dca4a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (911d5ed2-792b-4d2a-9bc3-5b5c10f6fd47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c744b2e7-9858-4a3a-87dc-7786d5f6f257', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1c2f8603-731a-4349-90a3-c809c48dca4a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cede009b-fe11-42dc-a8cd-393cc6a58278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:19 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-1c2f8603-731a-4349-90a3-c809c48dca4a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Volume volume-c744b2e7-9858-4a3a-87dc-7786d5f6f257 (c744b2e7-9858-4a3a-87dc-7786d5f6f257): created successfully Aug 28 09:49:19 devstack sudo[104043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-458933f0-eaa0-422f-918d-bddf4dbc96e0 1073741824 Aug 28 09:49:19 devstack sudo[104043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1c2f8603-731a-4349-90a3-c809c48dca4a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cede009b-fe11-42dc-a8cd-393cc6a58278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1c2f8603-731a-4349-90a3-c809c48dca4a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Flow 'volume_create_manager' (8cb218c2-10ab-4f50-aff9-fd0d3424dd18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:49:19 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-1c2f8603-731a-4349-90a3-c809c48dca4a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Created volume successfully. Aug 28 09:49:19 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-fccff2b5-a4a8-49c9-81c3-30c746fc2b84 tempest-CreateVolumesFromImageTest-539314689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:49:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-fccff2b5-a4a8-49c9-81c3-30c746fc2b84 tempest-CreateVolumesFromImageTest-539314689 None] Flow 'volume_create_manager' (fff8b874-971b-4ca8-86dc-c10fc9fbc6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:49:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-fccff2b5-a4a8-49c9-81c3-30c746fc2b84 tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (503f959d-09fa-4a63-91e9-e5996f4bc7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-fccff2b5-a4a8-49c9-81c3-30c746fc2b84 tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (503f959d-09fa-4a63-91e9-e5996f4bc7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1566054270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d77cc7f0-3b88-4acb-beab-42590650ea8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f95e2218e7648acabd8dc4874ac9e13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:19Z,use_quota=True,user_id='af9d8bba355644b99bdad851f7de3281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-fccff2b5-a4a8-49c9-81c3-30c746fc2b84 tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b38514d9-72f8-410c-90d2-a06093b36bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-fccff2b5-a4a8-49c9-81c3-30c746fc2b84 tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b38514d9-72f8-410c-90d2-a06093b36bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-fccff2b5-a4a8-49c9-81c3-30c746fc2b84 tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22abedb7-db92-48a9-88d4-042160b32c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-fccff2b5-a4a8-49c9-81c3-30c746fc2b84 tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22abedb7-db92-48a9-88d4-042160b32c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd77cc7f0-3b88-4acb-beab-42590650ea8c', 'volume_name': 'volume-d77cc7f0-3b88-4acb-beab-42590650ea8c', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-fccff2b5-a4a8-49c9-81c3-30c746fc2b84 tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba5f1a4f-4e3f-454f-ab3e-ad7978e5d1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-fccff2b5-a4a8-49c9-81c3-30c746fc2b84 tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba5f1a4f-4e3f-454f-ab3e-ad7978e5d1a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-fccff2b5-a4a8-49c9-81c3-30c746fc2b84 tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c474cd23-22f9-4591-9386-1c84d28bfbb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:19 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-fccff2b5-a4a8-49c9-81c3-30c746fc2b84 tempest-CreateVolumesFromImageTest-539314689 None] Volume d77cc7f0-3b88-4acb-beab-42590650ea8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d77cc7f0-3b88-4acb-beab-42590650ea8c', 'volume_size': 1} Aug 28 09:49:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-fccff2b5-a4a8-49c9-81c3-30c746fc2b84 tempest-CreateVolumesFromImageTest-539314689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:19 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ff5ea4f-d2a7-4550-87c5-9ef19265a478 tempest-CreateVolumesFromImageTest-539314689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:49:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-4ff5ea4f-d2a7-4550-87c5-9ef19265a478 tempest-CreateVolumesFromImageTest-539314689 None] Flow 'volume_create_manager' (6cc9fea9-78dd-4c6e-989f-70dd7d3ec5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:49:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-4ff5ea4f-d2a7-4550-87c5-9ef19265a478 tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e17de301-e08e-46b6-925f-bff564c0ff49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-4ff5ea4f-d2a7-4550-87c5-9ef19265a478 tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e17de301-e08e-46b6-925f-bff564c0ff49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1775111513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02091abb-fddf-47f7-b3d4-13dc13a7b54e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f95e2218e7648acabd8dc4874ac9e13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:19Z,use_quota=True,user_id='af9d8bba355644b99bdad851f7de3281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-4ff5ea4f-d2a7-4550-87c5-9ef19265a478 tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (847507ce-675c-47b2-9321-9443e2e35014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-4ff5ea4f-d2a7-4550-87c5-9ef19265a478 tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (847507ce-675c-47b2-9321-9443e2e35014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-4ff5ea4f-d2a7-4550-87c5-9ef19265a478 tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eccd3a93-ebd0-4539-98b5-0a93a1dcda8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-4ff5ea4f-d2a7-4550-87c5-9ef19265a478 tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eccd3a93-ebd0-4539-98b5-0a93a1dcda8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02091abb-fddf-47f7-b3d4-13dc13a7b54e', 'volume_name': 'volume-02091abb-fddf-47f7-b3d4-13dc13a7b54e', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-4ff5ea4f-d2a7-4550-87c5-9ef19265a478 tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29b0fee8-0c52-4521-8195-c37d7f724343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-4ff5ea4f-d2a7-4550-87c5-9ef19265a478 tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29b0fee8-0c52-4521-8195-c37d7f724343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-4ff5ea4f-d2a7-4550-87c5-9ef19265a478 tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25215564-6670-400e-8610-48d9fe4c844f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:19 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-4ff5ea4f-d2a7-4550-87c5-9ef19265a478 tempest-CreateVolumesFromImageTest-539314689 None] Volume 02091abb-fddf-47f7-b3d4-13dc13a7b54e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02091abb-fddf-47f7-b3d4-13dc13a7b54e', 'volume_size': 1} Aug 28 09:49:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-4ff5ea4f-d2a7-4550-87c5-9ef19265a478 tempest-CreateVolumesFromImageTest-539314689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:19 devstack sudo[104043]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2804a1e3-b57e-4ef0-b1fe-fe325713710f tempest-CreateVolumesFromImageTest-539314689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-458933f0-eaa0-422f-918d-bddf4dbc96e0 1073741824" returned: 0 in 0.739s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2804a1e3-b57e-4ef0-b1fe-fe325713710f tempest-CreateVolumesFromImageTest-539314689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-458933f0-eaa0-422f-918d-bddf4dbc96e0 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:19 devstack sudo[104052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-458933f0-eaa0-422f-918d-bddf4dbc96e0 Aug 28 09:49:19 devstack sudo[104052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:20 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef0b7167-0fc5-4519-8457-30a42465953c tempest-CreateVolumesFromImageTest-539314689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:49:20 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ef0b7167-0fc5-4519-8457-30a42465953c tempest-CreateVolumesFromImageTest-539314689 None] Flow 'volume_create_manager' (10f51cf1-efb2-4776-b73c-0d88ebbb2c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:49:20 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ef0b7167-0fc5-4519-8457-30a42465953c tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c36cec2e-c06a-4c98-abf6-1e3633725d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:20 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ef0b7167-0fc5-4519-8457-30a42465953c tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c36cec2e-c06a-4c98-abf6-1e3633725d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-356290934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e787072-076f-4866-895e-14a1e2c286e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f95e2218e7648acabd8dc4874ac9e13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:20Z,use_quota=True,user_id='af9d8bba355644b99bdad851f7de3281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:20 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ef0b7167-0fc5-4519-8457-30a42465953c tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c61497bd-0592-48da-baaa-dd9bebd1f601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:20 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ef0b7167-0fc5-4519-8457-30a42465953c tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c61497bd-0592-48da-baaa-dd9bebd1f601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:20 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ef0b7167-0fc5-4519-8457-30a42465953c tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9da77a21-153b-410f-8194-45535aeb52d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:20 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ef0b7167-0fc5-4519-8457-30a42465953c tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9da77a21-153b-410f-8194-45535aeb52d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e787072-076f-4866-895e-14a1e2c286e3', 'volume_name': 'volume-5e787072-076f-4866-895e-14a1e2c286e3', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:20 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ef0b7167-0fc5-4519-8457-30a42465953c tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb298dbd-578b-4ca8-80f9-fa55d3ad8c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:20 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ef0b7167-0fc5-4519-8457-30a42465953c tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb298dbd-578b-4ca8-80f9-fa55d3ad8c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:20 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ef0b7167-0fc5-4519-8457-30a42465953c tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (492b1807-e58b-47d1-819a-2208012d287c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:20 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-ef0b7167-0fc5-4519-8457-30a42465953c tempest-CreateVolumesFromImageTest-539314689 None] Volume 5e787072-076f-4866-895e-14a1e2c286e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e787072-076f-4866-895e-14a1e2c286e3', 'volume_size': 1} Aug 28 09:49:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ef0b7167-0fc5-4519-8457-30a42465953c tempest-CreateVolumesFromImageTest-539314689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:20 devstack sudo[104052]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2804a1e3-b57e-4ef0-b1fe-fe325713710f tempest-CreateVolumesFromImageTest-539314689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-458933f0-eaa0-422f-918d-bddf4dbc96e0" returned: 0 in 0.462s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:20 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-2804a1e3-b57e-4ef0-b1fe-fe325713710f tempest-CreateVolumesFromImageTest-539314689 None] <== create_volume: return (1278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:49:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-2804a1e3-b57e-4ef0-b1fe-fe325713710f tempest-CreateVolumesFromImageTest-539314689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.281s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-374b025a-ebeb-42dd-a217-ef75851dfa8a tempest-CreateVolumesFromImageTest-539314689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.610s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:20 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-374b025a-ebeb-42dd-a217-ef75851dfa8a tempest-CreateVolumesFromImageTest-539314689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-515413158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ac330f9-065e-4199-81af-1d7e58858063,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f95e2218e7648acabd8dc4874ac9e13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:18Z,use_quota=True,user_id='af9d8bba355644b99bdad851f7de3281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:49:20 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-374b025a-ebeb-42dd-a217-ef75851dfa8a tempest-CreateVolumesFromImageTest-539314689 None] Creating volume 4ac330f9-065e-4199-81af-1d7e58858063 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:49:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-374b025a-ebeb-42dd-a217-ef75851dfa8a tempest-CreateVolumesFromImageTest-539314689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-374b025a-ebeb-42dd-a217-ef75851dfa8a tempest-CreateVolumesFromImageTest-539314689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:20 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-374b025a-ebeb-42dd-a217-ef75851dfa8a tempest-CreateVolumesFromImageTest-539314689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:49:20 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-374b025a-ebeb-42dd-a217-ef75851dfa8a tempest-CreateVolumesFromImageTest-539314689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:49:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-374b025a-ebeb-42dd-a217-ef75851dfa8a tempest-CreateVolumesFromImageTest-539314689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:20 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-374b025a-ebeb-42dd-a217-ef75851dfa8a tempest-CreateVolumesFromImageTest-539314689 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:49:20 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-374b025a-ebeb-42dd-a217-ef75851dfa8a tempest-CreateVolumesFromImageTest-539314689 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:49:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-374b025a-ebeb-42dd-a217-ef75851dfa8a tempest-CreateVolumesFromImageTest-539314689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ac330f9-065e-4199-81af-1d7e58858063 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:20 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2804a1e3-b57e-4ef0-b1fe-fe325713710f tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb7450af-0090-4107-a736-6ed4d3557646) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-458933f0-eaa0-422f-918d-bddf4dbc96e0', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:20 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2804a1e3-b57e-4ef0-b1fe-fe325713710f tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74a530b4-8234-4535-a87f-2e645c4081bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:20 devstack sudo[104055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ac330f9-065e-4199-81af-1d7e58858063 1073741824 Aug 28 09:49:20 devstack sudo[104055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:20 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-2804a1e3-b57e-4ef0-b1fe-fe325713710f tempest-CreateVolumesFromImageTest-539314689 None] Volume volume-458933f0-eaa0-422f-918d-bddf4dbc96e0 (458933f0-eaa0-422f-918d-bddf4dbc96e0): created successfully Aug 28 09:49:20 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2804a1e3-b57e-4ef0-b1fe-fe325713710f tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74a530b4-8234-4535-a87f-2e645c4081bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:20 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2804a1e3-b57e-4ef0-b1fe-fe325713710f tempest-CreateVolumesFromImageTest-539314689 None] Flow 'volume_create_manager' (3f8349c7-907d-46dd-97a8-e085949b0f18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:49:20 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-2804a1e3-b57e-4ef0-b1fe-fe325713710f tempest-CreateVolumesFromImageTest-539314689 None] Created volume successfully. Aug 28 09:49:20 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-969bb0b4-93d9-415b-9053-79446fe9053a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:49:20 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-969bb0b4-93d9-415b-9053-79446fe9053a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Flow 'volume_create_manager' (03a7ad19-ba2f-432f-b029-1d4c067d0c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:49:20 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-969bb0b4-93d9-415b-9053-79446fe9053a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55c97a14-f491-43cf-86c2-963c7ada79a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:20 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-969bb0b4-93d9-415b-9053-79446fe9053a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55c97a14-f491-43cf-86c2-963c7ada79a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1503193322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0499a056-b1f3-4564-af6f-41d1caddd697,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0965f0d4cc2d4de48d3a9c94319ada7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:21Z,use_quota=True,user_id='c5054c9a36544491af674273388073ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:20 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-969bb0b4-93d9-415b-9053-79446fe9053a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4874fa90-bf0d-4304-949f-27fb512d1c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:20 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-969bb0b4-93d9-415b-9053-79446fe9053a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4874fa90-bf0d-4304-949f-27fb512d1c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:20 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-969bb0b4-93d9-415b-9053-79446fe9053a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e18daef7-2988-4476-94a9-e562021bfb30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:20 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-969bb0b4-93d9-415b-9053-79446fe9053a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e18daef7-2988-4476-94a9-e562021bfb30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0499a056-b1f3-4564-af6f-41d1caddd697', 'volume_name': 'volume-0499a056-b1f3-4564-af6f-41d1caddd697', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:20 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-969bb0b4-93d9-415b-9053-79446fe9053a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffd76a71-fcc2-4967-b772-7760662c6037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:20 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-969bb0b4-93d9-415b-9053-79446fe9053a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffd76a71-fcc2-4967-b772-7760662c6037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:20 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-969bb0b4-93d9-415b-9053-79446fe9053a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76aec424-8e13-4dc4-9d2f-b37f9fd5dbce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:20 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-969bb0b4-93d9-415b-9053-79446fe9053a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Volume 0499a056-b1f3-4564-af6f-41d1caddd697: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0499a056-b1f3-4564-af6f-41d1caddd697', 'volume_size': 1} Aug 28 09:49:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-969bb0b4-93d9-415b-9053-79446fe9053a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:20 devstack sudo[104055]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-374b025a-ebeb-42dd-a217-ef75851dfa8a tempest-CreateVolumesFromImageTest-539314689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ac330f9-065e-4199-81af-1d7e58858063 1073741824" returned: 0 in 0.618s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-374b025a-ebeb-42dd-a217-ef75851dfa8a tempest-CreateVolumesFromImageTest-539314689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ac330f9-065e-4199-81af-1d7e58858063 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:21 devstack sudo[104061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ac330f9-065e-4199-81af-1d7e58858063 Aug 28 09:49:21 devstack sudo[104061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:21 devstack sudo[104061]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-374b025a-ebeb-42dd-a217-ef75851dfa8a tempest-CreateVolumesFromImageTest-539314689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ac330f9-065e-4199-81af-1d7e58858063" returned: 0 in 0.309s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:21 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-374b025a-ebeb-42dd-a217-ef75851dfa8a tempest-CreateVolumesFromImageTest-539314689 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:49:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-374b025a-ebeb-42dd-a217-ef75851dfa8a tempest-CreateVolumesFromImageTest-539314689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-fccff2b5-a4a8-49c9-81c3-30c746fc2b84 tempest-CreateVolumesFromImageTest-539314689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.036s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:21 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-fccff2b5-a4a8-49c9-81c3-30c746fc2b84 tempest-CreateVolumesFromImageTest-539314689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1566054270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d77cc7f0-3b88-4acb-beab-42590650ea8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f95e2218e7648acabd8dc4874ac9e13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:19Z,use_quota=True,user_id='af9d8bba355644b99bdad851f7de3281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:49:21 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-fccff2b5-a4a8-49c9-81c3-30c746fc2b84 tempest-CreateVolumesFromImageTest-539314689 None] Creating volume d77cc7f0-3b88-4acb-beab-42590650ea8c {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:49:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-fccff2b5-a4a8-49c9-81c3-30c746fc2b84 tempest-CreateVolumesFromImageTest-539314689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-fccff2b5-a4a8-49c9-81c3-30c746fc2b84 tempest-CreateVolumesFromImageTest-539314689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:21 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-fccff2b5-a4a8-49c9-81c3-30c746fc2b84 tempest-CreateVolumesFromImageTest-539314689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:49:21 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-fccff2b5-a4a8-49c9-81c3-30c746fc2b84 tempest-CreateVolumesFromImageTest-539314689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:49:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-fccff2b5-a4a8-49c9-81c3-30c746fc2b84 tempest-CreateVolumesFromImageTest-539314689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:21 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-fccff2b5-a4a8-49c9-81c3-30c746fc2b84 tempest-CreateVolumesFromImageTest-539314689 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:49:21 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-fccff2b5-a4a8-49c9-81c3-30c746fc2b84 tempest-CreateVolumesFromImageTest-539314689 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:49:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fccff2b5-a4a8-49c9-81c3-30c746fc2b84 tempest-CreateVolumesFromImageTest-539314689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d77cc7f0-3b88-4acb-beab-42590650ea8c 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:21 devstack sudo[104064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d77cc7f0-3b88-4acb-beab-42590650ea8c 1073741824 Aug 28 09:49:21 devstack sudo[104064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:21 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-374b025a-ebeb-42dd-a217-ef75851dfa8a tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1832c261-0d22-4ae6-9047-9e5bd7e88613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ac330f9-065e-4199-81af-1d7e58858063', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:21 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-374b025a-ebeb-42dd-a217-ef75851dfa8a tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6716a567-aabe-46d0-85a7-075cc8fbfeb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:21 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-374b025a-ebeb-42dd-a217-ef75851dfa8a tempest-CreateVolumesFromImageTest-539314689 None] Volume volume-4ac330f9-065e-4199-81af-1d7e58858063 (4ac330f9-065e-4199-81af-1d7e58858063): created successfully Aug 28 09:49:21 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-374b025a-ebeb-42dd-a217-ef75851dfa8a tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6716a567-aabe-46d0-85a7-075cc8fbfeb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:21 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-374b025a-ebeb-42dd-a217-ef75851dfa8a tempest-CreateVolumesFromImageTest-539314689 None] Flow 'volume_create_manager' (7fa7fdc5-5448-4085-9979-c79456dfde33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:49:21 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:49:21 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] Flow 'volume_create_manager' (78c7720e-1e88-4904-816d-b78cb6a23403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:49:21 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a7bce04-25ec-47d7-b7ab-7c3fc6bc5ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:21 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-374b025a-ebeb-42dd-a217-ef75851dfa8a tempest-CreateVolumesFromImageTest-539314689 None] Created volume successfully. Aug 28 09:49:21 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a7bce04-25ec-47d7-b7ab-7c3fc6bc5ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8f4dddb-7e87-4290-a307-9f7c49256b92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e326ed5432b4631828d3aa7b0f7472e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:21Z,use_quota=True,user_id='9f452ea8a63e43a1b5e11bfbce092c97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:21 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cb67bb5-424e-4302-b0a4-802739fc6e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:21 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cb67bb5-424e-4302-b0a4-802739fc6e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:21 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a921d182-89ba-4000-9b27-1eb70f23550c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:21 devstack cinder-volume[86081]: DEBUG cinder.image.glance [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] Creating Keystone auth plugin from conf {{(pid=86081) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 28 09:49:21 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-d82a6938-3595-461e-a064-5107a36134ab tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:49:21 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-d82a6938-3595-461e-a064-5107a36134ab tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Flow 'volume_create_manager' (5d5da063-1acc-4355-aeea-7058f39860f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:49:21 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-d82a6938-3595-461e-a064-5107a36134ab tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89f44494-cf53-4a5a-b9f4-8016cd2c254e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:21 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-d82a6938-3595-461e-a064-5107a36134ab tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89f44494-cf53-4a5a-b9f4-8016cd2c254e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1739444423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99e380f8-40c5-4d2b-b434-77396d3344af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0965f0d4cc2d4de48d3a9c94319ada7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:21Z,use_quota=True,user_id='c5054c9a36544491af674273388073ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:21 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-d82a6938-3595-461e-a064-5107a36134ab tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91990480-4698-4ba9-a479-5ebd458bd5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:21 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-d82a6938-3595-461e-a064-5107a36134ab tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91990480-4698-4ba9-a479-5ebd458bd5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:21 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-d82a6938-3595-461e-a064-5107a36134ab tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c35ec62-ec97-4007-9e86-e1f4061924d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:21 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-d82a6938-3595-461e-a064-5107a36134ab tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c35ec62-ec97-4007-9e86-e1f4061924d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99e380f8-40c5-4d2b-b434-77396d3344af', 'volume_name': 'volume-99e380f8-40c5-4d2b-b434-77396d3344af', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:21 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-d82a6938-3595-461e-a064-5107a36134ab tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b0a5846-3156-4d91-b87b-5822d1190926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:21 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-d82a6938-3595-461e-a064-5107a36134ab tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b0a5846-3156-4d91-b87b-5822d1190926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:21 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-d82a6938-3595-461e-a064-5107a36134ab tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08c7f8f0-1634-41a9-89bb-74982942a0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:21 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-d82a6938-3595-461e-a064-5107a36134ab tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Volume 99e380f8-40c5-4d2b-b434-77396d3344af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99e380f8-40c5-4d2b-b434-77396d3344af', 'volume_size': 1} Aug 28 09:49:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-d82a6938-3595-461e-a064-5107a36134ab tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:21 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac2b4888-c5d2-4128-b64e-91a45f43c881 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:49:21 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ac2b4888-c5d2-4128-b64e-91a45f43c881 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Flow 'volume_create_manager' (1ec201dc-7659-48ad-a4c5-1eb89cae7afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:49:21 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ac2b4888-c5d2-4128-b64e-91a45f43c881 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fb6469e-a1f9-4ac5-9583-7913c890bdbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:21 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ac2b4888-c5d2-4128-b64e-91a45f43c881 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fb6469e-a1f9-4ac5-9583-7913c890bdbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1706797097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c2c99bb-033b-4f71-a22c-e3c33cbe0d74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0965f0d4cc2d4de48d3a9c94319ada7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:22Z,use_quota=True,user_id='c5054c9a36544491af674273388073ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:21 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ac2b4888-c5d2-4128-b64e-91a45f43c881 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69e11cbb-d57b-4533-a9c4-26613ddbf214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:21 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ac2b4888-c5d2-4128-b64e-91a45f43c881 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69e11cbb-d57b-4533-a9c4-26613ddbf214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:21 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ac2b4888-c5d2-4128-b64e-91a45f43c881 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e442438e-0a1c-41ab-915a-8ea9af52f47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:21 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ac2b4888-c5d2-4128-b64e-91a45f43c881 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e442438e-0a1c-41ab-915a-8ea9af52f47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c2c99bb-033b-4f71-a22c-e3c33cbe0d74', 'volume_name': 'volume-8c2c99bb-033b-4f71-a22c-e3c33cbe0d74', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:21 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ac2b4888-c5d2-4128-b64e-91a45f43c881 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c625296f-4793-43fb-8a74-878d7640ea9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:21 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ac2b4888-c5d2-4128-b64e-91a45f43c881 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c625296f-4793-43fb-8a74-878d7640ea9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:21 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ac2b4888-c5d2-4128-b64e-91a45f43c881 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (813889b2-96f2-49f9-b9ae-a1aff8386456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:21 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-ac2b4888-c5d2-4128-b64e-91a45f43c881 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Volume 8c2c99bb-033b-4f71-a22c-e3c33cbe0d74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c2c99bb-033b-4f71-a22c-e3c33cbe0d74', 'volume_size': 1} Aug 28 09:49:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ac2b4888-c5d2-4128-b64e-91a45f43c881 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:22 devstack sudo[104064]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fccff2b5-a4a8-49c9-81c3-30c746fc2b84 tempest-CreateVolumesFromImageTest-539314689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d77cc7f0-3b88-4acb-beab-42590650ea8c 1073741824" returned: 0 in 0.692s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a921d182-89ba-4000-9b27-1eb70f23550c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f8f4dddb-7e87-4290-a307-9f7c49256b92', 'volume_name': 'volume-f8f4dddb-7e87-4290-a307-9f7c49256b92', 'volume_size': 1, 'image_id': 'c65342cb-f54a-44f5-8a7b-b3b5e576985d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c65342cb-f54a-44f5-8a7b-b3b5e576985d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a14562aac3a38a9494995b6dd9d728c6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0e326ed5432b4631828d3aa7b0f7472e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ba2e458e3d7977ff502b23f38704e04a67c93d60e942f400a4d0807bb11bb5779003d188e3452ec2b3aaac8d3a87ee63435bb0d19a01b3fca72fe4a7a8209702', 'id': 'c65342cb-f54a-44f5-8a7b-b3b5e576985d', 'created_at': datetime.datetime(2026, 8, 28, 7, 49, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 7, 49, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c65342cb-f54a-44f5-8a7b-b3b5e576985d/file', 'properties': {}}, 'image_service': }' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65b488b2-be42-4dd4-a854-5be02260cabc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65b488b2-be42-4dd4-a854-5be02260cabc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43c7d0e0-b841-4c34-96fe-9faeb4d34c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:22 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] Volume f8f4dddb-7e87-4290-a307-9f7c49256b92: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f8f4dddb-7e87-4290-a307-9f7c49256b92', 'volume_size': 1, 'image_id': 'c65342cb-f54a-44f5-8a7b-b3b5e576985d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c65342cb-f54a-44f5-8a7b-b3b5e576985d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a14562aac3a38a9494995b6dd9d728c6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0e326ed5432b4631828d3aa7b0f7472e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ba2e458e3d7977ff502b23f38704e04a67c93d60e942f400a4d0807bb11bb5779003d188e3452ec2b3aaac8d3a87ee63435bb0d19a01b3fca72fe4a7a8209702', 'id': 'c65342cb-f54a-44f5-8a7b-b3b5e576985d', 'created_at': datetime.datetime(2026, 8, 28, 7, 49, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 7, 49, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c65342cb-f54a-44f5-8a7b-b3b5e576985d/file', 'properties': {}}, 'image_service': } Aug 28 09:49:22 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] Trying to clone f8f4dddb-7e87-4290-a307-9f7c49256b92 from image c65342cb-f54a-44f5-8a7b-b3b5e576985d at location (None, [{'url': 'file:///opt/stack/data/glance/images/c65342cb-f54a-44f5-8a7b-b3b5e576985d', 'metadata': {}}]). {{(pid=86081) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 28 09:49:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fccff2b5-a4a8-49c9-81c3-30c746fc2b84 tempest-CreateVolumesFromImageTest-539314689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d77cc7f0-3b88-4acb-beab-42590650ea8c {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:22 devstack sudo[104070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d77cc7f0-3b88-4acb-beab-42590650ea8c Aug 28 09:49:22 devstack sudo[104070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:22 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-1de7c272-0936-4b50-ad6b-c38800572f7b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:49:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1de7c272-0936-4b50-ad6b-c38800572f7b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Flow 'volume_create_manager' (8d98dc6a-cbb4-463b-a3a3-4acfebd1668d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:49:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1de7c272-0936-4b50-ad6b-c38800572f7b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7adfff4-6150-4e06-ba30-0cc48bed3c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1de7c272-0936-4b50-ad6b-c38800572f7b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7adfff4-6150-4e06-ba30-0cc48bed3c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1631926642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d117743-18db-4d17-88c6-f9f6429cf385,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0965f0d4cc2d4de48d3a9c94319ada7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:22Z,use_quota=True,user_id='c5054c9a36544491af674273388073ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1de7c272-0936-4b50-ad6b-c38800572f7b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (054dcd44-e8d6-4f6b-a7d6-32970093c4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1de7c272-0936-4b50-ad6b-c38800572f7b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (054dcd44-e8d6-4f6b-a7d6-32970093c4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1de7c272-0936-4b50-ad6b-c38800572f7b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa397a48-1b5c-4615-adee-0e05f74f8579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1de7c272-0936-4b50-ad6b-c38800572f7b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa397a48-1b5c-4615-adee-0e05f74f8579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d117743-18db-4d17-88c6-f9f6429cf385', 'volume_name': 'volume-8d117743-18db-4d17-88c6-f9f6429cf385', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1de7c272-0936-4b50-ad6b-c38800572f7b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76411b63-6fec-4ae8-ad78-47beb4ebfbff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1de7c272-0936-4b50-ad6b-c38800572f7b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76411b63-6fec-4ae8-ad78-47beb4ebfbff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1de7c272-0936-4b50-ad6b-c38800572f7b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9b7e873-47fd-4060-835c-d3cc277e8934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:22 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-1de7c272-0936-4b50-ad6b-c38800572f7b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Volume 8d117743-18db-4d17-88c6-f9f6429cf385: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d117743-18db-4d17-88c6-f9f6429cf385', 'volume_size': 1} Aug 28 09:49:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-1de7c272-0936-4b50-ad6b-c38800572f7b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:22 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c65342cb-f54a-44f5-8a7b-b3b5e576985d_4tiwqfrzdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86081) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 28 09:49:22 devstack cinder-volume[86081]: INFO cinder.image.image_utils [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] Image download 0.00 MB at 0.00 MB/s Aug 28 09:49:22 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[95423a82-f007-4f19-829f-3433ac568cb1]: (4, 'raw') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:49:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c65342cb-f54a-44f5-8a7b-b3b5e576985d_4tiwqfrzdevstack@QuobyteHD {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:22 devstack sudo[104070]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fccff2b5-a4a8-49c9-81c3-30c746fc2b84 tempest-CreateVolumesFromImageTest-539314689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d77cc7f0-3b88-4acb-beab-42590650ea8c" returned: 0 in 0.339s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:22 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-fccff2b5-a4a8-49c9-81c3-30c746fc2b84 tempest-CreateVolumesFromImageTest-539314689 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:49:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-fccff2b5-a4a8-49c9-81c3-30c746fc2b84 tempest-CreateVolumesFromImageTest-539314689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-4ff5ea4f-d2a7-4550-87c5-9ef19265a478 tempest-CreateVolumesFromImageTest-539314689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.737s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:22 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-4ff5ea4f-d2a7-4550-87c5-9ef19265a478 tempest-CreateVolumesFromImageTest-539314689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1775111513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02091abb-fddf-47f7-b3d4-13dc13a7b54e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f95e2218e7648acabd8dc4874ac9e13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:19Z,use_quota=True,user_id='af9d8bba355644b99bdad851f7de3281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:49:22 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-4ff5ea4f-d2a7-4550-87c5-9ef19265a478 tempest-CreateVolumesFromImageTest-539314689 None] Creating volume 02091abb-fddf-47f7-b3d4-13dc13a7b54e {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:49:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-4ff5ea4f-d2a7-4550-87c5-9ef19265a478 tempest-CreateVolumesFromImageTest-539314689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-4ff5ea4f-d2a7-4550-87c5-9ef19265a478 tempest-CreateVolumesFromImageTest-539314689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:22 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-4ff5ea4f-d2a7-4550-87c5-9ef19265a478 tempest-CreateVolumesFromImageTest-539314689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:49:22 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-4ff5ea4f-d2a7-4550-87c5-9ef19265a478 tempest-CreateVolumesFromImageTest-539314689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:49:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-4ff5ea4f-d2a7-4550-87c5-9ef19265a478 tempest-CreateVolumesFromImageTest-539314689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:22 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-4ff5ea4f-d2a7-4550-87c5-9ef19265a478 tempest-CreateVolumesFromImageTest-539314689 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:49:22 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-4ff5ea4f-d2a7-4550-87c5-9ef19265a478 tempest-CreateVolumesFromImageTest-539314689 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:49:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4ff5ea4f-d2a7-4550-87c5-9ef19265a478 tempest-CreateVolumesFromImageTest-539314689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-02091abb-fddf-47f7-b3d4-13dc13a7b54e 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:22 devstack sudo[104074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-02091abb-fddf-47f7-b3d4-13dc13a7b54e 1073741824 Aug 28 09:49:22 devstack sudo[104074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-fccff2b5-a4a8-49c9-81c3-30c746fc2b84 tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c474cd23-22f9-4591-9386-1c84d28bfbb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d77cc7f0-3b88-4acb-beab-42590650ea8c', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-fccff2b5-a4a8-49c9-81c3-30c746fc2b84 tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8da4c156-1d6d-4ee3-b29a-435151914b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:22 devstack sudo[104073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c65342cb-f54a-44f5-8a7b-b3b5e576985d_4tiwqfrzdevstack@QuobyteHD Aug 28 09:49:22 devstack sudo[104073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:22 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-fccff2b5-a4a8-49c9-81c3-30c746fc2b84 tempest-CreateVolumesFromImageTest-539314689 None] Volume volume-d77cc7f0-3b88-4acb-beab-42590650ea8c (d77cc7f0-3b88-4acb-beab-42590650ea8c): created successfully Aug 28 09:49:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-fccff2b5-a4a8-49c9-81c3-30c746fc2b84 tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8da4c156-1d6d-4ee3-b29a-435151914b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-fccff2b5-a4a8-49c9-81c3-30c746fc2b84 tempest-CreateVolumesFromImageTest-539314689 None] Flow 'volume_create_manager' (fff8b874-971b-4ca8-86dc-c10fc9fbc6df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:49:22 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-fccff2b5-a4a8-49c9-81c3-30c746fc2b84 tempest-CreateVolumesFromImageTest-539314689 None] Created volume successfully. Aug 28 09:49:22 devstack sudo[104073]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c65342cb-f54a-44f5-8a7b-b3b5e576985d_4tiwqfrzdevstack@QuobyteHD" returned: 0 in 0.378s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c65342cb-f54a-44f5-8a7b-b3b5e576985d_4tiwqfrzdevstack@QuobyteHD {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:22 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-eba5dfba-cb31-403b-851d-f8ec133732cd tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:49:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-eba5dfba-cb31-403b-851d-f8ec133732cd tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Flow 'volume_create_manager' (c3d154fe-09be-4c1f-9496-0ac6c71e4227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:49:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-eba5dfba-cb31-403b-851d-f8ec133732cd tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aa187a4-5a0f-4125-b5cf-497c1cb3f466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-eba5dfba-cb31-403b-851d-f8ec133732cd tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aa187a4-5a0f-4125-b5cf-497c1cb3f466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-598447539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5e1f7bc-61e5-4c18-8ede-6fc6cffbb339,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0965f0d4cc2d4de48d3a9c94319ada7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:23Z,use_quota=True,user_id='c5054c9a36544491af674273388073ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-eba5dfba-cb31-403b-851d-f8ec133732cd tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29aa3a76-c782-48e7-8cd7-67dcba20cf19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-eba5dfba-cb31-403b-851d-f8ec133732cd tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29aa3a76-c782-48e7-8cd7-67dcba20cf19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-eba5dfba-cb31-403b-851d-f8ec133732cd tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2701b582-3393-42f3-aa84-b136ae056b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-eba5dfba-cb31-403b-851d-f8ec133732cd tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2701b582-3393-42f3-aa84-b136ae056b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5e1f7bc-61e5-4c18-8ede-6fc6cffbb339', 'volume_name': 'volume-d5e1f7bc-61e5-4c18-8ede-6fc6cffbb339', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-eba5dfba-cb31-403b-851d-f8ec133732cd tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5200130-2c4c-46f0-a255-fa1574de22ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-eba5dfba-cb31-403b-851d-f8ec133732cd tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5200130-2c4c-46f0-a255-fa1574de22ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:22 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-eba5dfba-cb31-403b-851d-f8ec133732cd tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59033c6f-b750-479d-bdaa-690133a11c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:22 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-eba5dfba-cb31-403b-851d-f8ec133732cd tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Volume d5e1f7bc-61e5-4c18-8ede-6fc6cffbb339: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5e1f7bc-61e5-4c18-8ede-6fc6cffbb339', 'volume_size': 1} Aug 28 09:49:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-eba5dfba-cb31-403b-851d-f8ec133732cd tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:22 devstack sudo[104079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c65342cb-f54a-44f5-8a7b-b3b5e576985d_4tiwqfrzdevstack@QuobyteHD Aug 28 09:49:22 devstack sudo[104079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:23 devstack sudo[104074]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4ff5ea4f-d2a7-4550-87c5-9ef19265a478 tempest-CreateVolumesFromImageTest-539314689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-02091abb-fddf-47f7-b3d4-13dc13a7b54e 1073741824" returned: 0 in 0.608s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4ff5ea4f-d2a7-4550-87c5-9ef19265a478 tempest-CreateVolumesFromImageTest-539314689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-02091abb-fddf-47f7-b3d4-13dc13a7b54e {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:23 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:49:23 devstack sudo[104085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-02091abb-fddf-47f7-b3d4-13dc13a7b54e Aug 28 09:49:23 devstack sudo[104085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:23 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Flow 'volume_create_manager' (66088d00-d69c-4c15-8070-1bdcadfd44c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:49:23 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (793c44b2-b027-4d24-8731-530060fd1674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:23 devstack sudo[104079]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c65342cb-f54a-44f5-8a7b-b3b5e576985d_4tiwqfrzdevstack@QuobyteHD" returned: 1 in 0.428s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c65342cb-f54a-44f5-8a7b-b3b5e576985d_4tiwqfrzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 09:49:23 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] Temporary image c65342cb-f54a-44f5-8a7b-b3b5e576985d is fetched for user 9f452ea8a63e43a1b5e11bfbce092c97. {{(pid=86081) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 28 09:49:23 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (793c44b2-b027-4d24-8731-530060fd1674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3793440-13fb-4609-a558-9bb77715ad6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0923bb25b9543db98c6471f3608b680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:23Z,use_quota=True,user_id='ee35c4e0b1ac40b2bb7c957a3ef20ce6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a3e6f7c0-b0e8-4e87-abbd-0f8ed27b9db0),volume_type_id=a3e6f7c0-b0e8-4e87-abbd-0f8ed27b9db0)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:23 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d11ad959-1753-460b-a0f7-584f5a87a8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:23 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d11ad959-1753-460b-a0f7-584f5a87a8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:23 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ca62de3-2dc3-433d-9ec4-9cc32560ad1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:23 devstack cinder-volume[86081]: DEBUG cinder.image.glance [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Creating Keystone auth plugin from conf {{(pid=86081) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 28 09:49:23 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[92efa3e3-cb54-48f4-a525-ec6055896f4c]: (4, 'raw') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:49:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c65342cb-f54a-44f5-8a7b-b3b5e576985d_4tiwqfrzdevstack@QuobyteHD {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:23 devstack sudo[104090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c65342cb-f54a-44f5-8a7b-b3b5e576985d_4tiwqfrzdevstack@QuobyteHD Aug 28 09:49:23 devstack sudo[104090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:23 devstack sudo[104085]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4ff5ea4f-d2a7-4550-87c5-9ef19265a478 tempest-CreateVolumesFromImageTest-539314689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-02091abb-fddf-47f7-b3d4-13dc13a7b54e" returned: 0 in 0.276s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:23 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-4ff5ea4f-d2a7-4550-87c5-9ef19265a478 tempest-CreateVolumesFromImageTest-539314689 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:49:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-4ff5ea4f-d2a7-4550-87c5-9ef19265a478 tempest-CreateVolumesFromImageTest-539314689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ef0b7167-0fc5-4519-8457-30a42465953c tempest-CreateVolumesFromImageTest-539314689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.302s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:23 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ef0b7167-0fc5-4519-8457-30a42465953c tempest-CreateVolumesFromImageTest-539314689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-356290934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e787072-076f-4866-895e-14a1e2c286e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f95e2218e7648acabd8dc4874ac9e13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:20Z,use_quota=True,user_id='af9d8bba355644b99bdad851f7de3281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:49:23 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-ef0b7167-0fc5-4519-8457-30a42465953c tempest-CreateVolumesFromImageTest-539314689 None] Creating volume 5e787072-076f-4866-895e-14a1e2c286e3 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:49:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ef0b7167-0fc5-4519-8457-30a42465953c tempest-CreateVolumesFromImageTest-539314689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ef0b7167-0fc5-4519-8457-30a42465953c tempest-CreateVolumesFromImageTest-539314689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:23 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ef0b7167-0fc5-4519-8457-30a42465953c tempest-CreateVolumesFromImageTest-539314689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:49:23 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ef0b7167-0fc5-4519-8457-30a42465953c tempest-CreateVolumesFromImageTest-539314689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:49:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ef0b7167-0fc5-4519-8457-30a42465953c tempest-CreateVolumesFromImageTest-539314689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:23 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ef0b7167-0fc5-4519-8457-30a42465953c tempest-CreateVolumesFromImageTest-539314689 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:49:23 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-ef0b7167-0fc5-4519-8457-30a42465953c tempest-CreateVolumesFromImageTest-539314689 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:49:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ef0b7167-0fc5-4519-8457-30a42465953c tempest-CreateVolumesFromImageTest-539314689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-5e787072-076f-4866-895e-14a1e2c286e3 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:23 devstack sudo[104093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-5e787072-076f-4866-895e-14a1e2c286e3 1073741824 Aug 28 09:49:23 devstack sudo[104093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:23 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-4ff5ea4f-d2a7-4550-87c5-9ef19265a478 tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25215564-6670-400e-8610-48d9fe4c844f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02091abb-fddf-47f7-b3d4-13dc13a7b54e', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:23 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-4ff5ea4f-d2a7-4550-87c5-9ef19265a478 tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (293445cc-16c9-49f3-8925-1916f3113553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:23 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-4ff5ea4f-d2a7-4550-87c5-9ef19265a478 tempest-CreateVolumesFromImageTest-539314689 None] Volume volume-02091abb-fddf-47f7-b3d4-13dc13a7b54e (02091abb-fddf-47f7-b3d4-13dc13a7b54e): created successfully Aug 28 09:49:23 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-4ff5ea4f-d2a7-4550-87c5-9ef19265a478 tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (293445cc-16c9-49f3-8925-1916f3113553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:23 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-4ff5ea4f-d2a7-4550-87c5-9ef19265a478 tempest-CreateVolumesFromImageTest-539314689 None] Flow 'volume_create_manager' (6cc9fea9-78dd-4c6e-989f-70dd7d3ec5cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:49:23 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ca62de3-2dc3-433d-9ec4-9cc32560ad1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e3793440-13fb-4609-a558-9bb77715ad6b', 'volume_name': 'volume-e3793440-13fb-4609-a558-9bb77715ad6b', 'volume_size': 1, 'image_id': '1abbc937-d5b4-40c9-8d0d-1ef1443abc8f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1abbc937-d5b4-40c9-8d0d-1ef1443abc8f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c9f8bc79d3ffac53cc86bbf367eadce2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a0923bb25b9543db98c6471f3608b680', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '88f9628a3883fd560b1747740abd79df91c26a8b59b98e8e3c49601bf7764dc91dda30e13bb9096ce2fc15d6bfc0ab2b6077f22e55b7fad651f7dc43dac8dc2c', 'id': '1abbc937-d5b4-40c9-8d0d-1ef1443abc8f', 'created_at': datetime.datetime(2026, 8, 28, 7, 49, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 7, 49, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1abbc937-d5b4-40c9-8d0d-1ef1443abc8f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:23 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eeb936f-9523-4344-b797-aa0394117603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:23 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eeb936f-9523-4344-b797-aa0394117603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:23 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30be162b-0d2b-4b51-a3ad-899f36a6c89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:23 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Volume e3793440-13fb-4609-a558-9bb77715ad6b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e3793440-13fb-4609-a558-9bb77715ad6b', 'volume_size': 1, 'image_id': '1abbc937-d5b4-40c9-8d0d-1ef1443abc8f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1abbc937-d5b4-40c9-8d0d-1ef1443abc8f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c9f8bc79d3ffac53cc86bbf367eadce2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a0923bb25b9543db98c6471f3608b680', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '88f9628a3883fd560b1747740abd79df91c26a8b59b98e8e3c49601bf7764dc91dda30e13bb9096ce2fc15d6bfc0ab2b6077f22e55b7fad651f7dc43dac8dc2c', 'id': '1abbc937-d5b4-40c9-8d0d-1ef1443abc8f', 'created_at': datetime.datetime(2026, 8, 28, 7, 49, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 7, 49, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1abbc937-d5b4-40c9-8d0d-1ef1443abc8f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 28 09:49:23 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Trying to clone e3793440-13fb-4609-a558-9bb77715ad6b from image 1abbc937-d5b4-40c9-8d0d-1ef1443abc8f at location (None, [{'url': 'file:///opt/stack/data/glance/images/1abbc937-d5b4-40c9-8d0d-1ef1443abc8f', 'metadata': {}}]). {{(pid=86081) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 28 09:49:23 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-4ff5ea4f-d2a7-4550-87c5-9ef19265a478 tempest-CreateVolumesFromImageTest-539314689 None] Created volume successfully. Aug 28 09:49:23 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1abbc937-d5b4-40c9-8d0d-1ef1443abc8f_84_6omlsdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86081) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 28 09:49:23 devstack cinder-volume[86081]: INFO cinder.image.image_utils [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Image download 0.00 MB at 0.00 MB/s Aug 28 09:49:23 devstack sudo[104090]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c65342cb-f54a-44f5-8a7b-b3b5e576985d_4tiwqfrzdevstack@QuobyteHD" returned: 0 in 0.368s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c65342cb-f54a-44f5-8a7b-b3b5e576985d_4tiwqfrzdevstack@QuobyteHD {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:23 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2fbb4c3-2463-4d24-92be-4c3fc96ec210]: (4, 'raw') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:49:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1abbc937-d5b4-40c9-8d0d-1ef1443abc8f_84_6omlsdevstack@QuobyteHD {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:23 devstack sudo[104098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c65342cb-f54a-44f5-8a7b-b3b5e576985d_4tiwqfrzdevstack@QuobyteHD Aug 28 09:49:23 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:23 devstack sudo[104100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1abbc937-d5b4-40c9-8d0d-1ef1443abc8f_84_6omlsdevstack@QuobyteHD Aug 28 09:49:23 devstack sudo[104100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:23 devstack sudo[104093]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ef0b7167-0fc5-4519-8457-30a42465953c tempest-CreateVolumesFromImageTest-539314689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-5e787072-076f-4866-895e-14a1e2c286e3 1073741824" returned: 0 in 0.516s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ef0b7167-0fc5-4519-8457-30a42465953c tempest-CreateVolumesFromImageTest-539314689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-5e787072-076f-4866-895e-14a1e2c286e3 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:24 devstack sudo[104105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-5e787072-076f-4866-895e-14a1e2c286e3 Aug 28 09:49:24 devstack sudo[104105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:24 devstack sudo[104100]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1abbc937-d5b4-40c9-8d0d-1ef1443abc8f_84_6omlsdevstack@QuobyteHD" returned: 0 in 0.361s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1abbc937-d5b4-40c9-8d0d-1ef1443abc8f_84_6omlsdevstack@QuobyteHD {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:24 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c65342cb-f54a-44f5-8a7b-b3b5e576985d_4tiwqfrzdevstack@QuobyteHD" returned: 1 in 0.423s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c65342cb-f54a-44f5-8a7b-b3b5e576985d_4tiwqfrzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 09:49:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:24 devstack sudo[104112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1abbc937-d5b4-40c9-8d0d-1ef1443abc8f_84_6omlsdevstack@QuobyteHD Aug 28 09:49:24 devstack sudo[104112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:24 devstack sudo[104105]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ef0b7167-0fc5-4519-8457-30a42465953c tempest-CreateVolumesFromImageTest-539314689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-5e787072-076f-4866-895e-14a1e2c286e3" returned: 0 in 0.270s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:24 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ef0b7167-0fc5-4519-8457-30a42465953c tempest-CreateVolumesFromImageTest-539314689 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:49:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ef0b7167-0fc5-4519-8457-30a42465953c tempest-CreateVolumesFromImageTest-539314689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-969bb0b4-93d9-415b-9053-79446fe9053a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.596s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:24 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-969bb0b4-93d9-415b-9053-79446fe9053a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1503193322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0499a056-b1f3-4564-af6f-41d1caddd697,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0965f0d4cc2d4de48d3a9c94319ada7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:21Z,use_quota=True,user_id='c5054c9a36544491af674273388073ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:49:24 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-969bb0b4-93d9-415b-9053-79446fe9053a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Creating volume 0499a056-b1f3-4564-af6f-41d1caddd697 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:49:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-969bb0b4-93d9-415b-9053-79446fe9053a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-969bb0b4-93d9-415b-9053-79446fe9053a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:24 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-969bb0b4-93d9-415b-9053-79446fe9053a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:49:24 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-969bb0b4-93d9-415b-9053-79446fe9053a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:49:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-969bb0b4-93d9-415b-9053-79446fe9053a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:24 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-969bb0b4-93d9-415b-9053-79446fe9053a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:49:24 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-969bb0b4-93d9-415b-9053-79446fe9053a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:49:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-969bb0b4-93d9-415b-9053-79446fe9053a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-0499a056-b1f3-4564-af6f-41d1caddd697 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:24 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ef0b7167-0fc5-4519-8457-30a42465953c tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (492b1807-e58b-47d1-819a-2208012d287c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e787072-076f-4866-895e-14a1e2c286e3', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:24 devstack sudo[104115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-0499a056-b1f3-4564-af6f-41d1caddd697 1073741824 Aug 28 09:49:24 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ef0b7167-0fc5-4519-8457-30a42465953c tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ab964ea-6621-498a-ac8d-b30495b3dc01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:24 devstack sudo[104115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:24 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-ef0b7167-0fc5-4519-8457-30a42465953c tempest-CreateVolumesFromImageTest-539314689 None] Volume volume-5e787072-076f-4866-895e-14a1e2c286e3 (5e787072-076f-4866-895e-14a1e2c286e3): created successfully Aug 28 09:49:24 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ef0b7167-0fc5-4519-8457-30a42465953c tempest-CreateVolumesFromImageTest-539314689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ab964ea-6621-498a-ac8d-b30495b3dc01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:24 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ef0b7167-0fc5-4519-8457-30a42465953c tempest-CreateVolumesFromImageTest-539314689 None] Flow 'volume_create_manager' (10f51cf1-efb2-4776-b73c-0d88ebbb2c0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:49:24 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-ef0b7167-0fc5-4519-8457-30a42465953c tempest-CreateVolumesFromImageTest-539314689 None] Created volume successfully. Aug 28 09:49:24 devstack sudo[104112]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1abbc937-d5b4-40c9-8d0d-1ef1443abc8f_84_6omlsdevstack@QuobyteHD" returned: 1 in 0.355s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1abbc937-d5b4-40c9-8d0d-1ef1443abc8f_84_6omlsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 09:49:24 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Temporary image 1abbc937-d5b4-40c9-8d0d-1ef1443abc8f is fetched for user ee35c4e0b1ac40b2bb7c957a3ef20ce6. {{(pid=86081) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 28 09:49:24 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5b0fb5-5bbb-40d5-a4f2-1db01109397c]: (4, 'raw') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:49:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1abbc937-d5b4-40c9-8d0d-1ef1443abc8f_84_6omlsdevstack@QuobyteHD {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:24 devstack sudo[104122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1abbc937-d5b4-40c9-8d0d-1ef1443abc8f_84_6omlsdevstack@QuobyteHD Aug 28 09:49:24 devstack sudo[104122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:24 devstack sudo[104115]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-969bb0b4-93d9-415b-9053-79446fe9053a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-0499a056-b1f3-4564-af6f-41d1caddd697 1073741824" returned: 0 in 0.415s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-969bb0b4-93d9-415b-9053-79446fe9053a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-0499a056-b1f3-4564-af6f-41d1caddd697 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:24 devstack sudo[104126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-0499a056-b1f3-4564-af6f-41d1caddd697 Aug 28 09:49:24 devstack sudo[104126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:24 devstack sudo[104122]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1abbc937-d5b4-40c9-8d0d-1ef1443abc8f_84_6omlsdevstack@QuobyteHD" returned: 0 in 0.331s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1abbc937-d5b4-40c9-8d0d-1ef1443abc8f_84_6omlsdevstack@QuobyteHD {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:24 devstack sudo[104130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1abbc937-d5b4-40c9-8d0d-1ef1443abc8f_84_6omlsdevstack@QuobyteHD Aug 28 09:49:24 devstack sudo[104130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:25 devstack sudo[104126]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-969bb0b4-93d9-415b-9053-79446fe9053a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-0499a056-b1f3-4564-af6f-41d1caddd697" returned: 0 in 0.280s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:25 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-969bb0b4-93d9-415b-9053-79446fe9053a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:49:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-969bb0b4-93d9-415b-9053-79446fe9053a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-d82a6938-3595-461e-a064-5107a36134ab tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.308s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:25 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-d82a6938-3595-461e-a064-5107a36134ab tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1739444423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99e380f8-40c5-4d2b-b434-77396d3344af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0965f0d4cc2d4de48d3a9c94319ada7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:21Z,use_quota=True,user_id='c5054c9a36544491af674273388073ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:49:25 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-d82a6938-3595-461e-a064-5107a36134ab tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Creating volume 99e380f8-40c5-4d2b-b434-77396d3344af {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:49:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-d82a6938-3595-461e-a064-5107a36134ab tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-d82a6938-3595-461e-a064-5107a36134ab tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:25 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-d82a6938-3595-461e-a064-5107a36134ab tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:49:25 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-d82a6938-3595-461e-a064-5107a36134ab tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:49:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-d82a6938-3595-461e-a064-5107a36134ab tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:25 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-d82a6938-3595-461e-a064-5107a36134ab tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:49:25 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-d82a6938-3595-461e-a064-5107a36134ab tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:49:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d82a6938-3595-461e-a064-5107a36134ab tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-99e380f8-40c5-4d2b-b434-77396d3344af 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:25 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e16721d7-e700-44e8-8041-f6b3d2f6129c tempest-CreateVolumesFromImageTest-539314689 None] Acquiring lock "cinder-5e787072-076f-4866-895e-14a1e2c286e3-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:49:25 devstack sudo[104133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-99e380f8-40c5-4d2b-b434-77396d3344af 1073741824 Aug 28 09:49:25 devstack sudo[104133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:25 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-969bb0b4-93d9-415b-9053-79446fe9053a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76aec424-8e13-4dc4-9d2f-b37f9fd5dbce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0499a056-b1f3-4564-af6f-41d1caddd697', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:25 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-969bb0b4-93d9-415b-9053-79446fe9053a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ae29f30-d395-4958-90b1-fe29f694cc00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:25 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e16721d7-e700-44e8-8041-f6b3d2f6129c tempest-CreateVolumesFromImageTest-539314689 None] Lock "cinder-5e787072-076f-4866-895e-14a1e2c286e3-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:49:25 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-969bb0b4-93d9-415b-9053-79446fe9053a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Volume volume-0499a056-b1f3-4564-af6f-41d1caddd697 (0499a056-b1f3-4564-af6f-41d1caddd697): created successfully Aug 28 09:49:25 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-969bb0b4-93d9-415b-9053-79446fe9053a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ae29f30-d395-4958-90b1-fe29f694cc00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:25 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-969bb0b4-93d9-415b-9053-79446fe9053a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Flow 'volume_create_manager' (03a7ad19-ba2f-432f-b029-1d4c067d0c0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:49:25 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e16721d7-e700-44e8-8041-f6b3d2f6129c tempest-CreateVolumesFromImageTest-539314689 None] Acquiring lock "cinder-quobyte-5e787072-076f-4866-895e-14a1e2c286e3" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:49:25 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-969bb0b4-93d9-415b-9053-79446fe9053a tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Created volume successfully. Aug 28 09:49:25 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e16721d7-e700-44e8-8041-f6b3d2f6129c tempest-CreateVolumesFromImageTest-539314689 None] Lock "cinder-quobyte-5e787072-076f-4866-895e-14a1e2c286e3" acquired by "delete_volume" :: waited 0.022s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:49:25 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a1648d-6686-4080-ab14-36cfbec50960]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:49:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e16721d7-e700-44e8-8041-f6b3d2f6129c tempest-CreateVolumesFromImageTest-539314689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-5e787072-076f-4866-895e-14a1e2c286e3 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:25 devstack sudo[104130]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1abbc937-d5b4-40c9-8d0d-1ef1443abc8f_84_6omlsdevstack@QuobyteHD" returned: 1 in 0.390s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1abbc937-d5b4-40c9-8d0d-1ef1443abc8f_84_6omlsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 09:49:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:25 devstack sudo[104138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-5e787072-076f-4866-895e-14a1e2c286e3 Aug 28 09:49:25 devstack sudo[104138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:25 devstack sudo[104133]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d82a6938-3595-461e-a064-5107a36134ab tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-99e380f8-40c5-4d2b-b434-77396d3344af 1073741824" returned: 0 in 0.541s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:25 devstack sudo[104138]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e16721d7-e700-44e8-8041-f6b3d2f6129c tempest-CreateVolumesFromImageTest-539314689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-5e787072-076f-4866-895e-14a1e2c286e3" returned: 0 in 0.427s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e16721d7-e700-44e8-8041-f6b3d2f6129c tempest-CreateVolumesFromImageTest-539314689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-5e787072-076f-4866-895e-14a1e2c286e3 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d82a6938-3595-461e-a064-5107a36134ab tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-99e380f8-40c5-4d2b-b434-77396d3344af {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:25 devstack sudo[104147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-5e787072-076f-4866-895e-14a1e2c286e3 Aug 28 09:49:25 devstack sudo[104147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:25 devstack sudo[104149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-99e380f8-40c5-4d2b-b434-77396d3344af Aug 28 09:49:25 devstack sudo[104149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:25 devstack sudo[104147]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e16721d7-e700-44e8-8041-f6b3d2f6129c tempest-CreateVolumesFromImageTest-539314689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-5e787072-076f-4866-895e-14a1e2c286e3" returned: 0 in 0.255s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:25 devstack sudo[104149]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:25 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e16721d7-e700-44e8-8041-f6b3d2f6129c tempest-CreateVolumesFromImageTest-539314689 None] Lock "cinder-quobyte-5e787072-076f-4866-895e-14a1e2c286e3" released by "delete_volume" :: held 0.735s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:49:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d82a6938-3595-461e-a064-5107a36134ab tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-99e380f8-40c5-4d2b-b434-77396d3344af" returned: 0 in 0.257s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:25 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-d82a6938-3595-461e-a064-5107a36134ab tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:49:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-d82a6938-3595-461e-a064-5107a36134ab tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ac2b4888-c5d2-4128-b64e-91a45f43c881 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.970s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:25 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ac2b4888-c5d2-4128-b64e-91a45f43c881 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1706797097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c2c99bb-033b-4f71-a22c-e3c33cbe0d74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0965f0d4cc2d4de48d3a9c94319ada7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:22Z,use_quota=True,user_id='c5054c9a36544491af674273388073ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:49:25 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-ac2b4888-c5d2-4128-b64e-91a45f43c881 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Creating volume 8c2c99bb-033b-4f71-a22c-e3c33cbe0d74 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:49:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ac2b4888-c5d2-4128-b64e-91a45f43c881 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ac2b4888-c5d2-4128-b64e-91a45f43c881 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:25 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ac2b4888-c5d2-4128-b64e-91a45f43c881 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:49:25 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ac2b4888-c5d2-4128-b64e-91a45f43c881 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:49:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ac2b4888-c5d2-4128-b64e-91a45f43c881 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:25 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ac2b4888-c5d2-4128-b64e-91a45f43c881 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:49:25 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-ac2b4888-c5d2-4128-b64e-91a45f43c881 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:49:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ac2b4888-c5d2-4128-b64e-91a45f43c881 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8c2c99bb-033b-4f71-a22c-e3c33cbe0d74 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:25 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-d82a6938-3595-461e-a064-5107a36134ab tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08c7f8f0-1634-41a9-89bb-74982942a0c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99e380f8-40c5-4d2b-b434-77396d3344af', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:25 devstack sudo[104153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8c2c99bb-033b-4f71-a22c-e3c33cbe0d74 1073741824 Aug 28 09:49:25 devstack sudo[104153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:25 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-d82a6938-3595-461e-a064-5107a36134ab tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80ac9e0d-c949-4a47-9e5e-8592153de6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:26 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-d82a6938-3595-461e-a064-5107a36134ab tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Volume volume-99e380f8-40c5-4d2b-b434-77396d3344af (99e380f8-40c5-4d2b-b434-77396d3344af): created successfully Aug 28 09:49:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-d82a6938-3595-461e-a064-5107a36134ab tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80ac9e0d-c949-4a47-9e5e-8592153de6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-d82a6938-3595-461e-a064-5107a36134ab tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Flow 'volume_create_manager' (5d5da063-1acc-4355-aeea-7058f39860f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:49:26 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-d82a6938-3595-461e-a064-5107a36134ab tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Created volume successfully. Aug 28 09:49:26 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-e16721d7-e700-44e8-8041-f6b3d2f6129c tempest-CreateVolumesFromImageTest-539314689 None] Created reservations ['49573fc6-b2b9-4efd-a035-9855e0aae2db', '7a9dfaba-0b45-46ec-9104-f2ce598b2541', '3af8eaa6-5bb4-488e-9b7b-61bf928811f0', '4f983356-65a8-4246-ab21-6626263ad4d1'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:49:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e16721d7-e700-44e8-8041-f6b3d2f6129c tempest-CreateVolumesFromImageTest-539314689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e16721d7-e700-44e8-8041-f6b3d2f6129c tempest-CreateVolumesFromImageTest-539314689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:26 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e16721d7-e700-44e8-8041-f6b3d2f6129c tempest-CreateVolumesFromImageTest-539314689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:49:26 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e16721d7-e700-44e8-8041-f6b3d2f6129c tempest-CreateVolumesFromImageTest-539314689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:49:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e16721d7-e700-44e8-8041-f6b3d2f6129c tempest-CreateVolumesFromImageTest-539314689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e16721d7-e700-44e8-8041-f6b3d2f6129c tempest-CreateVolumesFromImageTest-539314689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:26 devstack sudo[104155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:49:26 devstack sudo[104155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:26 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-70a7f9f9-5fec-4c9c-89f8-bcb7a95c5f7e tempest-CreateVolumesFromImageTest-539314689 None] Acquiring lock "cinder-02091abb-fddf-47f7-b3d4-13dc13a7b54e-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:49:26 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-70a7f9f9-5fec-4c9c-89f8-bcb7a95c5f7e tempest-CreateVolumesFromImageTest-539314689 None] Lock "cinder-02091abb-fddf-47f7-b3d4-13dc13a7b54e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:49:26 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-70a7f9f9-5fec-4c9c-89f8-bcb7a95c5f7e tempest-CreateVolumesFromImageTest-539314689 None] Acquiring lock "cinder-quobyte-02091abb-fddf-47f7-b3d4-13dc13a7b54e" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:49:26 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-70a7f9f9-5fec-4c9c-89f8-bcb7a95c5f7e tempest-CreateVolumesFromImageTest-539314689 None] Lock "cinder-quobyte-02091abb-fddf-47f7-b3d4-13dc13a7b54e" acquired by "delete_volume" :: waited 0.020s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:49:26 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[4975e361-a323-4f8d-b7a5-cddf08112299]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:49:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-70a7f9f9-5fec-4c9c-89f8-bcb7a95c5f7e tempest-CreateVolumesFromImageTest-539314689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-02091abb-fddf-47f7-b3d4-13dc13a7b54e {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:26 devstack sudo[104155]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e16721d7-e700-44e8-8041-f6b3d2f6129c tempest-CreateVolumesFromImageTest-539314689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.315s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:26 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-e16721d7-e700-44e8-8041-f6b3d2f6129c tempest-CreateVolumesFromImageTest-539314689 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:49:26 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-e16721d7-e700-44e8-8041-f6b3d2f6129c tempest-CreateVolumesFromImageTest-539314689 None] Deleted volume successfully. Aug 28 09:49:26 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e16721d7-e700-44e8-8041-f6b3d2f6129c tempest-CreateVolumesFromImageTest-539314689 None] Lock "cinder-5e787072-076f-4866-895e-14a1e2c286e3-delete_volume" released by "delete_volume" :: held 1.340s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:49:26 devstack sudo[104153]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ac2b4888-c5d2-4128-b64e-91a45f43c881 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8c2c99bb-033b-4f71-a22c-e3c33cbe0d74 1073741824" returned: 0 in 0.533s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ac2b4888-c5d2-4128-b64e-91a45f43c881 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8c2c99bb-033b-4f71-a22c-e3c33cbe0d74 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:26 devstack sudo[104162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-02091abb-fddf-47f7-b3d4-13dc13a7b54e Aug 28 09:49:26 devstack sudo[104162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:26 devstack sudo[104163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8c2c99bb-033b-4f71-a22c-e3c33cbe0d74 Aug 28 09:49:26 devstack sudo[104163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:26 devstack sudo[104163]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ac2b4888-c5d2-4128-b64e-91a45f43c881 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8c2c99bb-033b-4f71-a22c-e3c33cbe0d74" returned: 0 in 0.243s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:26 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ac2b4888-c5d2-4128-b64e-91a45f43c881 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:49:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ac2b4888-c5d2-4128-b64e-91a45f43c881 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-1de7c272-0936-4b50-ad6b-c38800572f7b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.407s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:26 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-1de7c272-0936-4b50-ad6b-c38800572f7b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1631926642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d117743-18db-4d17-88c6-f9f6429cf385,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0965f0d4cc2d4de48d3a9c94319ada7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:22Z,use_quota=True,user_id='c5054c9a36544491af674273388073ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:49:26 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-1de7c272-0936-4b50-ad6b-c38800572f7b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Creating volume 8d117743-18db-4d17-88c6-f9f6429cf385 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:49:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-1de7c272-0936-4b50-ad6b-c38800572f7b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-1de7c272-0936-4b50-ad6b-c38800572f7b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:26 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-1de7c272-0936-4b50-ad6b-c38800572f7b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:49:26 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-1de7c272-0936-4b50-ad6b-c38800572f7b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:49:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-1de7c272-0936-4b50-ad6b-c38800572f7b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:26 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-1de7c272-0936-4b50-ad6b-c38800572f7b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:49:26 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-1de7c272-0936-4b50-ad6b-c38800572f7b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:49:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1de7c272-0936-4b50-ad6b-c38800572f7b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8d117743-18db-4d17-88c6-f9f6429cf385 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:26 devstack sudo[104162]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-70a7f9f9-5fec-4c9c-89f8-bcb7a95c5f7e tempest-CreateVolumesFromImageTest-539314689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-02091abb-fddf-47f7-b3d4-13dc13a7b54e" returned: 0 in 0.391s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-70a7f9f9-5fec-4c9c-89f8-bcb7a95c5f7e tempest-CreateVolumesFromImageTest-539314689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-02091abb-fddf-47f7-b3d4-13dc13a7b54e {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:26 devstack sudo[104170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8d117743-18db-4d17-88c6-f9f6429cf385 1073741824 Aug 28 09:49:26 devstack sudo[104170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ac2b4888-c5d2-4128-b64e-91a45f43c881 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (813889b2-96f2-49f9-b9ae-a1aff8386456) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c2c99bb-033b-4f71-a22c-e3c33cbe0d74', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ac2b4888-c5d2-4128-b64e-91a45f43c881 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1d61bc5-a6ee-4da6-93a5-401624b0dafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:26 devstack sudo[104171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-02091abb-fddf-47f7-b3d4-13dc13a7b54e Aug 28 09:49:26 devstack sudo[104171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:26 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-ac2b4888-c5d2-4128-b64e-91a45f43c881 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Volume volume-8c2c99bb-033b-4f71-a22c-e3c33cbe0d74 (8c2c99bb-033b-4f71-a22c-e3c33cbe0d74): created successfully Aug 28 09:49:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ac2b4888-c5d2-4128-b64e-91a45f43c881 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1d61bc5-a6ee-4da6-93a5-401624b0dafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ac2b4888-c5d2-4128-b64e-91a45f43c881 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Flow 'volume_create_manager' (1ec201dc-7659-48ad-a4c5-1eb89cae7afe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:49:26 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-ac2b4888-c5d2-4128-b64e-91a45f43c881 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Created volume successfully. Aug 28 09:49:27 devstack sudo[104171]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-70a7f9f9-5fec-4c9c-89f8-bcb7a95c5f7e tempest-CreateVolumesFromImageTest-539314689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-02091abb-fddf-47f7-b3d4-13dc13a7b54e" returned: 0 in 0.276s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:27 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-70a7f9f9-5fec-4c9c-89f8-bcb7a95c5f7e tempest-CreateVolumesFromImageTest-539314689 None] Lock "cinder-quobyte-02091abb-fddf-47f7-b3d4-13dc13a7b54e" released by "delete_volume" :: held 0.717s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:49:27 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-70a7f9f9-5fec-4c9c-89f8-bcb7a95c5f7e tempest-CreateVolumesFromImageTest-539314689 None] Created reservations ['718b2bbd-2b59-4b2e-a66c-c16ffd7a46b2', 'a6468635-3ce9-475f-beae-226bff7fb75d', '6b0dd7b3-2d36-487b-a55a-9976917c4c71', 'cc13cbe9-d8b9-4171-a2ad-f3029f7299ca'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:49:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-70a7f9f9-5fec-4c9c-89f8-bcb7a95c5f7e tempest-CreateVolumesFromImageTest-539314689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-70a7f9f9-5fec-4c9c-89f8-bcb7a95c5f7e tempest-CreateVolumesFromImageTest-539314689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:27 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-70a7f9f9-5fec-4c9c-89f8-bcb7a95c5f7e tempest-CreateVolumesFromImageTest-539314689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:49:27 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-70a7f9f9-5fec-4c9c-89f8-bcb7a95c5f7e tempest-CreateVolumesFromImageTest-539314689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:49:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-70a7f9f9-5fec-4c9c-89f8-bcb7a95c5f7e tempest-CreateVolumesFromImageTest-539314689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-70a7f9f9-5fec-4c9c-89f8-bcb7a95c5f7e tempest-CreateVolumesFromImageTest-539314689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:27 devstack sudo[104179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:49:27 devstack sudo[104179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:27 devstack sudo[104170]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1de7c272-0936-4b50-ad6b-c38800572f7b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8d117743-18db-4d17-88c6-f9f6429cf385 1073741824" returned: 0 in 0.463s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1de7c272-0936-4b50-ad6b-c38800572f7b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8d117743-18db-4d17-88c6-f9f6429cf385 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:27 devstack sudo[104181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8d117743-18db-4d17-88c6-f9f6429cf385 Aug 28 09:49:27 devstack sudo[104181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:27 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-d5ef50bf-8faf-4291-90d4-fec110c6cda0 tempest-CreateVolumesFromImageTest-539314689 None] Acquiring lock "cinder-d77cc7f0-3b88-4acb-beab-42590650ea8c-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:49:27 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-d5ef50bf-8faf-4291-90d4-fec110c6cda0 tempest-CreateVolumesFromImageTest-539314689 None] Lock "cinder-d77cc7f0-3b88-4acb-beab-42590650ea8c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:49:27 devstack sudo[104179]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-70a7f9f9-5fec-4c9c-89f8-bcb7a95c5f7e tempest-CreateVolumesFromImageTest-539314689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.297s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:27 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-70a7f9f9-5fec-4c9c-89f8-bcb7a95c5f7e tempest-CreateVolumesFromImageTest-539314689 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:49:27 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-70a7f9f9-5fec-4c9c-89f8-bcb7a95c5f7e tempest-CreateVolumesFromImageTest-539314689 None] Deleted volume successfully. Aug 28 09:49:27 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-d5ef50bf-8faf-4291-90d4-fec110c6cda0 tempest-CreateVolumesFromImageTest-539314689 None] Acquiring lock "cinder-quobyte-d77cc7f0-3b88-4acb-beab-42590650ea8c" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:49:27 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-70a7f9f9-5fec-4c9c-89f8-bcb7a95c5f7e tempest-CreateVolumesFromImageTest-539314689 None] Lock "cinder-02091abb-fddf-47f7-b3d4-13dc13a7b54e-delete_volume" released by "delete_volume" :: held 1.259s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:49:27 devstack sudo[104181]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1de7c272-0936-4b50-ad6b-c38800572f7b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8d117743-18db-4d17-88c6-f9f6429cf385" returned: 0 in 0.292s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:27 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-1de7c272-0936-4b50-ad6b-c38800572f7b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:49:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-1de7c272-0936-4b50-ad6b-c38800572f7b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:27 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-d5ef50bf-8faf-4291-90d4-fec110c6cda0 tempest-CreateVolumesFromImageTest-539314689 None] Lock "cinder-quobyte-d77cc7f0-3b88-4acb-beab-42590650ea8c" acquired by "delete_volume" :: waited 0.021s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:49:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-eba5dfba-cb31-403b-851d-f8ec133732cd tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.613s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:27 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-eba5dfba-cb31-403b-851d-f8ec133732cd tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-598447539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5e1f7bc-61e5-4c18-8ede-6fc6cffbb339,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0965f0d4cc2d4de48d3a9c94319ada7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:23Z,use_quota=True,user_id='c5054c9a36544491af674273388073ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:49:27 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-eba5dfba-cb31-403b-851d-f8ec133732cd tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Creating volume d5e1f7bc-61e5-4c18-8ede-6fc6cffbb339 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:49:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-eba5dfba-cb31-403b-851d-f8ec133732cd tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-eba5dfba-cb31-403b-851d-f8ec133732cd tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:27 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-eba5dfba-cb31-403b-851d-f8ec133732cd tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:49:27 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-eba5dfba-cb31-403b-851d-f8ec133732cd tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:49:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-eba5dfba-cb31-403b-851d-f8ec133732cd tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:27 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-eba5dfba-cb31-403b-851d-f8ec133732cd tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:49:27 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-eba5dfba-cb31-403b-851d-f8ec133732cd tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:49:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-eba5dfba-cb31-403b-851d-f8ec133732cd tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5e1f7bc-61e5-4c18-8ede-6fc6cffbb339 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:27 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[0afc6270-eb96-4897-a948-1dabcd2f01b5]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:49:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d5ef50bf-8faf-4291-90d4-fec110c6cda0 tempest-CreateVolumesFromImageTest-539314689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d77cc7f0-3b88-4acb-beab-42590650ea8c {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:27 devstack sudo[104185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5e1f7bc-61e5-4c18-8ede-6fc6cffbb339 1073741824 Aug 28 09:49:27 devstack sudo[104185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1de7c272-0936-4b50-ad6b-c38800572f7b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9b7e873-47fd-4060-835c-d3cc277e8934) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d117743-18db-4d17-88c6-f9f6429cf385', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1de7c272-0936-4b50-ad6b-c38800572f7b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7529fbe4-8fcf-4280-b913-976f0c6513f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:27 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-1de7c272-0936-4b50-ad6b-c38800572f7b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Volume volume-8d117743-18db-4d17-88c6-f9f6429cf385 (8d117743-18db-4d17-88c6-f9f6429cf385): created successfully Aug 28 09:49:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1de7c272-0936-4b50-ad6b-c38800572f7b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7529fbe4-8fcf-4280-b913-976f0c6513f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-1de7c272-0936-4b50-ad6b-c38800572f7b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Flow 'volume_create_manager' (8d98dc6a-cbb4-463b-a3a3-4acfebd1668d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:49:27 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-1de7c272-0936-4b50-ad6b-c38800572f7b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Created volume successfully. Aug 28 09:49:27 devstack sudo[104186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d77cc7f0-3b88-4acb-beab-42590650ea8c Aug 28 09:49:27 devstack sudo[104186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:28 devstack sudo[104186]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d5ef50bf-8faf-4291-90d4-fec110c6cda0 tempest-CreateVolumesFromImageTest-539314689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d77cc7f0-3b88-4acb-beab-42590650ea8c" returned: 0 in 0.392s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d5ef50bf-8faf-4291-90d4-fec110c6cda0 tempest-CreateVolumesFromImageTest-539314689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d77cc7f0-3b88-4acb-beab-42590650ea8c {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:28 devstack sudo[104185]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-eba5dfba-cb31-403b-851d-f8ec133732cd tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5e1f7bc-61e5-4c18-8ede-6fc6cffbb339 1073741824" returned: 0 in 0.421s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:28 devstack sudo[104195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d77cc7f0-3b88-4acb-beab-42590650ea8c Aug 28 09:49:28 devstack sudo[104195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-eba5dfba-cb31-403b-851d-f8ec133732cd tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5e1f7bc-61e5-4c18-8ede-6fc6cffbb339 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:28 devstack sudo[104197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5e1f7bc-61e5-4c18-8ede-6fc6cffbb339 Aug 28 09:49:28 devstack sudo[104197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:28 devstack sudo[104195]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d5ef50bf-8faf-4291-90d4-fec110c6cda0 tempest-CreateVolumesFromImageTest-539314689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d77cc7f0-3b88-4acb-beab-42590650ea8c" returned: 0 in 0.265s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:28 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-d5ef50bf-8faf-4291-90d4-fec110c6cda0 tempest-CreateVolumesFromImageTest-539314689 None] Lock "cinder-quobyte-d77cc7f0-3b88-4acb-beab-42590650ea8c" released by "delete_volume" :: held 0.722s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:49:28 devstack sudo[104197]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-eba5dfba-cb31-403b-851d-f8ec133732cd tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5e1f7bc-61e5-4c18-8ede-6fc6cffbb339" returned: 0 in 0.260s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:28 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-eba5dfba-cb31-403b-851d-f8ec133732cd tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:49:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-eba5dfba-cb31-403b-851d-f8ec133732cd tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.217s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:28 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8f4dddb-7e87-4290-a307-9f7c49256b92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e326ed5432b4631828d3aa7b0f7472e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:21Z,use_quota=True,user_id='9f452ea8a63e43a1b5e11bfbce092c97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:49:28 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] Creating volume f8f4dddb-7e87-4290-a307-9f7c49256b92 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:49:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:28 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:49:28 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:49:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:28 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:49:28 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:49:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f8f4dddb-7e87-4290-a307-9f7c49256b92 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-eba5dfba-cb31-403b-851d-f8ec133732cd tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59033c6f-b750-479d-bdaa-690133a11c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5e1f7bc-61e5-4c18-8ede-6fc6cffbb339', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:28 devstack sudo[104201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f8f4dddb-7e87-4290-a307-9f7c49256b92 1073741824 Aug 28 09:49:28 devstack sudo[104201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-eba5dfba-cb31-403b-851d-f8ec133732cd tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15aefa42-5a62-45ee-88cb-6284bb388020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:28 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-eba5dfba-cb31-403b-851d-f8ec133732cd tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Volume volume-d5e1f7bc-61e5-4c18-8ede-6fc6cffbb339 (d5e1f7bc-61e5-4c18-8ede-6fc6cffbb339): created successfully Aug 28 09:49:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-eba5dfba-cb31-403b-851d-f8ec133732cd tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15aefa42-5a62-45ee-88cb-6284bb388020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-eba5dfba-cb31-403b-851d-f8ec133732cd tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Flow 'volume_create_manager' (c3d154fe-09be-4c1f-9496-0ac6c71e4227) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:49:28 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-eba5dfba-cb31-403b-851d-f8ec133732cd tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Created volume successfully. Aug 28 09:49:28 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-d5ef50bf-8faf-4291-90d4-fec110c6cda0 tempest-CreateVolumesFromImageTest-539314689 None] Created reservations ['4de73cfd-2ed4-497f-8679-1512833df776', '1b3d4fcb-1b7d-42d5-80e0-89194802327f', '8e52ed89-a555-4ccd-8b61-c693c6e8eeba', 'be80ca14-e661-4d18-98fe-2c0c4c67f711'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:49:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-d5ef50bf-8faf-4291-90d4-fec110c6cda0 tempest-CreateVolumesFromImageTest-539314689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-d5ef50bf-8faf-4291-90d4-fec110c6cda0 tempest-CreateVolumesFromImageTest-539314689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:28 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-d5ef50bf-8faf-4291-90d4-fec110c6cda0 tempest-CreateVolumesFromImageTest-539314689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:49:28 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-d5ef50bf-8faf-4291-90d4-fec110c6cda0 tempest-CreateVolumesFromImageTest-539314689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:49:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-d5ef50bf-8faf-4291-90d4-fec110c6cda0 tempest-CreateVolumesFromImageTest-539314689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d5ef50bf-8faf-4291-90d4-fec110c6cda0 tempest-CreateVolumesFromImageTest-539314689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:28 devstack sudo[104203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:49:28 devstack sudo[104203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:28 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-0a86baca-4b70-44da-b714-4514568d2104 tempest-CreateVolumesFromImageTest-539314689 None] Acquiring lock "cinder-4ac330f9-065e-4199-81af-1d7e58858063-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:49:28 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-0a86baca-4b70-44da-b714-4514568d2104 tempest-CreateVolumesFromImageTest-539314689 None] Lock "cinder-4ac330f9-065e-4199-81af-1d7e58858063-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:49:28 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-0a86baca-4b70-44da-b714-4514568d2104 tempest-CreateVolumesFromImageTest-539314689 None] Acquiring lock "cinder-quobyte-4ac330f9-065e-4199-81af-1d7e58858063" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:49:28 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-0a86baca-4b70-44da-b714-4514568d2104 tempest-CreateVolumesFromImageTest-539314689 None] Lock "cinder-quobyte-4ac330f9-065e-4199-81af-1d7e58858063" acquired by "delete_volume" :: waited 0.022s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:49:28 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[a557b194-494d-4901-87b0-7c3e60ec18cf]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:49:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0a86baca-4b70-44da-b714-4514568d2104 tempest-CreateVolumesFromImageTest-539314689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ac330f9-065e-4199-81af-1d7e58858063 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:28 devstack sudo[104203]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d5ef50bf-8faf-4291-90d4-fec110c6cda0 tempest-CreateVolumesFromImageTest-539314689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.297s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:28 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-d5ef50bf-8faf-4291-90d4-fec110c6cda0 tempest-CreateVolumesFromImageTest-539314689 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:49:28 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-d5ef50bf-8faf-4291-90d4-fec110c6cda0 tempest-CreateVolumesFromImageTest-539314689 None] Deleted volume successfully. Aug 28 09:49:28 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-d5ef50bf-8faf-4291-90d4-fec110c6cda0 tempest-CreateVolumesFromImageTest-539314689 None] Lock "cinder-d77cc7f0-3b88-4acb-beab-42590650ea8c-delete_volume" released by "delete_volume" :: held 1.369s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:49:28 devstack sudo[104201]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f8f4dddb-7e87-4290-a307-9f7c49256b92 1073741824" returned: 0 in 0.538s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f8f4dddb-7e87-4290-a307-9f7c49256b92 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:28 devstack sudo[104211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f8f4dddb-7e87-4290-a307-9f7c49256b92 Aug 28 09:49:28 devstack sudo[104211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:28 devstack sudo[104210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ac330f9-065e-4199-81af-1d7e58858063 Aug 28 09:49:28 devstack sudo[104210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:29 devstack sudo[104211]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f8f4dddb-7e87-4290-a307-9f7c49256b92" returned: 0 in 0.247s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:29 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:49:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.911s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:29 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3793440-13fb-4609-a558-9bb77715ad6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0923bb25b9543db98c6471f3608b680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:23Z,use_quota=True,user_id='ee35c4e0b1ac40b2bb7c957a3ef20ce6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a3e6f7c0-b0e8-4e87-abbd-0f8ed27b9db0),volume_type_id=a3e6f7c0-b0e8-4e87-abbd-0f8ed27b9db0)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:49:29 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Creating volume e3793440-13fb-4609-a558-9bb77715ad6b {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:49:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:29 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:49:29 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:49:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:29 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:49:29 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:49:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e3793440-13fb-4609-a558-9bb77715ad6b 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:29 devstack sudo[104210]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:29 devstack sudo[104218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e3793440-13fb-4609-a558-9bb77715ad6b 1073741824 Aug 28 09:49:29 devstack sudo[104218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0a86baca-4b70-44da-b714-4514568d2104 tempest-CreateVolumesFromImageTest-539314689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ac330f9-065e-4199-81af-1d7e58858063" returned: 0 in 0.407s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0a86baca-4b70-44da-b714-4514568d2104 tempest-CreateVolumesFromImageTest-539314689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ac330f9-065e-4199-81af-1d7e58858063 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:29 devstack cinder-volume[86081]: DEBUG cinder.volume.volume_utils [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] Attempting download of c65342cb-f54a-44f5-8a7b-b3b5e576985d ((None, [{'url': 'file:///opt/stack/data/glance/images/c65342cb-f54a-44f5-8a7b-b3b5e576985d', 'metadata': {}}])) to volume f8f4dddb-7e87-4290-a307-9f7c49256b92. {{(pid=86081) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 28 09:49:29 devstack sudo[104220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ac330f9-065e-4199-81af-1d7e58858063 Aug 28 09:49:29 devstack sudo[104220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:29 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[97bb33ff-8674-4e38-ba46-87d2379e989f]: (4, 'raw') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:49:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c65342cb-f54a-44f5-8a7b-b3b5e576985d_37rkusvv {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:29 devstack sudo[104222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c65342cb-f54a-44f5-8a7b-b3b5e576985d_37rkusvv Aug 28 09:49:29 devstack sudo[104222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:29 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-62d2b001-0bf1-4e8c-93f9-58efe2ace25b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Acquiring lock "cinder-d5e1f7bc-61e5-4c18-8ede-6fc6cffbb339-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:49:29 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-62d2b001-0bf1-4e8c-93f9-58efe2ace25b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "cinder-d5e1f7bc-61e5-4c18-8ede-6fc6cffbb339-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:49:29 devstack sudo[104220]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0a86baca-4b70-44da-b714-4514568d2104 tempest-CreateVolumesFromImageTest-539314689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ac330f9-065e-4199-81af-1d7e58858063" returned: 0 in 0.348s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:29 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-0a86baca-4b70-44da-b714-4514568d2104 tempest-CreateVolumesFromImageTest-539314689 None] Lock "cinder-quobyte-4ac330f9-065e-4199-81af-1d7e58858063" released by "delete_volume" :: held 0.803s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:49:29 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-62d2b001-0bf1-4e8c-93f9-58efe2ace25b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Acquiring lock "cinder-quobyte-d5e1f7bc-61e5-4c18-8ede-6fc6cffbb339" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:49:29 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-62d2b001-0bf1-4e8c-93f9-58efe2ace25b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "cinder-quobyte-d5e1f7bc-61e5-4c18-8ede-6fc6cffbb339" acquired by "delete_volume" :: waited 0.019s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:49:29 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a46570d-1f2f-4239-87c2-dca8c1575af5]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:49:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-62d2b001-0bf1-4e8c-93f9-58efe2ace25b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5e1f7bc-61e5-4c18-8ede-6fc6cffbb339 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:29 devstack sudo[104222]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c65342cb-f54a-44f5-8a7b-b3b5e576985d_37rkusvv" returned: 0 in 0.427s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c65342cb-f54a-44f5-8a7b-b3b5e576985d_37rkusvv {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:29 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-0a86baca-4b70-44da-b714-4514568d2104 tempest-CreateVolumesFromImageTest-539314689 None] Created reservations ['dc0ad73a-dabe-479e-8766-cdbdccce7fc4', 'd54a07e0-f07d-48c3-a559-f1fb6e18828d', '6034961d-3e2b-4ce5-a28e-354e2ca9f804', '0ed11a24-7a61-4a8b-930a-c660e2ba0f96'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:49:29 devstack sudo[104218]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e3793440-13fb-4609-a558-9bb77715ad6b 1073741824" returned: 0 in 0.592s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:29 devstack sudo[104232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5e1f7bc-61e5-4c18-8ede-6fc6cffbb339 Aug 28 09:49:29 devstack sudo[104232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e3793440-13fb-4609-a558-9bb77715ad6b {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:29 devstack sudo[104233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c65342cb-f54a-44f5-8a7b-b3b5e576985d_37rkusvv Aug 28 09:49:29 devstack sudo[104233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0a86baca-4b70-44da-b714-4514568d2104 tempest-CreateVolumesFromImageTest-539314689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0a86baca-4b70-44da-b714-4514568d2104 tempest-CreateVolumesFromImageTest-539314689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:29 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0a86baca-4b70-44da-b714-4514568d2104 tempest-CreateVolumesFromImageTest-539314689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:49:29 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0a86baca-4b70-44da-b714-4514568d2104 tempest-CreateVolumesFromImageTest-539314689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:49:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0a86baca-4b70-44da-b714-4514568d2104 tempest-CreateVolumesFromImageTest-539314689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0a86baca-4b70-44da-b714-4514568d2104 tempest-CreateVolumesFromImageTest-539314689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:29 devstack sudo[104235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e3793440-13fb-4609-a558-9bb77715ad6b Aug 28 09:49:29 devstack sudo[104235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:29 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ee7f046b-5a55-4fc8-b2a6-1c3f6acb940e tempest-CreateVolumesFromImageTest-539314689 None] Acquiring lock "cinder-458933f0-eaa0-422f-918d-bddf4dbc96e0-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:49:29 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ee7f046b-5a55-4fc8-b2a6-1c3f6acb940e tempest-CreateVolumesFromImageTest-539314689 None] Lock "cinder-458933f0-eaa0-422f-918d-bddf4dbc96e0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:49:29 devstack sudo[104237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:49:29 devstack sudo[104237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:30 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ee7f046b-5a55-4fc8-b2a6-1c3f6acb940e tempest-CreateVolumesFromImageTest-539314689 None] Acquiring lock "cinder-quobyte-458933f0-eaa0-422f-918d-bddf4dbc96e0" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:49:30 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ee7f046b-5a55-4fc8-b2a6-1c3f6acb940e tempest-CreateVolumesFromImageTest-539314689 None] Lock "cinder-quobyte-458933f0-eaa0-422f-918d-bddf4dbc96e0" acquired by "delete_volume" :: waited 0.039s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:49:30 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf88ba2-1d68-44dc-91d3-fd3d65a076a9]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:49:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ee7f046b-5a55-4fc8-b2a6-1c3f6acb940e tempest-CreateVolumesFromImageTest-539314689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-458933f0-eaa0-422f-918d-bddf4dbc96e0 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:30 devstack sudo[104233]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c65342cb-f54a-44f5-8a7b-b3b5e576985d_37rkusvv" returned: 1 in 0.497s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c65342cb-f54a-44f5-8a7b-b3b5e576985d_37rkusvv' failed. Not Retrying. {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 09:49:30 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[90239eea-42dd-44c4-9fe0-20d8718cf11e]: (4, 'raw') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:49:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c65342cb-f54a-44f5-8a7b-b3b5e576985d_4tiwqfrzdevstack@QuobyteHD {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:30 devstack sudo[104232]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:30 devstack sudo[104235]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:30 devstack sudo[104240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-458933f0-eaa0-422f-918d-bddf4dbc96e0 Aug 28 09:49:30 devstack sudo[104240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-62d2b001-0bf1-4e8c-93f9-58efe2ace25b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5e1f7bc-61e5-4c18-8ede-6fc6cffbb339" returned: 0 in 0.605s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-62d2b001-0bf1-4e8c-93f9-58efe2ace25b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5e1f7bc-61e5-4c18-8ede-6fc6cffbb339 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e3793440-13fb-4609-a558-9bb77715ad6b" returned: 0 in 0.440s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:30 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:49:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:30 devstack sudo[104250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5e1f7bc-61e5-4c18-8ede-6fc6cffbb339 Aug 28 09:49:30 devstack sudo[104250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:30 devstack cinder-volume[86081]: DEBUG cinder.volume.volume_utils [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Attempting download of 1abbc937-d5b4-40c9-8d0d-1ef1443abc8f ((None, [{'url': 'file:///opt/stack/data/glance/images/1abbc937-d5b4-40c9-8d0d-1ef1443abc8f', 'metadata': {}}])) to volume e3793440-13fb-4609-a558-9bb77715ad6b. {{(pid=86081) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 28 09:49:30 devstack sudo[104237]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0a86baca-4b70-44da-b714-4514568d2104 tempest-CreateVolumesFromImageTest-539314689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.448s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:30 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-0a86baca-4b70-44da-b714-4514568d2104 tempest-CreateVolumesFromImageTest-539314689 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:49:30 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-0a86baca-4b70-44da-b714-4514568d2104 tempest-CreateVolumesFromImageTest-539314689 None] Deleted volume successfully. Aug 28 09:49:30 devstack sudo[104247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c65342cb-f54a-44f5-8a7b-b3b5e576985d_4tiwqfrzdevstack@QuobyteHD Aug 28 09:49:30 devstack sudo[104247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:30 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-0a86baca-4b70-44da-b714-4514568d2104 tempest-CreateVolumesFromImageTest-539314689 None] Lock "cinder-4ac330f9-065e-4199-81af-1d7e58858063-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:49:30 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1b3c1a-a3f3-4145-9c44-859b5392685d]: (4, 'raw') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:49:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1abbc937-d5b4-40c9-8d0d-1ef1443abc8f_xwy0e48d {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:30 devstack sudo[104253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1abbc937-d5b4-40c9-8d0d-1ef1443abc8f_xwy0e48d Aug 28 09:49:30 devstack sudo[104253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:30 devstack sudo[104250]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-62d2b001-0bf1-4e8c-93f9-58efe2ace25b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5e1f7bc-61e5-4c18-8ede-6fc6cffbb339" returned: 0 in 0.328s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:30 devstack sudo[104240]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:30 devstack sudo[104247]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ee7f046b-5a55-4fc8-b2a6-1c3f6acb940e tempest-CreateVolumesFromImageTest-539314689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-458933f0-eaa0-422f-918d-bddf4dbc96e0" returned: 0 in 0.513s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c65342cb-f54a-44f5-8a7b-b3b5e576985d_4tiwqfrzdevstack@QuobyteHD" returned: 0 in 0.392s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ee7f046b-5a55-4fc8-b2a6-1c3f6acb940e tempest-CreateVolumesFromImageTest-539314689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-458933f0-eaa0-422f-918d-bddf4dbc96e0 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c65342cb-f54a-44f5-8a7b-b3b5e576985d_4tiwqfrzdevstack@QuobyteHD {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:30 devstack sudo[104262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-458933f0-eaa0-422f-918d-bddf4dbc96e0 Aug 28 09:49:30 devstack sudo[104262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:30 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-62d2b001-0bf1-4e8c-93f9-58efe2ace25b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "cinder-quobyte-d5e1f7bc-61e5-4c18-8ede-6fc6cffbb339" released by "delete_volume" :: held 1.042s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:49:30 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-62d2b001-0bf1-4e8c-93f9-58efe2ace25b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Created reservations ['12f80497-d120-491a-8195-25abb7784209', 'aad95fd4-4e11-4cd1-96a9-fa87bcd55dc4', '535bb77b-c073-49a4-ba2f-b2874395494a', 'd46f2059-0e06-4b65-9b6f-5de9a586b0f3'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:49:30 devstack sudo[104263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c65342cb-f54a-44f5-8a7b-b3b5e576985d_4tiwqfrzdevstack@QuobyteHD Aug 28 09:49:30 devstack sudo[104263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:30 devstack sudo[104253]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1abbc937-d5b4-40c9-8d0d-1ef1443abc8f_xwy0e48d" returned: 0 in 0.402s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1abbc937-d5b4-40c9-8d0d-1ef1443abc8f_xwy0e48d {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-62d2b001-0bf1-4e8c-93f9-58efe2ace25b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-62d2b001-0bf1-4e8c-93f9-58efe2ace25b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:30 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-62d2b001-0bf1-4e8c-93f9-58efe2ace25b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:49:30 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-62d2b001-0bf1-4e8c-93f9-58efe2ace25b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:49:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-62d2b001-0bf1-4e8c-93f9-58efe2ace25b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-62d2b001-0bf1-4e8c-93f9-58efe2ace25b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:30 devstack sudo[104269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:49:30 devstack sudo[104269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:30 devstack sudo[104262]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ee7f046b-5a55-4fc8-b2a6-1c3f6acb940e tempest-CreateVolumesFromImageTest-539314689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-458933f0-eaa0-422f-918d-bddf4dbc96e0" returned: 0 in 0.308s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:30 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ee7f046b-5a55-4fc8-b2a6-1c3f6acb940e tempest-CreateVolumesFromImageTest-539314689 None] Lock "cinder-quobyte-458933f0-eaa0-422f-918d-bddf4dbc96e0" released by "delete_volume" :: held 0.883s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:49:30 devstack sudo[104268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1abbc937-d5b4-40c9-8d0d-1ef1443abc8f_xwy0e48d Aug 28 09:49:30 devstack sudo[104268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:31 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-ee7f046b-5a55-4fc8-b2a6-1c3f6acb940e tempest-CreateVolumesFromImageTest-539314689 None] Created reservations ['10463028-8704-46f9-b44d-e20776433392', '0a1aaafb-81e5-4f22-bd86-4b0618d8646b', '0f1da932-4b06-443b-859f-808d39a85ede', '0e2a8e37-aebf-4cd2-8cea-789fd0016160'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:49:31 devstack sudo[104263]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c65342cb-f54a-44f5-8a7b-b3b5e576985d_4tiwqfrzdevstack@QuobyteHD" returned: 1 in 0.426s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c65342cb-f54a-44f5-8a7b-b3b5e576985d_4tiwqfrzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 09:49:31 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] c65342cb-f54a-44f5-8a7b-b3b5e576985d was raw, converting to qcow2 {{(pid=86081) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 28 09:49:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c65342cb-f54a-44f5-8a7b-b3b5e576985d_4tiwqfrzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f8f4dddb-7e87-4290-a307-9f7c49256b92 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:31 devstack sudo[104276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c65342cb-f54a-44f5-8a7b-b3b5e576985d_4tiwqfrzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f8f4dddb-7e87-4290-a307-9f7c49256b92 Aug 28 09:49:31 devstack sudo[104276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ee7f046b-5a55-4fc8-b2a6-1c3f6acb940e tempest-CreateVolumesFromImageTest-539314689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ee7f046b-5a55-4fc8-b2a6-1c3f6acb940e tempest-CreateVolumesFromImageTest-539314689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:31 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ee7f046b-5a55-4fc8-b2a6-1c3f6acb940e tempest-CreateVolumesFromImageTest-539314689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:49:31 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ee7f046b-5a55-4fc8-b2a6-1c3f6acb940e tempest-CreateVolumesFromImageTest-539314689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:49:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ee7f046b-5a55-4fc8-b2a6-1c3f6acb940e tempest-CreateVolumesFromImageTest-539314689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ee7f046b-5a55-4fc8-b2a6-1c3f6acb940e tempest-CreateVolumesFromImageTest-539314689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:31 devstack sudo[104269]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-62d2b001-0bf1-4e8c-93f9-58efe2ace25b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.288s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:31 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-62d2b001-0bf1-4e8c-93f9-58efe2ace25b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:49:31 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-62d2b001-0bf1-4e8c-93f9-58efe2ace25b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Deleted volume successfully. Aug 28 09:49:31 devstack sudo[104279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:49:31 devstack sudo[104279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:31 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-62d2b001-0bf1-4e8c-93f9-58efe2ace25b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "cinder-d5e1f7bc-61e5-4c18-8ede-6fc6cffbb339-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:49:31 devstack sudo[104268]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1abbc937-d5b4-40c9-8d0d-1ef1443abc8f_xwy0e48d" returned: 1 in 0.406s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1abbc937-d5b4-40c9-8d0d-1ef1443abc8f_xwy0e48d' failed. Not Retrying. {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 09:49:31 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c268a22-55b8-4874-b83e-240e73865910]: (4, 'raw') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:49:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1abbc937-d5b4-40c9-8d0d-1ef1443abc8f_84_6omlsdevstack@QuobyteHD {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:31 devstack sudo[104283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1abbc937-d5b4-40c9-8d0d-1ef1443abc8f_84_6omlsdevstack@QuobyteHD Aug 28 09:49:31 devstack sudo[104283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:31 devstack sudo[104279]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ee7f046b-5a55-4fc8-b2a6-1c3f6acb940e tempest-CreateVolumesFromImageTest-539314689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.326s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:31 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-ee7f046b-5a55-4fc8-b2a6-1c3f6acb940e tempest-CreateVolumesFromImageTest-539314689 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:49:31 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-ee7f046b-5a55-4fc8-b2a6-1c3f6acb940e tempest-CreateVolumesFromImageTest-539314689 None] Deleted volume successfully. Aug 28 09:49:31 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ee7f046b-5a55-4fc8-b2a6-1c3f6acb940e tempest-CreateVolumesFromImageTest-539314689 None] Lock "cinder-458933f0-eaa0-422f-918d-bddf4dbc96e0-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:49:31 devstack sudo[104283]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1abbc937-d5b4-40c9-8d0d-1ef1443abc8f_84_6omlsdevstack@QuobyteHD" returned: 0 in 0.362s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1abbc937-d5b4-40c9-8d0d-1ef1443abc8f_84_6omlsdevstack@QuobyteHD {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:31 devstack sudo[104276]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c65342cb-f54a-44f5-8a7b-b3b5e576985d_4tiwqfrzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f8f4dddb-7e87-4290-a307-9f7c49256b92" returned: 0 in 0.572s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:31 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c65342cb-f54a-44f5-8a7b-b3b5e576985d_4tiwqfrzdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f8f4dddb-7e87-4290-a307-9f7c49256b92 {{(pid=86081) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 09:49:31 devstack cinder-volume[86081]: INFO cinder.image.image_utils [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] Converted 0.00 MB image at 0.00 MB/s Aug 28 09:49:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f8f4dddb-7e87-4290-a307-9f7c49256b92 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:31 devstack sudo[104293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f8f4dddb-7e87-4290-a307-9f7c49256b92 1G Aug 28 09:49:31 devstack sudo[104293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:31 devstack sudo[104292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1abbc937-d5b4-40c9-8d0d-1ef1443abc8f_84_6omlsdevstack@QuobyteHD Aug 28 09:49:31 devstack sudo[104292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:31 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-69f07653-58cb-4ac8-adb4-d5c64dc2a663 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Acquiring lock "cinder-8d117743-18db-4d17-88c6-f9f6429cf385-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:49:31 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-69f07653-58cb-4ac8-adb4-d5c64dc2a663 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "cinder-8d117743-18db-4d17-88c6-f9f6429cf385-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:49:31 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-69f07653-58cb-4ac8-adb4-d5c64dc2a663 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Acquiring lock "cinder-quobyte-8d117743-18db-4d17-88c6-f9f6429cf385" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:49:31 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-69f07653-58cb-4ac8-adb4-d5c64dc2a663 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "cinder-quobyte-8d117743-18db-4d17-88c6-f9f6429cf385" acquired by "delete_volume" :: waited 0.021s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:49:31 devstack sudo[104292]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1abbc937-d5b4-40c9-8d0d-1ef1443abc8f_84_6omlsdevstack@QuobyteHD" returned: 1 in 0.421s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1abbc937-d5b4-40c9-8d0d-1ef1443abc8f_84_6omlsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 09:49:32 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] 1abbc937-d5b4-40c9-8d0d-1ef1443abc8f was raw, converting to qcow2 {{(pid=86081) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 28 09:49:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1abbc937-d5b4-40c9-8d0d-1ef1443abc8f_84_6omlsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e3793440-13fb-4609-a558-9bb77715ad6b {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:32 devstack sudo[104293]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:32 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8375d32-3f37-4f11-8ad8-e4fb267e7951]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:49:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-69f07653-58cb-4ac8-adb4-d5c64dc2a663 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8d117743-18db-4d17-88c6-f9f6429cf385 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f8f4dddb-7e87-4290-a307-9f7c49256b92 1G" returned: 0 in 0.407s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:32 devstack cinder-volume[86081]: DEBUG cinder.volume.volume_utils [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] Downloaded image c65342cb-f54a-44f5-8a7b-b3b5e576985d ((None, [{'url': 'file:///opt/stack/data/glance/images/c65342cb-f54a-44f5-8a7b-b3b5e576985d', 'metadata': {}}])) to volume f8f4dddb-7e87-4290-a307-9f7c49256b92 successfully. {{(pid=86081) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 28 09:49:32 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] Temporary image c65342cb-f54a-44f5-8a7b-b3b5e576985d for user 9f452ea8a63e43a1b5e11bfbce092c97 is deleted. {{(pid=86081) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 28 09:49:32 devstack cinder-volume[86081]: DEBUG cinder.volume.volume_utils [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] Marking volume f8f4dddb-7e87-4290-a307-9f7c49256b92 as bootable. {{(pid=86081) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 28 09:49:32 devstack sudo[104303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1abbc937-d5b4-40c9-8d0d-1ef1443abc8f_84_6omlsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e3793440-13fb-4609-a558-9bb77715ad6b Aug 28 09:49:32 devstack sudo[104303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:32 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] Copying metadata from image c65342cb-f54a-44f5-8a7b-b3b5e576985d to f8f4dddb-7e87-4290-a307-9f7c49256b92. {{(pid=86081) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 28 09:49:32 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] Creating volume glance metadata for volume f8f4dddb-7e87-4290-a307-9f7c49256b92 backed by image c65342cb-f54a-44f5-8a7b-b3b5e576985d with: {'image_id': 'c65342cb-f54a-44f5-8a7b-b3b5e576985d', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'a14562aac3a38a9494995b6dd9d728c6', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86081) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 28 09:49:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43c7d0e0-b841-4c34-96fe-9faeb4d34c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8f4dddb-7e87-4290-a307-9f7c49256b92', 'volume_size': 1, 'image_id': 'c65342cb-f54a-44f5-8a7b-b3b5e576985d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c65342cb-f54a-44f5-8a7b-b3b5e576985d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a14562aac3a38a9494995b6dd9d728c6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0e326ed5432b4631828d3aa7b0f7472e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ba2e458e3d7977ff502b23f38704e04a67c93d60e942f400a4d0807bb11bb5779003d188e3452ec2b3aaac8d3a87ee63435bb0d19a01b3fca72fe4a7a8209702', 'id': 'c65342cb-f54a-44f5-8a7b-b3b5e576985d', 'created_at': datetime.datetime(2026, 8, 28, 7, 49, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 7, 49, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c65342cb-f54a-44f5-8a7b-b3b5e576985d/file', 'properties': {}}, 'image_service': }' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (421609f8-3f13-4f9c-baeb-63f32b4cd2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:32 devstack sudo[104304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8d117743-18db-4d17-88c6-f9f6429cf385 Aug 28 09:49:32 devstack sudo[104304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:32 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] Volume volume-f8f4dddb-7e87-4290-a307-9f7c49256b92 (f8f4dddb-7e87-4290-a307-9f7c49256b92): created successfully Aug 28 09:49:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (421609f8-3f13-4f9c-baeb-63f32b4cd2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] Flow 'volume_create_manager' (78c7720e-1e88-4904-816d-b78cb6a23403) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:49:32 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-bfffc080-166d-4d69-8cf7-fc2a50bafcb1 tempest-VolumeImageDependencyTests-1989276685 None] Created volume successfully. Aug 28 09:49:32 devstack sudo[104304]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-69f07653-58cb-4ac8-adb4-d5c64dc2a663 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8d117743-18db-4d17-88c6-f9f6429cf385" returned: 0 in 0.401s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-69f07653-58cb-4ac8-adb4-d5c64dc2a663 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8d117743-18db-4d17-88c6-f9f6429cf385 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:32 devstack sudo[104317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8d117743-18db-4d17-88c6-f9f6429cf385 Aug 28 09:49:32 devstack sudo[104317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:32 devstack sudo[104303]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1abbc937-d5b4-40c9-8d0d-1ef1443abc8f_84_6omlsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e3793440-13fb-4609-a558-9bb77715ad6b" returned: 0 in 0.576s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:32 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1abbc937-d5b4-40c9-8d0d-1ef1443abc8f_84_6omlsdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e3793440-13fb-4609-a558-9bb77715ad6b {{(pid=86081) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 09:49:32 devstack cinder-volume[86081]: INFO cinder.image.image_utils [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Converted 0.00 MB image at 0.00 MB/s Aug 28 09:49:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e3793440-13fb-4609-a558-9bb77715ad6b 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:32 devstack sudo[104319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e3793440-13fb-4609-a558-9bb77715ad6b 1G Aug 28 09:49:32 devstack sudo[104319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:32 devstack sudo[104317]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-69f07653-58cb-4ac8-adb4-d5c64dc2a663 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8d117743-18db-4d17-88c6-f9f6429cf385" returned: 0 in 0.272s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:32 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-69f07653-58cb-4ac8-adb4-d5c64dc2a663 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "cinder-quobyte-8d117743-18db-4d17-88c6-f9f6429cf385" released by "delete_volume" :: held 0.729s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:49:32 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-69f07653-58cb-4ac8-adb4-d5c64dc2a663 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Created reservations ['45b8e32e-0e3e-4bef-8741-e25ee4e7e8b0', '76604953-bda2-4df1-a9e5-690ec8612bdd', '1a1b5a8e-6b49-4b06-8c25-a32c76ea6613', '88b24f88-04c8-45ad-bb33-233a62447865'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:49:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-69f07653-58cb-4ac8-adb4-d5c64dc2a663 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-69f07653-58cb-4ac8-adb4-d5c64dc2a663 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:32 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-69f07653-58cb-4ac8-adb4-d5c64dc2a663 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:49:32 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-69f07653-58cb-4ac8-adb4-d5c64dc2a663 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:49:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-69f07653-58cb-4ac8-adb4-d5c64dc2a663 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-69f07653-58cb-4ac8-adb4-d5c64dc2a663 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:32 devstack sudo[104325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:49:32 devstack sudo[104325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:32 devstack sudo[104319]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e3793440-13fb-4609-a558-9bb77715ad6b 1G" returned: 0 in 0.370s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:32 devstack cinder-volume[86081]: DEBUG cinder.volume.volume_utils [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Downloaded image 1abbc937-d5b4-40c9-8d0d-1ef1443abc8f ((None, [{'url': 'file:///opt/stack/data/glance/images/1abbc937-d5b4-40c9-8d0d-1ef1443abc8f', 'metadata': {}}])) to volume e3793440-13fb-4609-a558-9bb77715ad6b successfully. {{(pid=86081) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 28 09:49:32 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Temporary image 1abbc937-d5b4-40c9-8d0d-1ef1443abc8f for user ee35c4e0b1ac40b2bb7c957a3ef20ce6 is deleted. {{(pid=86081) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 28 09:49:32 devstack cinder-volume[86081]: DEBUG cinder.volume.volume_utils [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Marking volume e3793440-13fb-4609-a558-9bb77715ad6b as bootable. {{(pid=86081) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 28 09:49:32 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Copying metadata from image 1abbc937-d5b4-40c9-8d0d-1ef1443abc8f to e3793440-13fb-4609-a558-9bb77715ad6b. {{(pid=86081) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 28 09:49:32 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Creating volume glance metadata for volume e3793440-13fb-4609-a558-9bb77715ad6b backed by image 1abbc937-d5b4-40c9-8d0d-1ef1443abc8f with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '1abbc937-d5b4-40c9-8d0d-1ef1443abc8f', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'c9f8bc79d3ffac53cc86bbf367eadce2', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86081) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 28 09:49:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30be162b-0d2b-4b51-a3ad-899f36a6c89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3793440-13fb-4609-a558-9bb77715ad6b', 'volume_size': 1, 'image_id': '1abbc937-d5b4-40c9-8d0d-1ef1443abc8f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1abbc937-d5b4-40c9-8d0d-1ef1443abc8f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c9f8bc79d3ffac53cc86bbf367eadce2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a0923bb25b9543db98c6471f3608b680', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '88f9628a3883fd560b1747740abd79df91c26a8b59b98e8e3c49601bf7764dc91dda30e13bb9096ce2fc15d6bfc0ab2b6077f22e55b7fad651f7dc43dac8dc2c', 'id': '1abbc937-d5b4-40c9-8d0d-1ef1443abc8f', 'created_at': datetime.datetime(2026, 8, 28, 7, 49, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 7, 49, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1abbc937-d5b4-40c9-8d0d-1ef1443abc8f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (217eedfe-73bc-4d75-b6b2-b255d1dee9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:33 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Volume volume-e3793440-13fb-4609-a558-9bb77715ad6b (e3793440-13fb-4609-a558-9bb77715ad6b): created successfully Aug 28 09:49:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (217eedfe-73bc-4d75-b6b2-b255d1dee9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:33 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Flow 'volume_create_manager' (66088d00-d69c-4c15-8070-1bdcadfd44c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:49:33 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-815934db-4423-44f4-8fb1-0152d754d106 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Acquiring lock "cinder-8c2c99bb-033b-4f71-a22c-e3c33cbe0d74-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:49:33 devstack sudo[104325]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:33 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-f4717c2e-aeb0-47cd-84e4-31c87a5a7906 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Created volume successfully. Aug 28 09:49:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-69f07653-58cb-4ac8-adb4-d5c64dc2a663 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.332s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:33 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-815934db-4423-44f4-8fb1-0152d754d106 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "cinder-8c2c99bb-033b-4f71-a22c-e3c33cbe0d74-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:49:33 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-69f07653-58cb-4ac8-adb4-d5c64dc2a663 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:49:33 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e474ab9f-28f9-40e7-be62-b177e74409a6 tempest-VolumeImageDependencyTests-1989276685 None] Acquiring lock "cinder-f8f4dddb-7e87-4290-a307-9f7c49256b92-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:49:33 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-69f07653-58cb-4ac8-adb4-d5c64dc2a663 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Deleted volume successfully. Aug 28 09:49:33 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e474ab9f-28f9-40e7-be62-b177e74409a6 tempest-VolumeImageDependencyTests-1989276685 None] Lock "cinder-f8f4dddb-7e87-4290-a307-9f7c49256b92-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:49:33 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-815934db-4423-44f4-8fb1-0152d754d106 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Acquiring lock "cinder-quobyte-8c2c99bb-033b-4f71-a22c-e3c33cbe0d74" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:49:33 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-69f07653-58cb-4ac8-adb4-d5c64dc2a663 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "cinder-8d117743-18db-4d17-88c6-f9f6429cf385-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:49:33 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-815934db-4423-44f4-8fb1-0152d754d106 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "cinder-quobyte-8c2c99bb-033b-4f71-a22c-e3c33cbe0d74" acquired by "delete_volume" :: waited 0.025s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:49:33 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e474ab9f-28f9-40e7-be62-b177e74409a6 tempest-VolumeImageDependencyTests-1989276685 None] Acquiring lock "cinder-quobyte-f8f4dddb-7e87-4290-a307-9f7c49256b92" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:49:33 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd0a58e-edbf-4e9c-aa2b-821feed1bf8e]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:49:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-815934db-4423-44f4-8fb1-0152d754d106 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8c2c99bb-033b-4f71-a22c-e3c33cbe0d74 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:33 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e474ab9f-28f9-40e7-be62-b177e74409a6 tempest-VolumeImageDependencyTests-1989276685 None] Lock "cinder-quobyte-f8f4dddb-7e87-4290-a307-9f7c49256b92" acquired by "delete_volume" :: waited 0.034s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:49:33 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[628bc1a0-c838-493a-afdb-aa1a0365ed1e]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:49:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e474ab9f-28f9-40e7-be62-b177e74409a6 tempest-VolumeImageDependencyTests-1989276685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f8f4dddb-7e87-4290-a307-9f7c49256b92 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:33 devstack sudo[104328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8c2c99bb-033b-4f71-a22c-e3c33cbe0d74 Aug 28 09:49:33 devstack sudo[104328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:33 devstack sudo[104329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f8f4dddb-7e87-4290-a307-9f7c49256b92 Aug 28 09:49:33 devstack sudo[104329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:33 devstack sudo[104328]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-815934db-4423-44f4-8fb1-0152d754d106 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8c2c99bb-033b-4f71-a22c-e3c33cbe0d74" returned: 0 in 0.402s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-815934db-4423-44f4-8fb1-0152d754d106 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8c2c99bb-033b-4f71-a22c-e3c33cbe0d74 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:33 devstack sudo[104338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8c2c99bb-033b-4f71-a22c-e3c33cbe0d74 Aug 28 09:49:33 devstack sudo[104338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:33 devstack sudo[104329]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e474ab9f-28f9-40e7-be62-b177e74409a6 tempest-VolumeImageDependencyTests-1989276685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f8f4dddb-7e87-4290-a307-9f7c49256b92" returned: 0 in 0.397s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e474ab9f-28f9-40e7-be62-b177e74409a6 tempest-VolumeImageDependencyTests-1989276685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f8f4dddb-7e87-4290-a307-9f7c49256b92 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:33 devstack sudo[104340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f8f4dddb-7e87-4290-a307-9f7c49256b92 Aug 28 09:49:33 devstack sudo[104340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:33 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-d0fc34ee-fbb0-4aac-a247-43aa04f75308 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Acquiring lock "cinder-e3793440-13fb-4609-a558-9bb77715ad6b-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:49:34 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-d0fc34ee-fbb0-4aac-a247-43aa04f75308 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Lock "cinder-e3793440-13fb-4609-a558-9bb77715ad6b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:49:34 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-d0fc34ee-fbb0-4aac-a247-43aa04f75308 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Acquiring lock "cinder-quobyte-e3793440-13fb-4609-a558-9bb77715ad6b" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:49:34 devstack sudo[104338]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-815934db-4423-44f4-8fb1-0152d754d106 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8c2c99bb-033b-4f71-a22c-e3c33cbe0d74" returned: 0 in 0.329s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:34 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-d0fc34ee-fbb0-4aac-a247-43aa04f75308 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Lock "cinder-quobyte-e3793440-13fb-4609-a558-9bb77715ad6b" acquired by "delete_volume" :: waited 0.027s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:49:34 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-815934db-4423-44f4-8fb1-0152d754d106 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "cinder-quobyte-8c2c99bb-033b-4f71-a22c-e3c33cbe0d74" released by "delete_volume" :: held 0.802s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:49:34 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f26d47-78d6-401c-abb5-20b778273ac0]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:49:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d0fc34ee-fbb0-4aac-a247-43aa04f75308 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e3793440-13fb-4609-a558-9bb77715ad6b {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:34 devstack sudo[104340]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e474ab9f-28f9-40e7-be62-b177e74409a6 tempest-VolumeImageDependencyTests-1989276685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-f8f4dddb-7e87-4290-a307-9f7c49256b92" returned: 0 in 0.343s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:34 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e474ab9f-28f9-40e7-be62-b177e74409a6 tempest-VolumeImageDependencyTests-1989276685 None] Lock "cinder-quobyte-f8f4dddb-7e87-4290-a307-9f7c49256b92" released by "delete_volume" :: held 0.801s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:49:34 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-815934db-4423-44f4-8fb1-0152d754d106 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Created reservations ['4baf54c6-3388-4172-b521-d0b4257861b2', '1284afb1-b7d8-492f-a542-fdd577fad476', 'c28216de-8ed9-434f-af65-55bbfe5fc4e1', '6924532a-1b61-43e0-bc8f-c5aac013f124'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:49:34 devstack sudo[104344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e3793440-13fb-4609-a558-9bb77715ad6b Aug 28 09:49:34 devstack sudo[104344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:34 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-e474ab9f-28f9-40e7-be62-b177e74409a6 tempest-VolumeImageDependencyTests-1989276685 None] Created reservations ['cbc2dd3b-1f70-45dd-92af-bbe26f7f22b8', 'e3978f4f-5a5b-4ec5-95b8-cd973507be3c', '086d5ea9-c67c-43b5-b02f-0837b9a9282b', '52cc3d06-7bf9-4b39-b957-4131d7236d5e'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:49:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-815934db-4423-44f4-8fb1-0152d754d106 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-815934db-4423-44f4-8fb1-0152d754d106 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:34 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-815934db-4423-44f4-8fb1-0152d754d106 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:49:34 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-815934db-4423-44f4-8fb1-0152d754d106 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:49:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-815934db-4423-44f4-8fb1-0152d754d106 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-815934db-4423-44f4-8fb1-0152d754d106 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:34 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ee03f4af-f03c-4450-80a2-025b9b3d38d0 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Acquiring lock "cinder-99e380f8-40c5-4d2b-b434-77396d3344af-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:49:34 devstack sudo[104346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:49:34 devstack sudo[104346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:34 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ee03f4af-f03c-4450-80a2-025b9b3d38d0 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "cinder-99e380f8-40c5-4d2b-b434-77396d3344af-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:49:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e474ab9f-28f9-40e7-be62-b177e74409a6 tempest-VolumeImageDependencyTests-1989276685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e474ab9f-28f9-40e7-be62-b177e74409a6 tempest-VolumeImageDependencyTests-1989276685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:34 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e474ab9f-28f9-40e7-be62-b177e74409a6 tempest-VolumeImageDependencyTests-1989276685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:49:34 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e474ab9f-28f9-40e7-be62-b177e74409a6 tempest-VolumeImageDependencyTests-1989276685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:49:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e474ab9f-28f9-40e7-be62-b177e74409a6 tempest-VolumeImageDependencyTests-1989276685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e474ab9f-28f9-40e7-be62-b177e74409a6 tempest-VolumeImageDependencyTests-1989276685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:34 devstack sudo[104350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:49:34 devstack sudo[104350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:34 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ee03f4af-f03c-4450-80a2-025b9b3d38d0 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Acquiring lock "cinder-quobyte-99e380f8-40c5-4d2b-b434-77396d3344af" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:49:34 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ee03f4af-f03c-4450-80a2-025b9b3d38d0 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "cinder-quobyte-99e380f8-40c5-4d2b-b434-77396d3344af" acquired by "delete_volume" :: waited 0.036s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:49:34 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[7967353c-f9af-450a-9a43-6fac5c7e2f2c]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:49:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ee03f4af-f03c-4450-80a2-025b9b3d38d0 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-99e380f8-40c5-4d2b-b434-77396d3344af {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:34 devstack sudo[104344]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d0fc34ee-fbb0-4aac-a247-43aa04f75308 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e3793440-13fb-4609-a558-9bb77715ad6b" returned: 0 in 0.544s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d0fc34ee-fbb0-4aac-a247-43aa04f75308 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e3793440-13fb-4609-a558-9bb77715ad6b {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:34 devstack sudo[104354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e3793440-13fb-4609-a558-9bb77715ad6b Aug 28 09:49:34 devstack sudo[104354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:34 devstack sudo[104353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-99e380f8-40c5-4d2b-b434-77396d3344af Aug 28 09:49:34 devstack sudo[104353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:34 devstack sudo[104346]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-815934db-4423-44f4-8fb1-0152d754d106 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.559s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:34 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-815934db-4423-44f4-8fb1-0152d754d106 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:49:34 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-815934db-4423-44f4-8fb1-0152d754d106 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Deleted volume successfully. Aug 28 09:49:34 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-815934db-4423-44f4-8fb1-0152d754d106 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "cinder-8c2c99bb-033b-4f71-a22c-e3c33cbe0d74-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:49:35 devstack sudo[104350]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e474ab9f-28f9-40e7-be62-b177e74409a6 tempest-VolumeImageDependencyTests-1989276685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.535s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:35 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-e474ab9f-28f9-40e7-be62-b177e74409a6 tempest-VolumeImageDependencyTests-1989276685 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:49:35 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-e474ab9f-28f9-40e7-be62-b177e74409a6 tempest-VolumeImageDependencyTests-1989276685 None] Deleted volume successfully. Aug 28 09:49:35 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e474ab9f-28f9-40e7-be62-b177e74409a6 tempest-VolumeImageDependencyTests-1989276685 None] Lock "cinder-f8f4dddb-7e87-4290-a307-9f7c49256b92-delete_volume" released by "delete_volume" :: held 1.831s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:49:35 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-26a0ed8b-6087-4dfd-8936-96add6eb9438 tempest-VolumeDependencyTests-1081417414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:49:35 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-26a0ed8b-6087-4dfd-8936-96add6eb9438 tempest-VolumeDependencyTests-1081417414 None] Flow 'volume_create_manager' (7cecc237-93a7-41ba-ae35-de58e0a7184a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:49:35 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-26a0ed8b-6087-4dfd-8936-96add6eb9438 tempest-VolumeDependencyTests-1081417414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c68a0caa-cbb3-4a33-9fcd-e339ba10fbe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:35 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-26a0ed8b-6087-4dfd-8936-96add6eb9438 tempest-VolumeDependencyTests-1081417414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c68a0caa-cbb3-4a33-9fcd-e339ba10fbe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1850544738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5203da2-d89a-4846-91e2-407b9be9dba1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2141e3a840f4529a210ac977ab79b03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:35Z,use_quota=True,user_id='f0f79757ff164ad6b5b69b378ec7e498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:35 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-26a0ed8b-6087-4dfd-8936-96add6eb9438 tempest-VolumeDependencyTests-1081417414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8b8659d-32fb-418f-ac2a-fbbd37e6178d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:35 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-26a0ed8b-6087-4dfd-8936-96add6eb9438 tempest-VolumeDependencyTests-1081417414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8b8659d-32fb-418f-ac2a-fbbd37e6178d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:35 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-26a0ed8b-6087-4dfd-8936-96add6eb9438 tempest-VolumeDependencyTests-1081417414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a228e1f-910f-4471-abb2-2697c5e7a3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:35 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-26a0ed8b-6087-4dfd-8936-96add6eb9438 tempest-VolumeDependencyTests-1081417414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a228e1f-910f-4471-abb2-2697c5e7a3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5203da2-d89a-4846-91e2-407b9be9dba1', 'volume_name': 'volume-d5203da2-d89a-4846-91e2-407b9be9dba1', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:35 devstack sudo[104353]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:35 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-26a0ed8b-6087-4dfd-8936-96add6eb9438 tempest-VolumeDependencyTests-1081417414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed02c91d-1705-44eb-915e-61c10782c55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:35 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-26a0ed8b-6087-4dfd-8936-96add6eb9438 tempest-VolumeDependencyTests-1081417414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed02c91d-1705-44eb-915e-61c10782c55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:35 devstack sudo[104354]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:35 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-26a0ed8b-6087-4dfd-8936-96add6eb9438 tempest-VolumeDependencyTests-1081417414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24037ce6-623b-433b-a75a-cff3f0d321a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:35 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-26a0ed8b-6087-4dfd-8936-96add6eb9438 tempest-VolumeDependencyTests-1081417414 None] Volume d5203da2-d89a-4846-91e2-407b9be9dba1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5203da2-d89a-4846-91e2-407b9be9dba1', 'volume_size': 1} Aug 28 09:49:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-26a0ed8b-6087-4dfd-8936-96add6eb9438 tempest-VolumeDependencyTests-1081417414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-26a0ed8b-6087-4dfd-8936-96add6eb9438 tempest-VolumeDependencyTests-1081417414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:35 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-26a0ed8b-6087-4dfd-8936-96add6eb9438 tempest-VolumeDependencyTests-1081417414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1850544738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5203da2-d89a-4846-91e2-407b9be9dba1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2141e3a840f4529a210ac977ab79b03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:35Z,use_quota=True,user_id='f0f79757ff164ad6b5b69b378ec7e498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:49:35 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-26a0ed8b-6087-4dfd-8936-96add6eb9438 tempest-VolumeDependencyTests-1081417414 None] Creating volume d5203da2-d89a-4846-91e2-407b9be9dba1 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:49:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-26a0ed8b-6087-4dfd-8936-96add6eb9438 tempest-VolumeDependencyTests-1081417414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-26a0ed8b-6087-4dfd-8936-96add6eb9438 tempest-VolumeDependencyTests-1081417414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:35 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-26a0ed8b-6087-4dfd-8936-96add6eb9438 tempest-VolumeDependencyTests-1081417414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:49:35 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-26a0ed8b-6087-4dfd-8936-96add6eb9438 tempest-VolumeDependencyTests-1081417414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:49:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-26a0ed8b-6087-4dfd-8936-96add6eb9438 tempest-VolumeDependencyTests-1081417414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:35 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-26a0ed8b-6087-4dfd-8936-96add6eb9438 tempest-VolumeDependencyTests-1081417414 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:49:35 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-26a0ed8b-6087-4dfd-8936-96add6eb9438 tempest-VolumeDependencyTests-1081417414 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:49:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-26a0ed8b-6087-4dfd-8936-96add6eb9438 tempest-VolumeDependencyTests-1081417414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ee03f4af-f03c-4450-80a2-025b9b3d38d0 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-99e380f8-40c5-4d2b-b434-77396d3344af" returned: 0 in 0.594s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d0fc34ee-fbb0-4aac-a247-43aa04f75308 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e3793440-13fb-4609-a558-9bb77715ad6b" returned: 0 in 0.568s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ee03f4af-f03c-4450-80a2-025b9b3d38d0 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-99e380f8-40c5-4d2b-b434-77396d3344af {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:35 devstack sudo[104363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1 1073741824 Aug 28 09:49:35 devstack sudo[104363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:35 devstack sudo[104364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-99e380f8-40c5-4d2b-b434-77396d3344af Aug 28 09:49:35 devstack sudo[104364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:35 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-d0fc34ee-fbb0-4aac-a247-43aa04f75308 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Lock "cinder-quobyte-e3793440-13fb-4609-a558-9bb77715ad6b" released by "delete_volume" :: held 1.183s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:49:35 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-d0fc34ee-fbb0-4aac-a247-43aa04f75308 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Created reservations ['8394545b-228c-46bc-b737-c32da8b73514', '46926137-5393-4b5b-9b82-92ab563aadb3', '6ef09685-2ee5-40f5-90be-fdfccfb9f681', '479bd28f-6078-444d-adbd-fb7fd98c6d0f'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:49:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-d0fc34ee-fbb0-4aac-a247-43aa04f75308 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-d0fc34ee-fbb0-4aac-a247-43aa04f75308 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:35 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-d0fc34ee-fbb0-4aac-a247-43aa04f75308 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:49:35 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-d0fc34ee-fbb0-4aac-a247-43aa04f75308 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:49:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-d0fc34ee-fbb0-4aac-a247-43aa04f75308 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d0fc34ee-fbb0-4aac-a247-43aa04f75308 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:35 devstack sudo[104367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:49:35 devstack sudo[104367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:35 devstack sudo[104364]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ee03f4af-f03c-4450-80a2-025b9b3d38d0 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-99e380f8-40c5-4d2b-b434-77396d3344af" returned: 0 in 0.306s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:35 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ee03f4af-f03c-4450-80a2-025b9b3d38d0 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "cinder-quobyte-99e380f8-40c5-4d2b-b434-77396d3344af" released by "delete_volume" :: held 0.974s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:49:35 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-ee03f4af-f03c-4450-80a2-025b9b3d38d0 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Created reservations ['ee6d3a95-77c6-46b8-b902-644dc9c3dbed', 'ffb8af5c-1097-4816-adcd-198919667d4d', '698e8bd0-2c6c-47f9-b715-5cb7cca4badd', '55f6bc96-346a-41f5-b57f-239698e13361'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:49:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ee03f4af-f03c-4450-80a2-025b9b3d38d0 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ee03f4af-f03c-4450-80a2-025b9b3d38d0 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:35 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ee03f4af-f03c-4450-80a2-025b9b3d38d0 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:49:35 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ee03f4af-f03c-4450-80a2-025b9b3d38d0 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:49:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ee03f4af-f03c-4450-80a2-025b9b3d38d0 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ee03f4af-f03c-4450-80a2-025b9b3d38d0 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:35 devstack sudo[104367]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:35 devstack sudo[104375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:49:35 devstack sudo[104375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d0fc34ee-fbb0-4aac-a247-43aa04f75308 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.306s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:35 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-d0fc34ee-fbb0-4aac-a247-43aa04f75308 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:49:35 devstack sudo[104363]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:35 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-d0fc34ee-fbb0-4aac-a247-43aa04f75308 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Deleted volume successfully. Aug 28 09:49:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-26a0ed8b-6087-4dfd-8936-96add6eb9438 tempest-VolumeDependencyTests-1081417414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1 1073741824" returned: 0 in 0.540s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:35 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-d0fc34ee-fbb0-4aac-a247-43aa04f75308 tempest-VolumeAndVolumeTypeFromImageTest-1292409478 None] Lock "cinder-e3793440-13fb-4609-a558-9bb77715ad6b-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:49:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-26a0ed8b-6087-4dfd-8936-96add6eb9438 tempest-VolumeDependencyTests-1081417414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:35 devstack sudo[104377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1 Aug 28 09:49:35 devstack sudo[104377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:35 devstack sudo[104375]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ee03f4af-f03c-4450-80a2-025b9b3d38d0 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.287s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:35 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-ee03f4af-f03c-4450-80a2-025b9b3d38d0 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:49:36 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-ee03f4af-f03c-4450-80a2-025b9b3d38d0 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Deleted volume successfully. Aug 28 09:49:36 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ee03f4af-f03c-4450-80a2-025b9b3d38d0 tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "cinder-99e380f8-40c5-4d2b-b434-77396d3344af-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:49:36 devstack sudo[104377]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-26a0ed8b-6087-4dfd-8936-96add6eb9438 tempest-VolumeDependencyTests-1081417414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1" returned: 0 in 0.311s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:36 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-26a0ed8b-6087-4dfd-8936-96add6eb9438 tempest-VolumeDependencyTests-1081417414 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:49:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-26a0ed8b-6087-4dfd-8936-96add6eb9438 tempest-VolumeDependencyTests-1081417414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:36 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-26a0ed8b-6087-4dfd-8936-96add6eb9438 tempest-VolumeDependencyTests-1081417414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24037ce6-623b-433b-a75a-cff3f0d321a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5203da2-d89a-4846-91e2-407b9be9dba1', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:36 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-26a0ed8b-6087-4dfd-8936-96add6eb9438 tempest-VolumeDependencyTests-1081417414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63143bc1-c08f-4299-bfd7-b6afe7f0dfeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:36 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-26a0ed8b-6087-4dfd-8936-96add6eb9438 tempest-VolumeDependencyTests-1081417414 None] Volume volume-d5203da2-d89a-4846-91e2-407b9be9dba1 (d5203da2-d89a-4846-91e2-407b9be9dba1): created successfully Aug 28 09:49:36 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-26a0ed8b-6087-4dfd-8936-96add6eb9438 tempest-VolumeDependencyTests-1081417414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63143bc1-c08f-4299-bfd7-b6afe7f0dfeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:36 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-26a0ed8b-6087-4dfd-8936-96add6eb9438 tempest-VolumeDependencyTests-1081417414 None] Flow 'volume_create_manager' (7cecc237-93a7-41ba-ae35-de58e0a7184a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:49:36 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-26a0ed8b-6087-4dfd-8936-96add6eb9438 tempest-VolumeDependencyTests-1081417414 None] Created volume successfully. Aug 28 09:49:36 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4f87f75f-07d3-4ac5-a6bd-d463182d176f tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Acquiring lock "cinder-0499a056-b1f3-4564-af6f-41d1caddd697-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:49:36 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4f87f75f-07d3-4ac5-a6bd-d463182d176f tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "cinder-0499a056-b1f3-4564-af6f-41d1caddd697-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:49:36 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4f87f75f-07d3-4ac5-a6bd-d463182d176f tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Acquiring lock "cinder-quobyte-0499a056-b1f3-4564-af6f-41d1caddd697" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:49:36 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4f87f75f-07d3-4ac5-a6bd-d463182d176f tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "cinder-quobyte-0499a056-b1f3-4564-af6f-41d1caddd697" acquired by "delete_volume" :: waited 0.018s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:49:36 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf2e709-2baf-4883-ba3a-301ce6ad5c59]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:49:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4f87f75f-07d3-4ac5-a6bd-d463182d176f tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-0499a056-b1f3-4564-af6f-41d1caddd697 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:36 devstack sudo[104381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-0499a056-b1f3-4564-af6f-41d1caddd697 Aug 28 09:49:36 devstack sudo[104381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-bd0485c5-183a-4cff-bfe7-28e9e6553b31 tempest-VolumeDependencyTests-1081417414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-bd0485c5-183a-4cff-bfe7-28e9e6553b31 tempest-VolumeDependencyTests-1081417414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:37 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-bd0485c5-183a-4cff-bfe7-28e9e6553b31 tempest-VolumeDependencyTests-1081417414 None] Creating offline snapshot 61cd126a-17d2-4558-951c-e992d1c5449c of volume d5203da2-d89a-4846-91e2-407b9be9dba1 {{(pid=86081) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:49:37 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[404542eb-37ae-4e0e-a4d4-9b910cbd47c3]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:49:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bd0485c5-183a-4cff-bfe7-28e9e6553b31 tempest-VolumeDependencyTests-1081417414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:37 devstack sudo[104381]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4f87f75f-07d3-4ac5-a6bd-d463182d176f tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-0499a056-b1f3-4564-af6f-41d1caddd697" returned: 0 in 0.503s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4f87f75f-07d3-4ac5-a6bd-d463182d176f tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-0499a056-b1f3-4564-af6f-41d1caddd697 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:37 devstack sudo[104387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-0499a056-b1f3-4564-af6f-41d1caddd697 Aug 28 09:49:37 devstack sudo[104387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:37 devstack sudo[104386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1 Aug 28 09:49:37 devstack sudo[104386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:37 devstack sudo[104387]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4f87f75f-07d3-4ac5-a6bd-d463182d176f tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-0499a056-b1f3-4564-af6f-41d1caddd697" returned: 0 in 0.354s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:37 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4f87f75f-07d3-4ac5-a6bd-d463182d176f tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "cinder-quobyte-0499a056-b1f3-4564-af6f-41d1caddd697" released by "delete_volume" :: held 0.930s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:49:37 devstack sudo[104386]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bd0485c5-183a-4cff-bfe7-28e9e6553b31 tempest-VolumeDependencyTests-1081417414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1" returned: 0 in 0.492s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bd0485c5-183a-4cff-bfe7-28e9e6553b31 tempest-VolumeDependencyTests-1081417414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1.61cd126a-17d2-4558-951c-e992d1c5449c 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:37 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-4f87f75f-07d3-4ac5-a6bd-d463182d176f tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Created reservations ['94f28f15-09e0-4694-ba08-da49fa280cb0', '3726971a-a38f-47a4-9e31-25b40b171c8a', '36d6e5eb-c12c-423b-aea5-8dd79a31ad60', '296d0eaf-ee35-4b23-bf5e-273554be2b66'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:49:37 devstack sudo[104394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1.61cd126a-17d2-4558-951c-e992d1c5449c 1G Aug 28 09:49:37 devstack sudo[104394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-4f87f75f-07d3-4ac5-a6bd-d463182d176f tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-4f87f75f-07d3-4ac5-a6bd-d463182d176f tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:37 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-4f87f75f-07d3-4ac5-a6bd-d463182d176f tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:49:37 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-4f87f75f-07d3-4ac5-a6bd-d463182d176f tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:49:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-4f87f75f-07d3-4ac5-a6bd-d463182d176f tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4f87f75f-07d3-4ac5-a6bd-d463182d176f tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:37 devstack sudo[104396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:49:37 devstack sudo[104396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:38 devstack cinder-volume[86081]: DEBUG oslo_service.periodic_task [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86081) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:49:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:49:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:49:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:38 devstack sudo[104398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:49:38 devstack sudo[104398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:38 devstack sudo[104396]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4f87f75f-07d3-4ac5-a6bd-d463182d176f tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.354s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:38 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-4f87f75f-07d3-4ac5-a6bd-d463182d176f tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:49:38 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-4f87f75f-07d3-4ac5-a6bd-d463182d176f tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Deleted volume successfully. Aug 28 09:49:38 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4f87f75f-07d3-4ac5-a6bd-d463182d176f tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "cinder-0499a056-b1f3-4564-af6f-41d1caddd697-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:49:38 devstack sudo[104394]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bd0485c5-183a-4cff-bfe7-28e9e6553b31 tempest-VolumeDependencyTests-1081417414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1.61cd126a-17d2-4558-951c-e992d1c5449c 1G" returned: 0 in 0.665s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bd0485c5-183a-4cff-bfe7-28e9e6553b31 tempest-VolumeDependencyTests-1081417414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5203da2-d89a-4846-91e2-407b9be9dba1 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1.61cd126a-17d2-4558-951c-e992d1c5449c {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:38 devstack sudo[104398]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.378s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:38 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:49:38 devstack cinder-volume[86081]: DEBUG oslo_service.periodic_task [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running periodic task VolumeManager._thread_info {{(pid=86081) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:49:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] thread count: 28 {{(pid=86081) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 09:49:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] thread info: [<_MainThread(MainThread, started 129914189705344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86081) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 09:49:38 devstack sudo[104406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5203da2-d89a-4846-91e2-407b9be9dba1 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1.61cd126a-17d2-4558-951c-e992d1c5449c Aug 28 09:49:38 devstack sudo[104406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:38 devstack sudo[104406]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bd0485c5-183a-4cff-bfe7-28e9e6553b31 tempest-VolumeDependencyTests-1081417414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5203da2-d89a-4846-91e2-407b9be9dba1 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1.61cd126a-17d2-4558-951c-e992d1c5449c" returned: 0 in 0.328s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:38 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-bd0485c5-183a-4cff-bfe7-28e9e6553b31 tempest-VolumeDependencyTests-1081417414 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1.61cd126a-17d2-4558-951c-e992d1c5449c is being set with open permissions: ugo+rw Aug 28 09:49:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bd0485c5-183a-4cff-bfe7-28e9e6553b31 tempest-VolumeDependencyTests-1081417414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1.61cd126a-17d2-4558-951c-e992d1c5449c {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:38 devstack sudo[104412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1.61cd126a-17d2-4558-951c-e992d1c5449c Aug 28 09:49:38 devstack sudo[104412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:38 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-3f05f58b-2359-4c2d-9de8-989a859cbd0b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Acquiring lock "cinder-c744b2e7-9858-4a3a-87dc-7786d5f6f257-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:49:39 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-3f05f58b-2359-4c2d-9de8-989a859cbd0b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "cinder-c744b2e7-9858-4a3a-87dc-7786d5f6f257-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:49:39 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-3f05f58b-2359-4c2d-9de8-989a859cbd0b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Acquiring lock "cinder-quobyte-c744b2e7-9858-4a3a-87dc-7786d5f6f257" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:49:39 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-3f05f58b-2359-4c2d-9de8-989a859cbd0b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "cinder-quobyte-c744b2e7-9858-4a3a-87dc-7786d5f6f257" acquired by "delete_volume" :: waited 0.025s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:49:39 devstack sudo[104412]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bd0485c5-183a-4cff-bfe7-28e9e6553b31 tempest-VolumeDependencyTests-1081417414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1.61cd126a-17d2-4558-951c-e992d1c5449c" returned: 0 in 0.350s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:39 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e41a46-341f-42a1-ab34-c8d0b1f42ca9]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:49:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3f05f58b-2359-4c2d-9de8-989a859cbd0b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c744b2e7-9858-4a3a-87dc-7786d5f6f257 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bd0485c5-183a-4cff-bfe7-28e9e6553b31 tempest-VolumeDependencyTests-1081417414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:39 devstack sudo[104416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1.info Aug 28 09:49:39 devstack sudo[104416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:39 devstack sudo[104415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c744b2e7-9858-4a3a-87dc-7786d5f6f257 Aug 28 09:49:39 devstack sudo[104415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:39 devstack sudo[104416]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bd0485c5-183a-4cff-bfe7-28e9e6553b31 tempest-VolumeDependencyTests-1081417414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1.info" returned: 0 in 0.372s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:39 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-bd0485c5-183a-4cff-bfe7-28e9e6553b31 tempest-VolumeDependencyTests-1081417414 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1.info is being set with open permissions: ugo+rw Aug 28 09:49:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bd0485c5-183a-4cff-bfe7-28e9e6553b31 tempest-VolumeDependencyTests-1081417414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:39 devstack sudo[104415]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3f05f58b-2359-4c2d-9de8-989a859cbd0b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c744b2e7-9858-4a3a-87dc-7786d5f6f257" returned: 0 in 0.462s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3f05f58b-2359-4c2d-9de8-989a859cbd0b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c744b2e7-9858-4a3a-87dc-7786d5f6f257 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:39 devstack sudo[104424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1.info Aug 28 09:49:39 devstack sudo[104424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:39 devstack sudo[104426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c744b2e7-9858-4a3a-87dc-7786d5f6f257 Aug 28 09:49:39 devstack sudo[104426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:39 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-864ff29e-4179-4e72-af10-7a08d5272150 tempest-ProjectReaderTests-1007845069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:49:39 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-864ff29e-4179-4e72-af10-7a08d5272150 tempest-ProjectReaderTests-1007845069 None] Flow 'volume_create_manager' (d5905660-4217-42e9-88f6-d4c995cfe854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:49:39 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-864ff29e-4179-4e72-af10-7a08d5272150 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc0a818c-7387-40c5-855c-e212c42a45f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:39 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-864ff29e-4179-4e72-af10-7a08d5272150 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc0a818c-7387-40c5-855c-e212c42a45f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1720757851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82ed3939-e357-4c17-878e-9f8c5371bb5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0a1ea6b99c7413e9fb54892d96af172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:40Z,use_quota=True,user_id='40fe0546d5a249bcb1fd3247e64d4590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:39 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-864ff29e-4179-4e72-af10-7a08d5272150 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b16cbb8-b564-48e6-8da7-0874bb046234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:39 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-864ff29e-4179-4e72-af10-7a08d5272150 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b16cbb8-b564-48e6-8da7-0874bb046234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:39 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-864ff29e-4179-4e72-af10-7a08d5272150 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ddc6211-4806-488a-b25c-c65d7b1bf94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:39 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-864ff29e-4179-4e72-af10-7a08d5272150 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ddc6211-4806-488a-b25c-c65d7b1bf94b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82ed3939-e357-4c17-878e-9f8c5371bb5f', 'volume_name': 'volume-82ed3939-e357-4c17-878e-9f8c5371bb5f', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:39 devstack sudo[104424]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:39 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-864ff29e-4179-4e72-af10-7a08d5272150 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a2e8355-9b28-45ef-aa3f-25d5c5444e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:39 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-864ff29e-4179-4e72-af10-7a08d5272150 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a2e8355-9b28-45ef-aa3f-25d5c5444e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:39 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-864ff29e-4179-4e72-af10-7a08d5272150 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d48b59f-582d-4427-9715-eb5ae84a3af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:39 devstack sudo[104426]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:39 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-864ff29e-4179-4e72-af10-7a08d5272150 tempest-ProjectReaderTests-1007845069 None] Volume 82ed3939-e357-4c17-878e-9f8c5371bb5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82ed3939-e357-4c17-878e-9f8c5371bb5f', 'volume_size': 1} Aug 28 09:49:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-864ff29e-4179-4e72-af10-7a08d5272150 tempest-ProjectReaderTests-1007845069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bd0485c5-183a-4cff-bfe7-28e9e6553b31 tempest-VolumeDependencyTests-1081417414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1.info" returned: 0 in 0.377s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-bd0485c5-183a-4cff-bfe7-28e9e6553b31 tempest-VolumeDependencyTests-1081417414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.719s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3f05f58b-2359-4c2d-9de8-989a859cbd0b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c744b2e7-9858-4a3a-87dc-7786d5f6f257" returned: 0 in 0.360s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-864ff29e-4179-4e72-af10-7a08d5272150 tempest-ProjectReaderTests-1007845069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.028s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:39 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-864ff29e-4179-4e72-af10-7a08d5272150 tempest-ProjectReaderTests-1007845069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1720757851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82ed3939-e357-4c17-878e-9f8c5371bb5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0a1ea6b99c7413e9fb54892d96af172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:40Z,use_quota=True,user_id='40fe0546d5a249bcb1fd3247e64d4590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:49:39 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-864ff29e-4179-4e72-af10-7a08d5272150 tempest-ProjectReaderTests-1007845069 None] Creating volume 82ed3939-e357-4c17-878e-9f8c5371bb5f {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:49:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-864ff29e-4179-4e72-af10-7a08d5272150 tempest-ProjectReaderTests-1007845069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-864ff29e-4179-4e72-af10-7a08d5272150 tempest-ProjectReaderTests-1007845069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:39 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-864ff29e-4179-4e72-af10-7a08d5272150 tempest-ProjectReaderTests-1007845069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:49:39 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-864ff29e-4179-4e72-af10-7a08d5272150 tempest-ProjectReaderTests-1007845069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:49:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-864ff29e-4179-4e72-af10-7a08d5272150 tempest-ProjectReaderTests-1007845069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:39 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-864ff29e-4179-4e72-af10-7a08d5272150 tempest-ProjectReaderTests-1007845069 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:49:39 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-864ff29e-4179-4e72-af10-7a08d5272150 tempest-ProjectReaderTests-1007845069 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:49:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-864ff29e-4179-4e72-af10-7a08d5272150 tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-82ed3939-e357-4c17-878e-9f8c5371bb5f 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:40 devstack sudo[104430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-82ed3939-e357-4c17-878e-9f8c5371bb5f 1073741824 Aug 28 09:49:40 devstack sudo[104430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:40 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-3f05f58b-2359-4c2d-9de8-989a859cbd0b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "cinder-quobyte-c744b2e7-9858-4a3a-87dc-7786d5f6f257" released by "delete_volume" :: held 0.910s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:49:40 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-bd0485c5-183a-4cff-bfe7-28e9e6553b31 tempest-VolumeDependencyTests-1081417414 None] Create snapshot completed successfully Aug 28 09:49:40 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-3f05f58b-2359-4c2d-9de8-989a859cbd0b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Created reservations ['45839bc0-b517-4c51-97d0-f3d49f87b209', 'a8a31c8f-7c5b-4583-bcf2-c76272c815d6', 'b3ce01c2-d13d-4116-a8a5-a0a2b127e8d8', '1c94ad00-8f6f-41cc-96ca-fca7ce3db93f'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:49:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-3f05f58b-2359-4c2d-9de8-989a859cbd0b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-3f05f58b-2359-4c2d-9de8-989a859cbd0b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:40 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-3f05f58b-2359-4c2d-9de8-989a859cbd0b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:49:40 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-3f05f58b-2359-4c2d-9de8-989a859cbd0b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:49:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-3f05f58b-2359-4c2d-9de8-989a859cbd0b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3f05f58b-2359-4c2d-9de8-989a859cbd0b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:40 devstack sudo[104432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:49:40 devstack sudo[104432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:40 devstack sudo[104432]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3f05f58b-2359-4c2d-9de8-989a859cbd0b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.310s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:40 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-3f05f58b-2359-4c2d-9de8-989a859cbd0b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:49:40 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-3f05f58b-2359-4c2d-9de8-989a859cbd0b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Deleted volume successfully. Aug 28 09:49:40 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-3f05f58b-2359-4c2d-9de8-989a859cbd0b tempest-CreateVolumesFromSourceVolumeTest-1266975927 None] Lock "cinder-c744b2e7-9858-4a3a-87dc-7786d5f6f257-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:49:40 devstack sudo[104430]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-864ff29e-4179-4e72-af10-7a08d5272150 tempest-ProjectReaderTests-1007845069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-82ed3939-e357-4c17-878e-9f8c5371bb5f 1073741824" returned: 0 in 0.591s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-864ff29e-4179-4e72-af10-7a08d5272150 tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-82ed3939-e357-4c17-878e-9f8c5371bb5f {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:40 devstack sudo[104439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-82ed3939-e357-4c17-878e-9f8c5371bb5f Aug 28 09:49:40 devstack sudo[104439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:41 devstack sudo[104439]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-864ff29e-4179-4e72-af10-7a08d5272150 tempest-ProjectReaderTests-1007845069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-82ed3939-e357-4c17-878e-9f8c5371bb5f" returned: 0 in 0.485s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:41 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-864ff29e-4179-4e72-af10-7a08d5272150 tempest-ProjectReaderTests-1007845069 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:49:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-864ff29e-4179-4e72-af10-7a08d5272150 tempest-ProjectReaderTests-1007845069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:41 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-864ff29e-4179-4e72-af10-7a08d5272150 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d48b59f-582d-4427-9715-eb5ae84a3af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82ed3939-e357-4c17-878e-9f8c5371bb5f', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:41 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-864ff29e-4179-4e72-af10-7a08d5272150 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84fe9c06-7ef8-484b-be28-5cb0082a0d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:41 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-864ff29e-4179-4e72-af10-7a08d5272150 tempest-ProjectReaderTests-1007845069 None] Volume volume-82ed3939-e357-4c17-878e-9f8c5371bb5f (82ed3939-e357-4c17-878e-9f8c5371bb5f): created successfully Aug 28 09:49:41 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-864ff29e-4179-4e72-af10-7a08d5272150 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84fe9c06-7ef8-484b-be28-5cb0082a0d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:41 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-864ff29e-4179-4e72-af10-7a08d5272150 tempest-ProjectReaderTests-1007845069 None] Flow 'volume_create_manager' (d5905660-4217-42e9-88f6-d4c995cfe854) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:49:41 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-864ff29e-4179-4e72-af10-7a08d5272150 tempest-ProjectReaderTests-1007845069 None] Created volume successfully. Aug 28 09:49:41 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-67f96850-239f-4618-a484-a4847c1b6c99 tempest-VolumeDependencyTests-1081417414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:49:41 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-67f96850-239f-4618-a484-a4847c1b6c99 tempest-VolumeDependencyTests-1081417414 None] Flow 'volume_create_manager' (e0556e67-5f0a-4c24-8194-140b737897ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:49:41 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-67f96850-239f-4618-a484-a4847c1b6c99 tempest-VolumeDependencyTests-1081417414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f489573-cc9b-41ca-b010-1661ffba8a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:41 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-67f96850-239f-4618-a484-a4847c1b6c99 tempest-VolumeDependencyTests-1081417414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f489573-cc9b-41ca-b010-1661ffba8a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1157985522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63c3cfe1-10e2-40cc-8411-86f72995506e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2141e3a840f4529a210ac977ab79b03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=61cd126a-17d2-4558-951c-e992d1c5449c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:41Z,use_quota=True,user_id='f0f79757ff164ad6b5b69b378ec7e498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:41 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-67f96850-239f-4618-a484-a4847c1b6c99 tempest-VolumeDependencyTests-1081417414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (355d8d84-926d-4147-84ab-27a2aa97e638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:41 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-67f96850-239f-4618-a484-a4847c1b6c99 tempest-VolumeDependencyTests-1081417414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (355d8d84-926d-4147-84ab-27a2aa97e638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:41 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-67f96850-239f-4618-a484-a4847c1b6c99 tempest-VolumeDependencyTests-1081417414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (957a0965-2dda-4563-b3d8-8ad2862faf97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:41 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-67f96850-239f-4618-a484-a4847c1b6c99 tempest-VolumeDependencyTests-1081417414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (957a0965-2dda-4563-b3d8-8ad2862faf97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '63c3cfe1-10e2-40cc-8411-86f72995506e', 'volume_name': 'volume-63c3cfe1-10e2-40cc-8411-86f72995506e', 'volume_size': 1, 'snapshot_id': '61cd126a-17d2-4558-951c-e992d1c5449c'}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:41 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-67f96850-239f-4618-a484-a4847c1b6c99 tempest-VolumeDependencyTests-1081417414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59801de7-b3f0-46b4-8e0e-7c77950729ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:41 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-67f96850-239f-4618-a484-a4847c1b6c99 tempest-VolumeDependencyTests-1081417414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59801de7-b3f0-46b4-8e0e-7c77950729ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:41 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-67f96850-239f-4618-a484-a4847c1b6c99 tempest-VolumeDependencyTests-1081417414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a5692bc-d017-4167-b15e-051ab64d3f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:41 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-67f96850-239f-4618-a484-a4847c1b6c99 tempest-VolumeDependencyTests-1081417414 None] Volume 63c3cfe1-10e2-40cc-8411-86f72995506e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-63c3cfe1-10e2-40cc-8411-86f72995506e', 'volume_size': 1, 'snapshot_id': '61cd126a-17d2-4558-951c-e992d1c5449c'} Aug 28 09:49:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-67f96850-239f-4618-a484-a4847c1b6c99 tempest-VolumeDependencyTests-1081417414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-67f96850-239f-4618-a484-a4847c1b6c99 tempest-VolumeDependencyTests-1081417414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:41 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-67f96850-239f-4618-a484-a4847c1b6c99 tempest-VolumeDependencyTests-1081417414 None] Acquiring lock "cinder-quobyte-61cd126a-17d2-4558-951c-e992d1c5449c-63c3cfe1-10e2-40cc-8411-86f72995506e" by "_create_volume_from_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:49:41 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-67f96850-239f-4618-a484-a4847c1b6c99 tempest-VolumeDependencyTests-1081417414 None] Lock "cinder-quobyte-61cd126a-17d2-4558-951c-e992d1c5449c-63c3cfe1-10e2-40cc-8411-86f72995506e" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:49:41 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-67f96850-239f-4618-a484-a4847c1b6c99 tempest-VolumeDependencyTests-1081417414 None] Creating volume 63c3cfe1-10e2-40cc-8411-86f72995506e from snapshot 61cd126a-17d2-4558-951c-e992d1c5449c {{(pid=86081) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 28 09:49:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-67f96850-239f-4618-a484-a4847c1b6c99 tempest-VolumeDependencyTests-1081417414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-67f96850-239f-4618-a484-a4847c1b6c99 tempest-VolumeDependencyTests-1081417414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:41 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-67f96850-239f-4618-a484-a4847c1b6c99 tempest-VolumeDependencyTests-1081417414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:49:41 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-67f96850-239f-4618-a484-a4847c1b6c99 tempest-VolumeDependencyTests-1081417414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:49:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-67f96850-239f-4618-a484-a4847c1b6c99 tempest-VolumeDependencyTests-1081417414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:41 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-67f96850-239f-4618-a484-a4847c1b6c99 tempest-VolumeDependencyTests-1081417414 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:49:41 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-67f96850-239f-4618-a484-a4847c1b6c99 tempest-VolumeDependencyTests-1081417414 None] Acquiring lock "cinder-quobyte-63c3cfe1-10e2-40cc-8411-86f72995506e" by "_copy_volume_from_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:49:41 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-67f96850-239f-4618-a484-a4847c1b6c99 tempest-VolumeDependencyTests-1081417414 None] Lock "cinder-quobyte-63c3cfe1-10e2-40cc-8411-86f72995506e" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:49:41 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-67f96850-239f-4618-a484-a4847c1b6c99 tempest-VolumeDependencyTests-1081417414 None] snapshot: 61cd126a-17d2-4558-951c-e992d1c5449c, volume: 63c3cfe1-10e2-40cc-8411-86f72995506e, {{(pid=86081) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 28 09:49:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-67f96850-239f-4618-a484-a4847c1b6c99 tempest-VolumeDependencyTests-1081417414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-67f96850-239f-4618-a484-a4847c1b6c99 tempest-VolumeDependencyTests-1081417414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:41 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-67f96850-239f-4618-a484-a4847c1b6c99 tempest-VolumeDependencyTests-1081417414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:49:41 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-67f96850-239f-4618-a484-a4847c1b6c99 tempest-VolumeDependencyTests-1081417414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:49:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-67f96850-239f-4618-a484-a4847c1b6c99 tempest-VolumeDependencyTests-1081417414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:41 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f29701-9e96-44de-8bb9-52869cdaab76]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:49:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-67f96850-239f-4618-a484-a4847c1b6c99 tempest-VolumeDependencyTests-1081417414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1.61cd126a-17d2-4558-951c-e992d1c5449c {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:41 devstack sudo[104444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1.61cd126a-17d2-4558-951c-e992d1c5449c Aug 28 09:49:41 devstack sudo[104444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:41 devstack sudo[104444]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-67f96850-239f-4618-a484-a4847c1b6c99 tempest-VolumeDependencyTests-1081417414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1.61cd126a-17d2-4558-951c-e992d1c5449c" returned: 0 in 0.417s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:41 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-67f96850-239f-4618-a484-a4847c1b6c99 tempest-VolumeDependencyTests-1081417414 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5203da2-d89a-4846-91e2-407b9be9dba1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:49:41 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[3755e4e6-f759-4dde-8105-28ec3acf9131]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:49:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-67f96850-239f-4618-a484-a4847c1b6c99 tempest-VolumeDependencyTests-1081417414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:42 devstack sudo[104449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1 Aug 28 09:49:42 devstack sudo[104449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:42 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-c541762a-f573-43f9-a40e-0f6d7e78ed9c tempest-ProjectReaderTests-1007845069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:42 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-e947f31a-8d3f-44e6-8395-e0c726e3e39f tempest-CreateVolumesFromSnapshotTest-1117622518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:49:42 devstack sudo[104449]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:42 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e947f31a-8d3f-44e6-8395-e0c726e3e39f tempest-CreateVolumesFromSnapshotTest-1117622518 None] Flow 'volume_create_manager' (874d5a70-1f8f-424c-b08d-04bc56312c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:49:42 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e947f31a-8d3f-44e6-8395-e0c726e3e39f tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e44e5492-3dd4-4a05-a7a5-dccbee124bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:42 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-67f96850-239f-4618-a484-a4847c1b6c99 tempest-VolumeDependencyTests-1081417414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1" returned: 0 in 0.496s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:42 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-67f96850-239f-4618-a484-a4847c1b6c99 tempest-VolumeDependencyTests-1081417414 None] will copy from snapshot at /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1 {{(pid=86081) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 28 09:49:42 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-67f96850-239f-4618-a484-a4847c1b6c99 tempest-VolumeDependencyTests-1081417414 None] Creating direct copy from snapshot {{(pid=86081) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 28 09:49:42 devstack cinder-volume[86081]: DEBUG cinder.utils [None req-67f96850-239f-4618-a484-a4847c1b6c99 tempest-VolumeDependencyTests-1081417414 None] Path /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-63c3cfe1-10e2-40cc-8411-86f72995506e not found in is_blk_device check {{(pid=86081) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 28 09:49:42 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-67f96850-239f-4618-a484-a4847c1b6c99 tempest-VolumeDependencyTests-1081417414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-63c3cfe1-10e2-40cc-8411-86f72995506e {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:42 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e947f31a-8d3f-44e6-8395-e0c726e3e39f tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e44e5492-3dd4-4a05-a7a5-dccbee124bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1307798673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=464f3f82-06e2-4d2f-a459-aa86c9e0d4f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aae33908983746b98ccde3d1e66e9f74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:42Z,use_quota=True,user_id='19b3519d9ca64c3cb159fe37ee6267f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:42 devstack sudo[104454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-63c3cfe1-10e2-40cc-8411-86f72995506e Aug 28 09:49:42 devstack sudo[104454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:42 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e947f31a-8d3f-44e6-8395-e0c726e3e39f tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e845ba4-cfde-497f-a78d-99aa5eb8cab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:42 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e947f31a-8d3f-44e6-8395-e0c726e3e39f tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e845ba4-cfde-497f-a78d-99aa5eb8cab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:42 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e947f31a-8d3f-44e6-8395-e0c726e3e39f tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36592519-1946-4160-9403-80177858876c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:42 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e947f31a-8d3f-44e6-8395-e0c726e3e39f tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36592519-1946-4160-9403-80177858876c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '464f3f82-06e2-4d2f-a459-aa86c9e0d4f9', 'volume_name': 'volume-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:42 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e947f31a-8d3f-44e6-8395-e0c726e3e39f tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c34d3354-5831-49f7-9763-46dedfb92162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:42 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e947f31a-8d3f-44e6-8395-e0c726e3e39f tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c34d3354-5831-49f7-9763-46dedfb92162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:42 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e947f31a-8d3f-44e6-8395-e0c726e3e39f tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcd125bc-a220-4f15-8854-eb9ed3ec7e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:42 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-e947f31a-8d3f-44e6-8395-e0c726e3e39f tempest-CreateVolumesFromSnapshotTest-1117622518 None] Volume 464f3f82-06e2-4d2f-a459-aa86c9e0d4f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9', 'volume_size': 1} Aug 28 09:49:42 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e947f31a-8d3f-44e6-8395-e0c726e3e39f tempest-CreateVolumesFromSnapshotTest-1117622518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:45 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a5da8cf7-19e5-42f7-b1be-bc674320d711 tempest-ProjectAdminTests-78397866 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.6184768676758, 'free_capacity_gb': 1774.6184768676758, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86081) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 28 09:49:47 devstack sudo[104454]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-67f96850-239f-4618-a484-a4847c1b6c99 tempest-VolumeDependencyTests-1081417414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-63c3cfe1-10e2-40cc-8411-86f72995506e" returned: 0 in 4.825s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:47 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-67f96850-239f-4618-a484-a4847c1b6c99 tempest-VolumeDependencyTests-1081417414 None] Image conversion details: src /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1, size 1024.00 MB, duration 4.83 sec, destination /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-63c3cfe1-10e2-40cc-8411-86f72995506e {{(pid=86081) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 09:49:47 devstack cinder-volume[86081]: INFO cinder.image.image_utils [None req-67f96850-239f-4618-a484-a4847c1b6c99 tempest-VolumeDependencyTests-1081417414 None] Converted 1024.00 MB image at 212.20 MB/s Aug 28 09:49:47 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-67f96850-239f-4618-a484-a4847c1b6c99 tempest-VolumeDependencyTests-1081417414 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-63c3cfe1-10e2-40cc-8411-86f72995506e is being set with open permissions: ugo+rw Aug 28 09:49:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-67f96850-239f-4618-a484-a4847c1b6c99 tempest-VolumeDependencyTests-1081417414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-63c3cfe1-10e2-40cc-8411-86f72995506e {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:47 devstack sudo[104468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-63c3cfe1-10e2-40cc-8411-86f72995506e Aug 28 09:49:47 devstack sudo[104468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:47 devstack sudo[104468]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-67f96850-239f-4618-a484-a4847c1b6c99 tempest-VolumeDependencyTests-1081417414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-63c3cfe1-10e2-40cc-8411-86f72995506e" returned: 0 in 0.259s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:47 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-67f96850-239f-4618-a484-a4847c1b6c99 tempest-VolumeDependencyTests-1081417414 None] Lock "cinder-quobyte-63c3cfe1-10e2-40cc-8411-86f72995506e" released by "_copy_volume_from_snapshot" :: held 6.104s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:49:47 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-67f96850-239f-4618-a484-a4847c1b6c99 tempest-VolumeDependencyTests-1081417414 None] Lock "cinder-quobyte-61cd126a-17d2-4558-951c-e992d1c5449c-63c3cfe1-10e2-40cc-8411-86f72995506e" released by "_create_volume_from_snapshot" :: held 6.179s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:49:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-67f96850-239f-4618-a484-a4847c1b6c99 tempest-VolumeDependencyTests-1081417414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.195s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-c541762a-f573-43f9-a40e-0f6d7e78ed9c tempest-ProjectReaderTests-1007845069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.212s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:47 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-c541762a-f573-43f9-a40e-0f6d7e78ed9c tempest-ProjectReaderTests-1007845069 None] Creating offline snapshot 5bf1abd5-e899-45d7-a98e-d058e9e256bc of volume 82ed3939-e357-4c17-878e-9f8c5371bb5f {{(pid=86081) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:49:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-67f96850-239f-4618-a484-a4847c1b6c99 tempest-VolumeDependencyTests-1081417414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a5692bc-d017-4167-b15e-051ab64d3f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63c3cfe1-10e2-40cc-8411-86f72995506e', 'volume_size': 1, 'snapshot_id': '61cd126a-17d2-4558-951c-e992d1c5449c'}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-67f96850-239f-4618-a484-a4847c1b6c99 tempest-VolumeDependencyTests-1081417414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a04251ce-e960-4c44-926d-4056a6d3d7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:47 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[9660e688-14da-4fb8-8640-c7a3cec074f8]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:49:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c541762a-f573-43f9-a40e-0f6d7e78ed9c tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-82ed3939-e357-4c17-878e-9f8c5371bb5f {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:47 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-67f96850-239f-4618-a484-a4847c1b6c99 tempest-VolumeDependencyTests-1081417414 None] Volume volume-63c3cfe1-10e2-40cc-8411-86f72995506e (63c3cfe1-10e2-40cc-8411-86f72995506e): created successfully Aug 28 09:49:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-67f96850-239f-4618-a484-a4847c1b6c99 tempest-VolumeDependencyTests-1081417414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a04251ce-e960-4c44-926d-4056a6d3d7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:47 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-67f96850-239f-4618-a484-a4847c1b6c99 tempest-VolumeDependencyTests-1081417414 None] Flow 'volume_create_manager' (e0556e67-5f0a-4c24-8194-140b737897ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:49:47 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-67f96850-239f-4618-a484-a4847c1b6c99 tempest-VolumeDependencyTests-1081417414 None] Created volume successfully. Aug 28 09:49:47 devstack sudo[104471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-82ed3939-e357-4c17-878e-9f8c5371bb5f Aug 28 09:49:47 devstack sudo[104471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:48 devstack sudo[104471]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:48 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e1e7cc2c-d846-4e2c-bf8f-bf628579d2c9 tempest-VolumeDependencyTests-1081417414 None] Acquiring lock "cinder-61cd126a-17d2-4558-951c-e992d1c5449c-delete_snapshot" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:49:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c541762a-f573-43f9-a40e-0f6d7e78ed9c tempest-ProjectReaderTests-1007845069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-82ed3939-e357-4c17-878e-9f8c5371bb5f" returned: 0 in 0.439s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c541762a-f573-43f9-a40e-0f6d7e78ed9c tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-82ed3939-e357-4c17-878e-9f8c5371bb5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-82ed3939-e357-4c17-878e-9f8c5371bb5f.5bf1abd5-e899-45d7-a98e-d058e9e256bc 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:48 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e1e7cc2c-d846-4e2c-bf8f-bf628579d2c9 tempest-VolumeDependencyTests-1081417414 None] Lock "cinder-61cd126a-17d2-4558-951c-e992d1c5449c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:49:48 devstack sudo[104477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-82ed3939-e357-4c17-878e-9f8c5371bb5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-82ed3939-e357-4c17-878e-9f8c5371bb5f.5bf1abd5-e899-45d7-a98e-d058e9e256bc 1G Aug 28 09:49:48 devstack sudo[104477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:48 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e1e7cc2c-d846-4e2c-bf8f-bf628579d2c9 tempest-VolumeDependencyTests-1081417414 None] Acquiring lock "cinder-quobyte-d5203da2-d89a-4846-91e2-407b9be9dba1" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:49:48 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e1e7cc2c-d846-4e2c-bf8f-bf628579d2c9 tempest-VolumeDependencyTests-1081417414 None] Lock "cinder-quobyte-d5203da2-d89a-4846-91e2-407b9be9dba1" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:49:48 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e1e7cc2c-d846-4e2c-bf8f-bf628579d2c9 tempest-VolumeDependencyTests-1081417414 None] Acquiring lock "cinder-quobyte-61cd126a-17d2-4558-951c-e992d1c5449c" by "_delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:49:48 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e1e7cc2c-d846-4e2c-bf8f-bf628579d2c9 tempest-VolumeDependencyTests-1081417414 None] Lock "cinder-quobyte-61cd126a-17d2-4558-951c-e992d1c5449c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:49:48 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-e1e7cc2c-d846-4e2c-bf8f-bf628579d2c9 tempest-VolumeDependencyTests-1081417414 None] Deleting offline snapshot 61cd126a-17d2-4558-951c-e992d1c5449c of volume d5203da2-d89a-4846-91e2-407b9be9dba1 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:49:48 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-e1e7cc2c-d846-4e2c-bf8f-bf628579d2c9 tempest-VolumeDependencyTests-1081417414 None] snapshot_file for this snap is: volume-d5203da2-d89a-4846-91e2-407b9be9dba1.61cd126a-17d2-4558-951c-e992d1c5449c {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:49:48 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c79e99-a935-42f0-b79f-ed5a08413212]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:49:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e1e7cc2c-d846-4e2c-bf8f-bf628579d2c9 tempest-VolumeDependencyTests-1081417414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1.61cd126a-17d2-4558-951c-e992d1c5449c {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:48 devstack sudo[104479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1.61cd126a-17d2-4558-951c-e992d1c5449c Aug 28 09:49:48 devstack sudo[104479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:48 devstack sudo[104477]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c541762a-f573-43f9-a40e-0f6d7e78ed9c tempest-ProjectReaderTests-1007845069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-82ed3939-e357-4c17-878e-9f8c5371bb5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-82ed3939-e357-4c17-878e-9f8c5371bb5f.5bf1abd5-e899-45d7-a98e-d058e9e256bc 1G" returned: 0 in 0.457s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c541762a-f573-43f9-a40e-0f6d7e78ed9c tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82ed3939-e357-4c17-878e-9f8c5371bb5f -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-82ed3939-e357-4c17-878e-9f8c5371bb5f.5bf1abd5-e899-45d7-a98e-d058e9e256bc {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:48 devstack sudo[104486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82ed3939-e357-4c17-878e-9f8c5371bb5f -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-82ed3939-e357-4c17-878e-9f8c5371bb5f.5bf1abd5-e899-45d7-a98e-d058e9e256bc Aug 28 09:49:48 devstack sudo[104486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:48 devstack sudo[104479]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e1e7cc2c-d846-4e2c-bf8f-bf628579d2c9 tempest-VolumeDependencyTests-1081417414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1.61cd126a-17d2-4558-951c-e992d1c5449c" returned: 0 in 0.428s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:48 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-e1e7cc2c-d846-4e2c-bf8f-bf628579d2c9 tempest-VolumeDependencyTests-1081417414 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5203da2-d89a-4846-91e2-407b9be9dba1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:49:48 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da6567e-f22c-4a58-b46c-79708e8862d1]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:49:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e1e7cc2c-d846-4e2c-bf8f-bf628579d2c9 tempest-VolumeDependencyTests-1081417414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:48 devstack sudo[104489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1 Aug 28 09:49:48 devstack sudo[104489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:48 devstack sudo[104486]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c541762a-f573-43f9-a40e-0f6d7e78ed9c tempest-ProjectReaderTests-1007845069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82ed3939-e357-4c17-878e-9f8c5371bb5f -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-82ed3939-e357-4c17-878e-9f8c5371bb5f.5bf1abd5-e899-45d7-a98e-d058e9e256bc" returned: 0 in 0.336s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:48 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-c541762a-f573-43f9-a40e-0f6d7e78ed9c tempest-ProjectReaderTests-1007845069 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-82ed3939-e357-4c17-878e-9f8c5371bb5f.5bf1abd5-e899-45d7-a98e-d058e9e256bc is being set with open permissions: ugo+rw Aug 28 09:49:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c541762a-f573-43f9-a40e-0f6d7e78ed9c tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-82ed3939-e357-4c17-878e-9f8c5371bb5f.5bf1abd5-e899-45d7-a98e-d058e9e256bc {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:48 devstack sudo[104494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-82ed3939-e357-4c17-878e-9f8c5371bb5f.5bf1abd5-e899-45d7-a98e-d058e9e256bc Aug 28 09:49:48 devstack sudo[104494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:49 devstack sudo[104494]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c541762a-f573-43f9-a40e-0f6d7e78ed9c tempest-ProjectReaderTests-1007845069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-82ed3939-e357-4c17-878e-9f8c5371bb5f.5bf1abd5-e899-45d7-a98e-d058e9e256bc" returned: 0 in 0.277s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c541762a-f573-43f9-a40e-0f6d7e78ed9c tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-82ed3939-e357-4c17-878e-9f8c5371bb5f.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:49 devstack sudo[104499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-82ed3939-e357-4c17-878e-9f8c5371bb5f.info Aug 28 09:49:49 devstack sudo[104499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:49 devstack sudo[104489]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e1e7cc2c-d846-4e2c-bf8f-bf628579d2c9 tempest-VolumeDependencyTests-1081417414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1" returned: 0 in 0.593s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e1e7cc2c-d846-4e2c-bf8f-bf628579d2c9 tempest-VolumeDependencyTests-1081417414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1.61cd126a-17d2-4558-951c-e992d1c5449c {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:49 devstack sudo[104502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1.61cd126a-17d2-4558-951c-e992d1c5449c Aug 28 09:49:49 devstack sudo[104502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:49 devstack sudo[104499]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c541762a-f573-43f9-a40e-0f6d7e78ed9c tempest-ProjectReaderTests-1007845069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-82ed3939-e357-4c17-878e-9f8c5371bb5f.info" returned: 0 in 0.279s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:49 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-c541762a-f573-43f9-a40e-0f6d7e78ed9c tempest-ProjectReaderTests-1007845069 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-82ed3939-e357-4c17-878e-9f8c5371bb5f.info is being set with open permissions: ugo+rw Aug 28 09:49:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c541762a-f573-43f9-a40e-0f6d7e78ed9c tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-82ed3939-e357-4c17-878e-9f8c5371bb5f.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:49 devstack sudo[104506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-82ed3939-e357-4c17-878e-9f8c5371bb5f.info Aug 28 09:49:49 devstack sudo[104506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:49 devstack sudo[104502]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e1e7cc2c-d846-4e2c-bf8f-bf628579d2c9 tempest-VolumeDependencyTests-1081417414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1.61cd126a-17d2-4558-951c-e992d1c5449c" returned: 0 in 0.374s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e1e7cc2c-d846-4e2c-bf8f-bf628579d2c9 tempest-VolumeDependencyTests-1081417414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1.61cd126a-17d2-4558-951c-e992d1c5449c {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:49 devstack sudo[104512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1.61cd126a-17d2-4558-951c-e992d1c5449c Aug 28 09:49:49 devstack sudo[104512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:49 devstack sudo[104506]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c541762a-f573-43f9-a40e-0f6d7e78ed9c tempest-ProjectReaderTests-1007845069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-82ed3939-e357-4c17-878e-9f8c5371bb5f.info" returned: 0 in 0.265s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-c541762a-f573-43f9-a40e-0f6d7e78ed9c tempest-ProjectReaderTests-1007845069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.155s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e947f31a-8d3f-44e6-8395-e0c726e3e39f tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.243s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:49 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e947f31a-8d3f-44e6-8395-e0c726e3e39f tempest-CreateVolumesFromSnapshotTest-1117622518 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1307798673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=464f3f82-06e2-4d2f-a459-aa86c9e0d4f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aae33908983746b98ccde3d1e66e9f74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:42Z,use_quota=True,user_id='19b3519d9ca64c3cb159fe37ee6267f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:49:49 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-e947f31a-8d3f-44e6-8395-e0c726e3e39f tempest-CreateVolumesFromSnapshotTest-1117622518 None] Creating volume 464f3f82-06e2-4d2f-a459-aa86c9e0d4f9 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:49:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e947f31a-8d3f-44e6-8395-e0c726e3e39f tempest-CreateVolumesFromSnapshotTest-1117622518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e947f31a-8d3f-44e6-8395-e0c726e3e39f tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:49 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e947f31a-8d3f-44e6-8395-e0c726e3e39f tempest-CreateVolumesFromSnapshotTest-1117622518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:49:49 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e947f31a-8d3f-44e6-8395-e0c726e3e39f tempest-CreateVolumesFromSnapshotTest-1117622518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:49:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e947f31a-8d3f-44e6-8395-e0c726e3e39f tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:49 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e947f31a-8d3f-44e6-8395-e0c726e3e39f tempest-CreateVolumesFromSnapshotTest-1117622518 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:49:49 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-e947f31a-8d3f-44e6-8395-e0c726e3e39f tempest-CreateVolumesFromSnapshotTest-1117622518 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:49:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e947f31a-8d3f-44e6-8395-e0c726e3e39f tempest-CreateVolumesFromSnapshotTest-1117622518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:49 devstack sudo[104515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9 1073741824 Aug 28 09:49:49 devstack sudo[104515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:49 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-c541762a-f573-43f9-a40e-0f6d7e78ed9c tempest-ProjectReaderTests-1007845069 None] Create snapshot completed successfully Aug 28 09:49:49 devstack sudo[104512]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e1e7cc2c-d846-4e2c-bf8f-bf628579d2c9 tempest-VolumeDependencyTests-1081417414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1.61cd126a-17d2-4558-951c-e992d1c5449c" returned: 0 in 0.266s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:49 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e1e7cc2c-d846-4e2c-bf8f-bf628579d2c9 tempest-VolumeDependencyTests-1081417414 None] Lock "cinder-quobyte-61cd126a-17d2-4558-951c-e992d1c5449c" released by "_delete_snapshot" :: held 1.784s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:49:49 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e1e7cc2c-d846-4e2c-bf8f-bf628579d2c9 tempest-VolumeDependencyTests-1081417414 None] Lock "cinder-quobyte-d5203da2-d89a-4846-91e2-407b9be9dba1" released by "delete_snapshot" :: held 1.813s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:49:50 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-e1e7cc2c-d846-4e2c-bf8f-bf628579d2c9 tempest-VolumeDependencyTests-1081417414 None] Created reservations ['0b78c3b9-4bd8-4adf-9191-e187a0258b33', 'f7d8df1e-0612-43ea-ab95-910cbaa89ff5', 'da0219cf-30fd-41ce-a71a-cdaf84666a9e', '61f689da-0de2-49a3-89b1-ff92189d106f'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:49:50 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-e1e7cc2c-d846-4e2c-bf8f-bf628579d2c9 tempest-VolumeDependencyTests-1081417414 None] Delete snapshot completed successfully. Aug 28 09:49:50 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e1e7cc2c-d846-4e2c-bf8f-bf628579d2c9 tempest-VolumeDependencyTests-1081417414 None] Lock "cinder-61cd126a-17d2-4558-951c-e992d1c5449c-delete_snapshot" released by "delete_snapshot" :: held 1.981s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:49:50 devstack sudo[104515]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e947f31a-8d3f-44e6-8395-e0c726e3e39f tempest-CreateVolumesFromSnapshotTest-1117622518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9 1073741824" returned: 0 in 0.466s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:50 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6461dca4-083d-4724-8356-0fce0186fc03 tempest-VolumeDependencyTests-1081417414 None] Acquiring lock "cinder-d5203da2-d89a-4846-91e2-407b9be9dba1-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:49:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e947f31a-8d3f-44e6-8395-e0c726e3e39f tempest-CreateVolumesFromSnapshotTest-1117622518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:50 devstack sudo[104521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9 Aug 28 09:49:50 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6461dca4-083d-4724-8356-0fce0186fc03 tempest-VolumeDependencyTests-1081417414 None] Lock "cinder-d5203da2-d89a-4846-91e2-407b9be9dba1-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:49:50 devstack sudo[104521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:50 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6461dca4-083d-4724-8356-0fce0186fc03 tempest-VolumeDependencyTests-1081417414 None] Acquiring lock "cinder-quobyte-d5203da2-d89a-4846-91e2-407b9be9dba1" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:49:50 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6461dca4-083d-4724-8356-0fce0186fc03 tempest-VolumeDependencyTests-1081417414 None] Lock "cinder-quobyte-d5203da2-d89a-4846-91e2-407b9be9dba1" acquired by "delete_volume" :: waited 0.018s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:49:50 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[747c9601-5b9b-4769-a698-6e709f120cef]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:49:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6461dca4-083d-4724-8356-0fce0186fc03 tempest-VolumeDependencyTests-1081417414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:50 devstack sudo[104523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1 Aug 28 09:49:50 devstack sudo[104523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:50 devstack sudo[104521]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e947f31a-8d3f-44e6-8395-e0c726e3e39f tempest-CreateVolumesFromSnapshotTest-1117622518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9" returned: 0 in 0.288s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:50 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e947f31a-8d3f-44e6-8395-e0c726e3e39f tempest-CreateVolumesFromSnapshotTest-1117622518 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:49:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e947f31a-8d3f-44e6-8395-e0c726e3e39f tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:50 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e947f31a-8d3f-44e6-8395-e0c726e3e39f tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcd125bc-a220-4f15-8854-eb9ed3ec7e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:50 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e947f31a-8d3f-44e6-8395-e0c726e3e39f tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4342a232-4238-48a1-aca5-f602e2a8290d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:50 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-e947f31a-8d3f-44e6-8395-e0c726e3e39f tempest-CreateVolumesFromSnapshotTest-1117622518 None] Volume volume-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9 (464f3f82-06e2-4d2f-a459-aa86c9e0d4f9): created successfully Aug 28 09:49:50 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e947f31a-8d3f-44e6-8395-e0c726e3e39f tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4342a232-4238-48a1-aca5-f602e2a8290d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:50 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-e947f31a-8d3f-44e6-8395-e0c726e3e39f tempest-CreateVolumesFromSnapshotTest-1117622518 None] Flow 'volume_create_manager' (874d5a70-1f8f-424c-b08d-04bc56312c35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:49:50 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-e947f31a-8d3f-44e6-8395-e0c726e3e39f tempest-CreateVolumesFromSnapshotTest-1117622518 None] Created volume successfully. Aug 28 09:49:50 devstack sudo[104523]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6461dca4-083d-4724-8356-0fce0186fc03 tempest-VolumeDependencyTests-1081417414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1" returned: 0 in 0.436s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6461dca4-083d-4724-8356-0fce0186fc03 tempest-VolumeDependencyTests-1081417414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:50 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-722c32e6-663d-44f4-8538-974005e198ce tempest-ProjectReaderTests-617012472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:49:50 devstack sudo[104529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1 Aug 28 09:49:50 devstack sudo[104529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:50 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-722c32e6-663d-44f4-8538-974005e198ce tempest-ProjectReaderTests-617012472 None] Flow 'volume_create_manager' (46d62b6b-c5cd-4cbd-ab21-7001984e507a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:49:50 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-722c32e6-663d-44f4-8538-974005e198ce tempest-ProjectReaderTests-617012472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b337d3d-fa20-4f91-8f17-5d1d712e2118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:50 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-722c32e6-663d-44f4-8538-974005e198ce tempest-ProjectReaderTests-617012472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b337d3d-fa20-4f91-8f17-5d1d712e2118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-393385840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a259f87-f156-4daf-a751-841fd2f976c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a17af17478e4c5da3a44644c27a625e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:51Z,use_quota=True,user_id='2ba337b9bf0e4eb8bcaa95493081e2f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:50 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-722c32e6-663d-44f4-8538-974005e198ce tempest-ProjectReaderTests-617012472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (195ae9c2-b035-4adb-bb6b-bbfe682129db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:50 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-722c32e6-663d-44f4-8538-974005e198ce tempest-ProjectReaderTests-617012472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (195ae9c2-b035-4adb-bb6b-bbfe682129db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:50 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-722c32e6-663d-44f4-8538-974005e198ce tempest-ProjectReaderTests-617012472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf311185-3916-4a8e-ad12-1fcebac6a2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:50 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-722c32e6-663d-44f4-8538-974005e198ce tempest-ProjectReaderTests-617012472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf311185-3916-4a8e-ad12-1fcebac6a2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a259f87-f156-4daf-a751-841fd2f976c1', 'volume_name': 'volume-2a259f87-f156-4daf-a751-841fd2f976c1', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:50 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-722c32e6-663d-44f4-8538-974005e198ce tempest-ProjectReaderTests-617012472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d4b0fdb-cd87-4f9c-925d-0ab68d64803c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:50 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-722c32e6-663d-44f4-8538-974005e198ce tempest-ProjectReaderTests-617012472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d4b0fdb-cd87-4f9c-925d-0ab68d64803c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:50 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-722c32e6-663d-44f4-8538-974005e198ce tempest-ProjectReaderTests-617012472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30133735-581b-47b4-a8e3-9ba1be27ceee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:50 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-722c32e6-663d-44f4-8538-974005e198ce tempest-ProjectReaderTests-617012472 None] Volume 2a259f87-f156-4daf-a751-841fd2f976c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a259f87-f156-4daf-a751-841fd2f976c1', 'volume_size': 1} Aug 28 09:49:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-722c32e6-663d-44f4-8538-974005e198ce tempest-ProjectReaderTests-617012472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-722c32e6-663d-44f4-8538-974005e198ce tempest-ProjectReaderTests-617012472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:50 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-722c32e6-663d-44f4-8538-974005e198ce tempest-ProjectReaderTests-617012472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-393385840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a259f87-f156-4daf-a751-841fd2f976c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a17af17478e4c5da3a44644c27a625e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:51Z,use_quota=True,user_id='2ba337b9bf0e4eb8bcaa95493081e2f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:49:50 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-722c32e6-663d-44f4-8538-974005e198ce tempest-ProjectReaderTests-617012472 None] Creating volume 2a259f87-f156-4daf-a751-841fd2f976c1 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:49:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-722c32e6-663d-44f4-8538-974005e198ce tempest-ProjectReaderTests-617012472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-722c32e6-663d-44f4-8538-974005e198ce tempest-ProjectReaderTests-617012472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:50 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-722c32e6-663d-44f4-8538-974005e198ce tempest-ProjectReaderTests-617012472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:49:50 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-722c32e6-663d-44f4-8538-974005e198ce tempest-ProjectReaderTests-617012472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:49:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-722c32e6-663d-44f4-8538-974005e198ce tempest-ProjectReaderTests-617012472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:50 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-722c32e6-663d-44f4-8538-974005e198ce tempest-ProjectReaderTests-617012472 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:49:50 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-722c32e6-663d-44f4-8538-974005e198ce tempest-ProjectReaderTests-617012472 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:49:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-722c32e6-663d-44f4-8538-974005e198ce tempest-ProjectReaderTests-617012472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2a259f87-f156-4daf-a751-841fd2f976c1 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:50 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-9c279dc3-7184-4352-9c45-5a9d9709f45e tempest-ProjectReaderTests-1007845069 None] Acquiring lock "cinder-5bf1abd5-e899-45d7-a98e-d058e9e256bc-delete_snapshot" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:49:51 devstack sudo[104531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2a259f87-f156-4daf-a751-841fd2f976c1 1073741824 Aug 28 09:49:51 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-9c279dc3-7184-4352-9c45-5a9d9709f45e tempest-ProjectReaderTests-1007845069 None] Lock "cinder-5bf1abd5-e899-45d7-a98e-d058e9e256bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:49:51 devstack sudo[104531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:51 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-9c279dc3-7184-4352-9c45-5a9d9709f45e tempest-ProjectReaderTests-1007845069 None] Acquiring lock "cinder-quobyte-82ed3939-e357-4c17-878e-9f8c5371bb5f" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:49:51 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-9c279dc3-7184-4352-9c45-5a9d9709f45e tempest-ProjectReaderTests-1007845069 None] Lock "cinder-quobyte-82ed3939-e357-4c17-878e-9f8c5371bb5f" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:49:51 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-9c279dc3-7184-4352-9c45-5a9d9709f45e tempest-ProjectReaderTests-1007845069 None] Acquiring lock "cinder-quobyte-5bf1abd5-e899-45d7-a98e-d058e9e256bc" by "_delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:49:51 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-9c279dc3-7184-4352-9c45-5a9d9709f45e tempest-ProjectReaderTests-1007845069 None] Lock "cinder-quobyte-5bf1abd5-e899-45d7-a98e-d058e9e256bc" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:49:51 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-9c279dc3-7184-4352-9c45-5a9d9709f45e tempest-ProjectReaderTests-1007845069 None] Deleting offline snapshot 5bf1abd5-e899-45d7-a98e-d058e9e256bc of volume 82ed3939-e357-4c17-878e-9f8c5371bb5f {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:49:51 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-9c279dc3-7184-4352-9c45-5a9d9709f45e tempest-ProjectReaderTests-1007845069 None] snapshot_file for this snap is: volume-82ed3939-e357-4c17-878e-9f8c5371bb5f.5bf1abd5-e899-45d7-a98e-d058e9e256bc {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:49:51 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c8076a-ef79-4dc0-8e8f-c038f6548988]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:49:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9c279dc3-7184-4352-9c45-5a9d9709f45e tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-82ed3939-e357-4c17-878e-9f8c5371bb5f.5bf1abd5-e899-45d7-a98e-d058e9e256bc {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:51 devstack sudo[104529]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6461dca4-083d-4724-8356-0fce0186fc03 tempest-VolumeDependencyTests-1081417414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d5203da2-d89a-4846-91e2-407b9be9dba1" returned: 0 in 0.309s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:51 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6461dca4-083d-4724-8356-0fce0186fc03 tempest-VolumeDependencyTests-1081417414 None] Lock "cinder-quobyte-d5203da2-d89a-4846-91e2-407b9be9dba1" released by "delete_volume" :: held 0.812s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:49:51 devstack sudo[104534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-82ed3939-e357-4c17-878e-9f8c5371bb5f.5bf1abd5-e899-45d7-a98e-d058e9e256bc Aug 28 09:49:51 devstack sudo[104534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:51 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-6461dca4-083d-4724-8356-0fce0186fc03 tempest-VolumeDependencyTests-1081417414 None] Created reservations ['0e943f19-5096-4a19-86f9-7677fd799995', 'abd26b01-6f09-4ca2-acda-55189b0b3327', 'c68405cd-e5a5-445c-949d-77e947177e9a', '444de896-bc0a-41b9-aa67-1b39401aec99'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:49:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-6461dca4-083d-4724-8356-0fce0186fc03 tempest-VolumeDependencyTests-1081417414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-6461dca4-083d-4724-8356-0fce0186fc03 tempest-VolumeDependencyTests-1081417414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:51 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-6461dca4-083d-4724-8356-0fce0186fc03 tempest-VolumeDependencyTests-1081417414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:49:51 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-6461dca4-083d-4724-8356-0fce0186fc03 tempest-VolumeDependencyTests-1081417414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:49:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-6461dca4-083d-4724-8356-0fce0186fc03 tempest-VolumeDependencyTests-1081417414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6461dca4-083d-4724-8356-0fce0186fc03 tempest-VolumeDependencyTests-1081417414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:51 devstack sudo[104539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:49:51 devstack sudo[104539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-27e2b478-7d11-4e79-bc44-a71b65e22875 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:51 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-494a69e4-101e-487f-ac3e-ea0c0e65f81e tempest-VolumeDependencyTests-1081417414 None] Acquiring lock "cinder-63c3cfe1-10e2-40cc-8411-86f72995506e-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:49:51 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-494a69e4-101e-487f-ac3e-ea0c0e65f81e tempest-VolumeDependencyTests-1081417414 None] Lock "cinder-63c3cfe1-10e2-40cc-8411-86f72995506e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:49:51 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-494a69e4-101e-487f-ac3e-ea0c0e65f81e tempest-VolumeDependencyTests-1081417414 None] Acquiring lock "cinder-quobyte-63c3cfe1-10e2-40cc-8411-86f72995506e" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:49:51 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-494a69e4-101e-487f-ac3e-ea0c0e65f81e tempest-VolumeDependencyTests-1081417414 None] Lock "cinder-quobyte-63c3cfe1-10e2-40cc-8411-86f72995506e" acquired by "delete_volume" :: waited 0.025s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:49:51 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[478327e1-1fae-48b7-ac47-81ec158f9db2]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:49:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-494a69e4-101e-487f-ac3e-ea0c0e65f81e tempest-VolumeDependencyTests-1081417414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-63c3cfe1-10e2-40cc-8411-86f72995506e {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:51 devstack sudo[104534]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9c279dc3-7184-4352-9c45-5a9d9709f45e tempest-ProjectReaderTests-1007845069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-82ed3939-e357-4c17-878e-9f8c5371bb5f.5bf1abd5-e899-45d7-a98e-d058e9e256bc" returned: 0 in 0.522s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:51 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-9c279dc3-7184-4352-9c45-5a9d9709f45e tempest-ProjectReaderTests-1007845069 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82ed3939-e357-4c17-878e-9f8c5371bb5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:49:51 devstack sudo[104531]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-722c32e6-663d-44f4-8538-974005e198ce tempest-ProjectReaderTests-617012472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2a259f87-f156-4daf-a751-841fd2f976c1 1073741824" returned: 0 in 0.675s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:51 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b8126f-2077-4453-8ef6-9b148725ba22]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:49:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9c279dc3-7184-4352-9c45-5a9d9709f45e tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-82ed3939-e357-4c17-878e-9f8c5371bb5f {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-722c32e6-663d-44f4-8538-974005e198ce tempest-ProjectReaderTests-617012472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2a259f87-f156-4daf-a751-841fd2f976c1 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:51 devstack sudo[104545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-63c3cfe1-10e2-40cc-8411-86f72995506e Aug 28 09:49:51 devstack sudo[104545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:51 devstack sudo[104539]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6461dca4-083d-4724-8356-0fce0186fc03 tempest-VolumeDependencyTests-1081417414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.379s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:51 devstack sudo[104548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2a259f87-f156-4daf-a751-841fd2f976c1 Aug 28 09:49:51 devstack sudo[104548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:51 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-6461dca4-083d-4724-8356-0fce0186fc03 tempest-VolumeDependencyTests-1081417414 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:49:51 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-6461dca4-083d-4724-8356-0fce0186fc03 tempest-VolumeDependencyTests-1081417414 None] Deleted volume successfully. Aug 28 09:49:51 devstack sudo[104546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-82ed3939-e357-4c17-878e-9f8c5371bb5f Aug 28 09:49:51 devstack sudo[104546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:51 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-6461dca4-083d-4724-8356-0fce0186fc03 tempest-VolumeDependencyTests-1081417414 None] Lock "cinder-d5203da2-d89a-4846-91e2-407b9be9dba1-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:49:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-722c32e6-663d-44f4-8538-974005e198ce tempest-ProjectReaderTests-617012472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2a259f87-f156-4daf-a751-841fd2f976c1" returned: 0 in 0.338s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:52 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-722c32e6-663d-44f4-8538-974005e198ce tempest-ProjectReaderTests-617012472 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:49:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-722c32e6-663d-44f4-8538-974005e198ce tempest-ProjectReaderTests-617012472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-27e2b478-7d11-4e79-bc44-a71b65e22875 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.575s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-494a69e4-101e-487f-ac3e-ea0c0e65f81e tempest-VolumeDependencyTests-1081417414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-63c3cfe1-10e2-40cc-8411-86f72995506e" returned: 0 in 0.454s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-494a69e4-101e-487f-ac3e-ea0c0e65f81e tempest-VolumeDependencyTests-1081417414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-63c3cfe1-10e2-40cc-8411-86f72995506e {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:52 devstack sudo[104548]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:52 devstack sudo[104545]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:52 devstack sudo[104546]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9c279dc3-7184-4352-9c45-5a9d9709f45e tempest-ProjectReaderTests-1007845069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-82ed3939-e357-4c17-878e-9f8c5371bb5f" returned: 0 in 0.416s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:52 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-27e2b478-7d11-4e79-bc44-a71b65e22875 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Creating offline snapshot 022772fd-676c-4808-b0ce-88cf9b85d963 of volume 464f3f82-06e2-4d2f-a459-aa86c9e0d4f9 {{(pid=86081) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:49:52 devstack sudo[104561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-63c3cfe1-10e2-40cc-8411-86f72995506e Aug 28 09:49:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9c279dc3-7184-4352-9c45-5a9d9709f45e tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-82ed3939-e357-4c17-878e-9f8c5371bb5f.5bf1abd5-e899-45d7-a98e-d058e9e256bc {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:52 devstack sudo[104561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:52 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-722c32e6-663d-44f4-8538-974005e198ce tempest-ProjectReaderTests-617012472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30133735-581b-47b4-a8e3-9ba1be27ceee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a259f87-f156-4daf-a751-841fd2f976c1', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:52 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-722c32e6-663d-44f4-8538-974005e198ce tempest-ProjectReaderTests-617012472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b81dfa25-aa31-41c5-ac9c-1df039255e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:52 devstack sudo[104563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-82ed3939-e357-4c17-878e-9f8c5371bb5f.5bf1abd5-e899-45d7-a98e-d058e9e256bc Aug 28 09:49:52 devstack sudo[104563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:52 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[2106f317-d6f4-4baf-aa1e-c73b03504fac]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:49:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-27e2b478-7d11-4e79-bc44-a71b65e22875 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:52 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-722c32e6-663d-44f4-8538-974005e198ce tempest-ProjectReaderTests-617012472 None] Volume volume-2a259f87-f156-4daf-a751-841fd2f976c1 (2a259f87-f156-4daf-a751-841fd2f976c1): created successfully Aug 28 09:49:52 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-722c32e6-663d-44f4-8538-974005e198ce tempest-ProjectReaderTests-617012472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b81dfa25-aa31-41c5-ac9c-1df039255e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:52 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-722c32e6-663d-44f4-8538-974005e198ce tempest-ProjectReaderTests-617012472 None] Flow 'volume_create_manager' (46d62b6b-c5cd-4cbd-ab21-7001984e507a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:49:52 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-722c32e6-663d-44f4-8538-974005e198ce tempest-ProjectReaderTests-617012472 None] Created volume successfully. Aug 28 09:49:52 devstack sudo[104565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9 Aug 28 09:49:52 devstack sudo[104565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:52 devstack sudo[104561]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-494a69e4-101e-487f-ac3e-ea0c0e65f81e tempest-VolumeDependencyTests-1081417414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-63c3cfe1-10e2-40cc-8411-86f72995506e" returned: 0 in 0.280s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:52 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-494a69e4-101e-487f-ac3e-ea0c0e65f81e tempest-VolumeDependencyTests-1081417414 None] Lock "cinder-quobyte-63c3cfe1-10e2-40cc-8411-86f72995506e" released by "delete_volume" :: held 0.777s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:49:52 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-494a69e4-101e-487f-ac3e-ea0c0e65f81e tempest-VolumeDependencyTests-1081417414 None] Created reservations ['12e3733f-40a9-4ebf-a8c6-054a3a6d76bb', '5b5e2703-eae9-486d-b0b5-15e50b519975', '2cadad8b-1ef2-4fd8-b4ef-2854ef92a4ac', '4be23f49-243a-4946-93b4-cb22dbd5773a'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:49:52 devstack sudo[104563]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9c279dc3-7184-4352-9c45-5a9d9709f45e tempest-ProjectReaderTests-1007845069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-82ed3939-e357-4c17-878e-9f8c5371bb5f.5bf1abd5-e899-45d7-a98e-d058e9e256bc" returned: 0 in 0.373s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9c279dc3-7184-4352-9c45-5a9d9709f45e tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-82ed3939-e357-4c17-878e-9f8c5371bb5f.5bf1abd5-e899-45d7-a98e-d058e9e256bc {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:52 devstack sudo[104574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-82ed3939-e357-4c17-878e-9f8c5371bb5f.5bf1abd5-e899-45d7-a98e-d058e9e256bc Aug 28 09:49:52 devstack sudo[104574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-494a69e4-101e-487f-ac3e-ea0c0e65f81e tempest-VolumeDependencyTests-1081417414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-494a69e4-101e-487f-ac3e-ea0c0e65f81e tempest-VolumeDependencyTests-1081417414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:52 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-494a69e4-101e-487f-ac3e-ea0c0e65f81e tempest-VolumeDependencyTests-1081417414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:49:52 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-494a69e4-101e-487f-ac3e-ea0c0e65f81e tempest-VolumeDependencyTests-1081417414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:49:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-494a69e4-101e-487f-ac3e-ea0c0e65f81e tempest-VolumeDependencyTests-1081417414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-494a69e4-101e-487f-ac3e-ea0c0e65f81e tempest-VolumeDependencyTests-1081417414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:52 devstack sudo[104577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:49:52 devstack sudo[104577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:52 devstack sudo[104565]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-27e2b478-7d11-4e79-bc44-a71b65e22875 tempest-CreateVolumesFromSnapshotTest-1117622518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9" returned: 0 in 0.421s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-27e2b478-7d11-4e79-bc44-a71b65e22875 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9.022772fd-676c-4808-b0ce-88cf9b85d963 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:52 devstack sudo[104579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9.022772fd-676c-4808-b0ce-88cf9b85d963 1G Aug 28 09:49:52 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:52 devstack sudo[104577]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-494a69e4-101e-487f-ac3e-ea0c0e65f81e tempest-VolumeDependencyTests-1081417414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.255s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:52 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-494a69e4-101e-487f-ac3e-ea0c0e65f81e tempest-VolumeDependencyTests-1081417414 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:49:52 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-494a69e4-101e-487f-ac3e-ea0c0e65f81e tempest-VolumeDependencyTests-1081417414 None] Deleted volume successfully. Aug 28 09:49:52 devstack sudo[104574]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9c279dc3-7184-4352-9c45-5a9d9709f45e tempest-ProjectReaderTests-1007845069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-82ed3939-e357-4c17-878e-9f8c5371bb5f.5bf1abd5-e899-45d7-a98e-d058e9e256bc" returned: 0 in 0.320s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:52 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-9c279dc3-7184-4352-9c45-5a9d9709f45e tempest-ProjectReaderTests-1007845069 None] Lock "cinder-quobyte-5bf1abd5-e899-45d7-a98e-d058e9e256bc" released by "_delete_snapshot" :: held 1.747s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:49:52 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-494a69e4-101e-487f-ac3e-ea0c0e65f81e tempest-VolumeDependencyTests-1081417414 None] Lock "cinder-63c3cfe1-10e2-40cc-8411-86f72995506e-delete_volume" released by "delete_volume" :: held 1.313s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:49:52 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-9c279dc3-7184-4352-9c45-5a9d9709f45e tempest-ProjectReaderTests-1007845069 None] Lock "cinder-quobyte-82ed3939-e357-4c17-878e-9f8c5371bb5f" released by "delete_snapshot" :: held 1.788s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:49:52 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-9c279dc3-7184-4352-9c45-5a9d9709f45e tempest-ProjectReaderTests-1007845069 None] Created reservations ['e97ce2a8-fd74-4cab-9954-e89583041284', 'fc8cf6cc-8127-474c-bc79-1e343bea00ed', '256c1818-20eb-4fda-8970-a5c105e7eeae', '7444e7fb-ad4d-497e-9c76-030d49db5d1c'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:49:53 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-9c279dc3-7184-4352-9c45-5a9d9709f45e tempest-ProjectReaderTests-1007845069 None] Delete snapshot completed successfully. Aug 28 09:49:53 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-9c279dc3-7184-4352-9c45-5a9d9709f45e tempest-ProjectReaderTests-1007845069 None] Lock "cinder-5bf1abd5-e899-45d7-a98e-d058e9e256bc-delete_snapshot" released by "delete_snapshot" :: held 2.040s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:49:53 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-27e2b478-7d11-4e79-bc44-a71b65e22875 tempest-CreateVolumesFromSnapshotTest-1117622518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9.022772fd-676c-4808-b0ce-88cf9b85d963 1G" returned: 0 in 0.553s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-27e2b478-7d11-4e79-bc44-a71b65e22875 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9.022772fd-676c-4808-b0ce-88cf9b85d963 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:53 devstack sudo[104587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9.022772fd-676c-4808-b0ce-88cf9b85d963 Aug 28 09:49:53 devstack sudo[104587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:53 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-76eecb85-f518-44e8-adf0-3ee952aa3173 tempest-ProjectReaderTests-1007845069 None] Acquiring lock "cinder-82ed3939-e357-4c17-878e-9f8c5371bb5f-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:49:53 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-76eecb85-f518-44e8-adf0-3ee952aa3173 tempest-ProjectReaderTests-1007845069 None] Lock "cinder-82ed3939-e357-4c17-878e-9f8c5371bb5f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:49:53 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-76eecb85-f518-44e8-adf0-3ee952aa3173 tempest-ProjectReaderTests-1007845069 None] Acquiring lock "cinder-quobyte-82ed3939-e357-4c17-878e-9f8c5371bb5f" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:49:53 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-76eecb85-f518-44e8-adf0-3ee952aa3173 tempest-ProjectReaderTests-1007845069 None] Lock "cinder-quobyte-82ed3939-e357-4c17-878e-9f8c5371bb5f" acquired by "delete_volume" :: waited 0.023s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:49:53 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-9377b52c-2a05-42e4-95d3-89cffd96a2f1 tempest-ProjectReaderTests-617012472 None] Acquiring lock "cinder-2a259f87-f156-4daf-a751-841fd2f976c1-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:49:53 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-9377b52c-2a05-42e4-95d3-89cffd96a2f1 tempest-ProjectReaderTests-617012472 None] Lock "cinder-2a259f87-f156-4daf-a751-841fd2f976c1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:49:53 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd39a18-1785-497f-9ede-7ef7e883c2d3]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:49:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-76eecb85-f518-44e8-adf0-3ee952aa3173 tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-82ed3939-e357-4c17-878e-9f8c5371bb5f {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:53 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-9377b52c-2a05-42e4-95d3-89cffd96a2f1 tempest-ProjectReaderTests-617012472 None] Acquiring lock "cinder-quobyte-2a259f87-f156-4daf-a751-841fd2f976c1" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:49:53 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-9377b52c-2a05-42e4-95d3-89cffd96a2f1 tempest-ProjectReaderTests-617012472 None] Lock "cinder-quobyte-2a259f87-f156-4daf-a751-841fd2f976c1" acquired by "delete_volume" :: waited 0.031s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:49:53 devstack sudo[104587]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-27e2b478-7d11-4e79-bc44-a71b65e22875 tempest-CreateVolumesFromSnapshotTest-1117622518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9.022772fd-676c-4808-b0ce-88cf9b85d963" returned: 0 in 0.380s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:53 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-27e2b478-7d11-4e79-bc44-a71b65e22875 tempest-CreateVolumesFromSnapshotTest-1117622518 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9.022772fd-676c-4808-b0ce-88cf9b85d963 is being set with open permissions: ugo+rw Aug 28 09:49:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-27e2b478-7d11-4e79-bc44-a71b65e22875 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9.022772fd-676c-4808-b0ce-88cf9b85d963 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:53 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[063e541e-3500-4f93-b1e8-300cfd3be0cf]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:49:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9377b52c-2a05-42e4-95d3-89cffd96a2f1 tempest-ProjectReaderTests-617012472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2a259f87-f156-4daf-a751-841fd2f976c1 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:53 devstack sudo[104591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-82ed3939-e357-4c17-878e-9f8c5371bb5f Aug 28 09:49:53 devstack sudo[104591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:53 devstack sudo[104593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9.022772fd-676c-4808-b0ce-88cf9b85d963 Aug 28 09:49:53 devstack sudo[104593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:53 devstack sudo[104594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2a259f87-f156-4daf-a751-841fd2f976c1 Aug 28 09:49:53 devstack sudo[104594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:53 devstack sudo[104593]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-27e2b478-7d11-4e79-bc44-a71b65e22875 tempest-CreateVolumesFromSnapshotTest-1117622518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9.022772fd-676c-4808-b0ce-88cf9b85d963" returned: 0 in 0.303s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:53 devstack sudo[104591]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-76eecb85-f518-44e8-adf0-3ee952aa3173 tempest-ProjectReaderTests-1007845069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-82ed3939-e357-4c17-878e-9f8c5371bb5f" returned: 0 in 0.427s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-76eecb85-f518-44e8-adf0-3ee952aa3173 tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-82ed3939-e357-4c17-878e-9f8c5371bb5f {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:53 devstack sudo[104603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-82ed3939-e357-4c17-878e-9f8c5371bb5f Aug 28 09:49:53 devstack sudo[104603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-27e2b478-7d11-4e79-bc44-a71b65e22875 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:53 devstack sudo[104606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9.info Aug 28 09:49:53 devstack sudo[104606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:53 devstack sudo[104594]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9377b52c-2a05-42e4-95d3-89cffd96a2f1 tempest-ProjectReaderTests-617012472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2a259f87-f156-4daf-a751-841fd2f976c1" returned: 0 in 0.456s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9377b52c-2a05-42e4-95d3-89cffd96a2f1 tempest-ProjectReaderTests-617012472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2a259f87-f156-4daf-a751-841fd2f976c1 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:53 devstack sudo[104610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2a259f87-f156-4daf-a751-841fd2f976c1 Aug 28 09:49:53 devstack sudo[104610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:54 devstack sudo[104603]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-76eecb85-f518-44e8-adf0-3ee952aa3173 tempest-ProjectReaderTests-1007845069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-82ed3939-e357-4c17-878e-9f8c5371bb5f" returned: 0 in 0.284s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:54 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-76eecb85-f518-44e8-adf0-3ee952aa3173 tempest-ProjectReaderTests-1007845069 None] Lock "cinder-quobyte-82ed3939-e357-4c17-878e-9f8c5371bb5f" released by "delete_volume" :: held 0.825s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:49:54 devstack sudo[104606]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-27e2b478-7d11-4e79-bc44-a71b65e22875 tempest-CreateVolumesFromSnapshotTest-1117622518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9.info" returned: 0 in 0.287s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:54 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-27e2b478-7d11-4e79-bc44-a71b65e22875 tempest-CreateVolumesFromSnapshotTest-1117622518 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9.info is being set with open permissions: ugo+rw Aug 28 09:49:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-27e2b478-7d11-4e79-bc44-a71b65e22875 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:54 devstack sudo[104614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9.info Aug 28 09:49:54 devstack sudo[104614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:54 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-76eecb85-f518-44e8-adf0-3ee952aa3173 tempest-ProjectReaderTests-1007845069 None] Created reservations ['f81e791c-833a-44f0-ac71-322956ed794e', 'f9413690-d612-4b4b-840e-5e6a60545608', '8dbd3eb0-f16f-465c-91d1-9c0e6adb2036', '97d6434a-2136-4cd5-93c4-0566477d696c'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:49:54 devstack sudo[104610]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9377b52c-2a05-42e4-95d3-89cffd96a2f1 tempest-ProjectReaderTests-617012472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-2a259f87-f156-4daf-a751-841fd2f976c1" returned: 0 in 0.319s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-76eecb85-f518-44e8-adf0-3ee952aa3173 tempest-ProjectReaderTests-1007845069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-76eecb85-f518-44e8-adf0-3ee952aa3173 tempest-ProjectReaderTests-1007845069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:54 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-76eecb85-f518-44e8-adf0-3ee952aa3173 tempest-ProjectReaderTests-1007845069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:49:54 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-76eecb85-f518-44e8-adf0-3ee952aa3173 tempest-ProjectReaderTests-1007845069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:49:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-76eecb85-f518-44e8-adf0-3ee952aa3173 tempest-ProjectReaderTests-1007845069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-76eecb85-f518-44e8-adf0-3ee952aa3173 tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:54 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-9377b52c-2a05-42e4-95d3-89cffd96a2f1 tempest-ProjectReaderTests-617012472 None] Lock "cinder-quobyte-2a259f87-f156-4daf-a751-841fd2f976c1" released by "delete_volume" :: held 0.865s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:49:54 devstack sudo[104617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:49:54 devstack sudo[104617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:54 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-9377b52c-2a05-42e4-95d3-89cffd96a2f1 tempest-ProjectReaderTests-617012472 None] Created reservations ['60cf46b2-e98b-44a1-bcc7-2aca736fbd03', '37cfc1e4-02a3-4ef5-a1e5-a13b221fa901', '9c071493-6dda-4b16-97b9-ebb4c834edd9', 'd97eed97-4cbe-4566-b8a0-03b2105a81c0'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:49:54 devstack sudo[104614]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-27e2b478-7d11-4e79-bc44-a71b65e22875 tempest-CreateVolumesFromSnapshotTest-1117622518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9.info" returned: 0 in 0.385s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-27e2b478-7d11-4e79-bc44-a71b65e22875 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.493s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:54 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-27e2b478-7d11-4e79-bc44-a71b65e22875 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Create snapshot completed successfully Aug 28 09:49:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-9377b52c-2a05-42e4-95d3-89cffd96a2f1 tempest-ProjectReaderTests-617012472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-9377b52c-2a05-42e4-95d3-89cffd96a2f1 tempest-ProjectReaderTests-617012472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:54 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-9377b52c-2a05-42e4-95d3-89cffd96a2f1 tempest-ProjectReaderTests-617012472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:49:54 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-9377b52c-2a05-42e4-95d3-89cffd96a2f1 tempest-ProjectReaderTests-617012472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:49:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-9377b52c-2a05-42e4-95d3-89cffd96a2f1 tempest-ProjectReaderTests-617012472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9377b52c-2a05-42e4-95d3-89cffd96a2f1 tempest-ProjectReaderTests-617012472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:54 devstack sudo[104621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:49:54 devstack sudo[104621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:54 devstack sudo[104617]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-76eecb85-f518-44e8-adf0-3ee952aa3173 tempest-ProjectReaderTests-1007845069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.356s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:54 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-76eecb85-f518-44e8-adf0-3ee952aa3173 tempest-ProjectReaderTests-1007845069 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:49:54 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-76eecb85-f518-44e8-adf0-3ee952aa3173 tempest-ProjectReaderTests-1007845069 None] Deleted volume successfully. Aug 28 09:49:54 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-76eecb85-f518-44e8-adf0-3ee952aa3173 tempest-ProjectReaderTests-1007845069 None] Lock "cinder-82ed3939-e357-4c17-878e-9f8c5371bb5f-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:49:54 devstack sudo[104621]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-9377b52c-2a05-42e4-95d3-89cffd96a2f1 tempest-ProjectReaderTests-617012472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.301s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:54 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-9377b52c-2a05-42e4-95d3-89cffd96a2f1 tempest-ProjectReaderTests-617012472 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:49:54 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-9377b52c-2a05-42e4-95d3-89cffd96a2f1 tempest-ProjectReaderTests-617012472 None] Deleted volume successfully. Aug 28 09:49:54 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-9377b52c-2a05-42e4-95d3-89cffd96a2f1 tempest-ProjectReaderTests-617012472 None] Lock "cinder-2a259f87-f156-4daf-a751-841fd2f976c1-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:49:55 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccf6b228-6b0e-42ee-a6c2-c370690845f7 tempest-ProjectReaderTests-1007845069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:49:55 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ccf6b228-6b0e-42ee-a6c2-c370690845f7 tempest-ProjectReaderTests-1007845069 None] Flow 'volume_create_manager' (fc3ea7bf-c70a-4d9f-8b13-7e3ac9e4b2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:49:55 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ccf6b228-6b0e-42ee-a6c2-c370690845f7 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21c3e081-4d92-400d-9d1a-9c3c51f5c96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:55 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ccf6b228-6b0e-42ee-a6c2-c370690845f7 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21c3e081-4d92-400d-9d1a-9c3c51f5c96a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1782909699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abf07dfb-a9c2-4df6-ac63-89bee6c0cd09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0a1ea6b99c7413e9fb54892d96af172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:55Z,use_quota=True,user_id='40fe0546d5a249bcb1fd3247e64d4590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:55 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ccf6b228-6b0e-42ee-a6c2-c370690845f7 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fa33ac3-55bf-418d-b4fa-4f693139ccff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:55 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ccf6b228-6b0e-42ee-a6c2-c370690845f7 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fa33ac3-55bf-418d-b4fa-4f693139ccff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:55 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ccf6b228-6b0e-42ee-a6c2-c370690845f7 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68f279c7-e861-44f5-89ad-4bbe605e80c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:55 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ccf6b228-6b0e-42ee-a6c2-c370690845f7 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68f279c7-e861-44f5-89ad-4bbe605e80c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abf07dfb-a9c2-4df6-ac63-89bee6c0cd09', 'volume_name': 'volume-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:55 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ccf6b228-6b0e-42ee-a6c2-c370690845f7 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77cb400f-397f-444e-aecc-745252252272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:55 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ccf6b228-6b0e-42ee-a6c2-c370690845f7 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77cb400f-397f-444e-aecc-745252252272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:55 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ccf6b228-6b0e-42ee-a6c2-c370690845f7 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ed88ad5-2dd0-4a9e-9f5b-41f4ae02f0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:55 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-ccf6b228-6b0e-42ee-a6c2-c370690845f7 tempest-ProjectReaderTests-1007845069 None] Volume abf07dfb-a9c2-4df6-ac63-89bee6c0cd09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09', 'volume_size': 1} Aug 28 09:49:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ccf6b228-6b0e-42ee-a6c2-c370690845f7 tempest-ProjectReaderTests-1007845069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ccf6b228-6b0e-42ee-a6c2-c370690845f7 tempest-ProjectReaderTests-1007845069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:55 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ccf6b228-6b0e-42ee-a6c2-c370690845f7 tempest-ProjectReaderTests-1007845069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1782909699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abf07dfb-a9c2-4df6-ac63-89bee6c0cd09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0a1ea6b99c7413e9fb54892d96af172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:55Z,use_quota=True,user_id='40fe0546d5a249bcb1fd3247e64d4590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:49:55 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-ccf6b228-6b0e-42ee-a6c2-c370690845f7 tempest-ProjectReaderTests-1007845069 None] Creating volume abf07dfb-a9c2-4df6-ac63-89bee6c0cd09 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:49:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ccf6b228-6b0e-42ee-a6c2-c370690845f7 tempest-ProjectReaderTests-1007845069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ccf6b228-6b0e-42ee-a6c2-c370690845f7 tempest-ProjectReaderTests-1007845069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:55 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ccf6b228-6b0e-42ee-a6c2-c370690845f7 tempest-ProjectReaderTests-1007845069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:49:55 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ccf6b228-6b0e-42ee-a6c2-c370690845f7 tempest-ProjectReaderTests-1007845069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:49:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ccf6b228-6b0e-42ee-a6c2-c370690845f7 tempest-ProjectReaderTests-1007845069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:55 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ccf6b228-6b0e-42ee-a6c2-c370690845f7 tempest-ProjectReaderTests-1007845069 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:49:55 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-ccf6b228-6b0e-42ee-a6c2-c370690845f7 tempest-ProjectReaderTests-1007845069 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:49:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ccf6b228-6b0e-42ee-a6c2-c370690845f7 tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:55 devstack sudo[104624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09 1073741824 Aug 28 09:49:55 devstack sudo[104624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:55 devstack sudo[104624]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ccf6b228-6b0e-42ee-a6c2-c370690845f7 tempest-ProjectReaderTests-1007845069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09 1073741824" returned: 0 in 0.456s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ccf6b228-6b0e-42ee-a6c2-c370690845f7 tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:55 devstack sudo[104630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09 Aug 28 09:49:55 devstack sudo[104630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:55 devstack sudo[104630]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ccf6b228-6b0e-42ee-a6c2-c370690845f7 tempest-ProjectReaderTests-1007845069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09" returned: 0 in 0.261s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:55 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ccf6b228-6b0e-42ee-a6c2-c370690845f7 tempest-ProjectReaderTests-1007845069 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:49:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ccf6b228-6b0e-42ee-a6c2-c370690845f7 tempest-ProjectReaderTests-1007845069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:55 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ccf6b228-6b0e-42ee-a6c2-c370690845f7 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ed88ad5-2dd0-4a9e-9f5b-41f4ae02f0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:55 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ccf6b228-6b0e-42ee-a6c2-c370690845f7 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7711dd38-bc19-412c-8be2-32c35dcbc1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:55 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-ccf6b228-6b0e-42ee-a6c2-c370690845f7 tempest-ProjectReaderTests-1007845069 None] Volume volume-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09 (abf07dfb-a9c2-4df6-ac63-89bee6c0cd09): created successfully Aug 28 09:49:55 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ccf6b228-6b0e-42ee-a6c2-c370690845f7 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7711dd38-bc19-412c-8be2-32c35dcbc1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:55 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ccf6b228-6b0e-42ee-a6c2-c370690845f7 tempest-ProjectReaderTests-1007845069 None] Flow 'volume_create_manager' (fc3ea7bf-c70a-4d9f-8b13-7e3ac9e4b2f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:49:55 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-ccf6b228-6b0e-42ee-a6c2-c370690845f7 tempest-ProjectReaderTests-1007845069 None] Created volume successfully. Aug 28 09:49:56 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-211783ee-08b8-4403-a5c1-a7b507aba18b tempest-ProjectReaderTests-617012472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:49:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-211783ee-08b8-4403-a5c1-a7b507aba18b tempest-ProjectReaderTests-617012472 None] Flow 'volume_create_manager' (64acac36-fa26-4821-b3ef-d6d9df64590b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:49:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-211783ee-08b8-4403-a5c1-a7b507aba18b tempest-ProjectReaderTests-617012472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e12a7678-d59e-4213-b636-2a71691286f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-211783ee-08b8-4403-a5c1-a7b507aba18b tempest-ProjectReaderTests-617012472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e12a7678-d59e-4213-b636-2a71691286f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2094179412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39545fc3-9af9-4c53-b2d1-cafbe4c59077,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a17af17478e4c5da3a44644c27a625e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:56Z,use_quota=True,user_id='2ba337b9bf0e4eb8bcaa95493081e2f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-211783ee-08b8-4403-a5c1-a7b507aba18b tempest-ProjectReaderTests-617012472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (903c0fdc-bf7b-4b72-877b-63db49231b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-211783ee-08b8-4403-a5c1-a7b507aba18b tempest-ProjectReaderTests-617012472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (903c0fdc-bf7b-4b72-877b-63db49231b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-211783ee-08b8-4403-a5c1-a7b507aba18b tempest-ProjectReaderTests-617012472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3285dee-1d6e-421a-b035-fc14fc64de96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-211783ee-08b8-4403-a5c1-a7b507aba18b tempest-ProjectReaderTests-617012472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3285dee-1d6e-421a-b035-fc14fc64de96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39545fc3-9af9-4c53-b2d1-cafbe4c59077', 'volume_name': 'volume-39545fc3-9af9-4c53-b2d1-cafbe4c59077', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-211783ee-08b8-4403-a5c1-a7b507aba18b tempest-ProjectReaderTests-617012472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3186cb0-a2d1-4ecc-9356-c86c8d41d5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-211783ee-08b8-4403-a5c1-a7b507aba18b tempest-ProjectReaderTests-617012472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3186cb0-a2d1-4ecc-9356-c86c8d41d5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-211783ee-08b8-4403-a5c1-a7b507aba18b tempest-ProjectReaderTests-617012472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f94ec05-f904-40a8-b184-a4cbbe4a7cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:56 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-211783ee-08b8-4403-a5c1-a7b507aba18b tempest-ProjectReaderTests-617012472 None] Volume 39545fc3-9af9-4c53-b2d1-cafbe4c59077: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39545fc3-9af9-4c53-b2d1-cafbe4c59077', 'volume_size': 1} Aug 28 09:49:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-211783ee-08b8-4403-a5c1-a7b507aba18b tempest-ProjectReaderTests-617012472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-211783ee-08b8-4403-a5c1-a7b507aba18b tempest-ProjectReaderTests-617012472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:56 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-211783ee-08b8-4403-a5c1-a7b507aba18b tempest-ProjectReaderTests-617012472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2094179412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39545fc3-9af9-4c53-b2d1-cafbe4c59077,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a17af17478e4c5da3a44644c27a625e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:56Z,use_quota=True,user_id='2ba337b9bf0e4eb8bcaa95493081e2f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:49:56 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-211783ee-08b8-4403-a5c1-a7b507aba18b tempest-ProjectReaderTests-617012472 None] Creating volume 39545fc3-9af9-4c53-b2d1-cafbe4c59077 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:49:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-211783ee-08b8-4403-a5c1-a7b507aba18b tempest-ProjectReaderTests-617012472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-211783ee-08b8-4403-a5c1-a7b507aba18b tempest-ProjectReaderTests-617012472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:56 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-211783ee-08b8-4403-a5c1-a7b507aba18b tempest-ProjectReaderTests-617012472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:49:56 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-211783ee-08b8-4403-a5c1-a7b507aba18b tempest-ProjectReaderTests-617012472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:49:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-211783ee-08b8-4403-a5c1-a7b507aba18b tempest-ProjectReaderTests-617012472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:56 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-211783ee-08b8-4403-a5c1-a7b507aba18b tempest-ProjectReaderTests-617012472 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:49:56 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-211783ee-08b8-4403-a5c1-a7b507aba18b tempest-ProjectReaderTests-617012472 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:49:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-211783ee-08b8-4403-a5c1-a7b507aba18b tempest-ProjectReaderTests-617012472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-39545fc3-9af9-4c53-b2d1-cafbe4c59077 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:56 devstack sudo[104633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-39545fc3-9af9-4c53-b2d1-cafbe4c59077 1073741824 Aug 28 09:49:56 devstack sudo[104633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:56 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e6558aa-7839-4868-97a0-e68078a5d109 tempest-CinderUnicodeTest-818840768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:49:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6e6558aa-7839-4868-97a0-e68078a5d109 tempest-CinderUnicodeTest-818840768 None] Flow 'volume_create_manager' (03f81b15-42d4-48ba-88d3-5627b33c2d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:49:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6e6558aa-7839-4868-97a0-e68078a5d109 tempest-CinderUnicodeTest-818840768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c1a831a-a367-424c-89c5-e8f37d681ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6e6558aa-7839-4868-97a0-e68078a5d109 tempest-CinderUnicodeTest-818840768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c1a831a-a367-424c-89c5-e8f37d681ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1abe3f4-755f-4ef4-a26f-cb64f0c7c661,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df14ebaa64c54b4a835bd39c0f4349d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:56Z,use_quota=True,user_id='e0a01d28781c461caa6150e64642401b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6e6558aa-7839-4868-97a0-e68078a5d109 tempest-CinderUnicodeTest-818840768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45cd4082-6be0-4b8a-a8fc-36e1d54025cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6e6558aa-7839-4868-97a0-e68078a5d109 tempest-CinderUnicodeTest-818840768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45cd4082-6be0-4b8a-a8fc-36e1d54025cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6e6558aa-7839-4868-97a0-e68078a5d109 tempest-CinderUnicodeTest-818840768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8379f171-2f25-46f9-b994-00dca3abbb97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6e6558aa-7839-4868-97a0-e68078a5d109 tempest-CinderUnicodeTest-818840768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8379f171-2f25-46f9-b994-00dca3abbb97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1abe3f4-755f-4ef4-a26f-cb64f0c7c661', 'volume_name': 'volume-c1abe3f4-755f-4ef4-a26f-cb64f0c7c661', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6e6558aa-7839-4868-97a0-e68078a5d109 tempest-CinderUnicodeTest-818840768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4769d1be-5640-409d-8d74-ced486b17494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6e6558aa-7839-4868-97a0-e68078a5d109 tempest-CinderUnicodeTest-818840768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4769d1be-5640-409d-8d74-ced486b17494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6e6558aa-7839-4868-97a0-e68078a5d109 tempest-CinderUnicodeTest-818840768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5278faf3-eb0c-4277-8d0a-eb9172a9b765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:56 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-6e6558aa-7839-4868-97a0-e68078a5d109 tempest-CinderUnicodeTest-818840768 None] Volume c1abe3f4-755f-4ef4-a26f-cb64f0c7c661: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1abe3f4-755f-4ef4-a26f-cb64f0c7c661', 'volume_size': 1} Aug 28 09:49:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-6e6558aa-7839-4868-97a0-e68078a5d109 tempest-CinderUnicodeTest-818840768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-dff79692-ab55-4ca7-8a3b-82568f3bc2f3 tempest-ProjectReaderTests-1007845069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:56 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf5bde6f-8d8b-41bf-af06-b96976b45a5a tempest-CreateVolumesFromSnapshotTest-1117622518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:49:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-cf5bde6f-8d8b-41bf-af06-b96976b45a5a tempest-CreateVolumesFromSnapshotTest-1117622518 None] Flow 'volume_create_manager' (fac89e5e-2e6f-451e-8b9f-45e097896e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:49:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-cf5bde6f-8d8b-41bf-af06-b96976b45a5a tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6c13254-63ed-43e7-99d3-8725f6315fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-cf5bde6f-8d8b-41bf-af06-b96976b45a5a tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6c13254-63ed-43e7-99d3-8725f6315fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1041031140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ab11766-d206-4070-812a-a76677fea9ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aae33908983746b98ccde3d1e66e9f74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:57Z,use_quota=True,user_id='19b3519d9ca64c3cb159fe37ee6267f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-cf5bde6f-8d8b-41bf-af06-b96976b45a5a tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2768eca4-42c9-48a0-9bca-2748068c142a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-cf5bde6f-8d8b-41bf-af06-b96976b45a5a tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2768eca4-42c9-48a0-9bca-2748068c142a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-cf5bde6f-8d8b-41bf-af06-b96976b45a5a tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4749491-7878-4cf6-9889-cad4a48212f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-cf5bde6f-8d8b-41bf-af06-b96976b45a5a tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4749491-7878-4cf6-9889-cad4a48212f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ab11766-d206-4070-812a-a76677fea9ad', 'volume_name': 'volume-8ab11766-d206-4070-812a-a76677fea9ad', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-cf5bde6f-8d8b-41bf-af06-b96976b45a5a tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a087dc1-de11-4170-bb36-2b58eba41e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-cf5bde6f-8d8b-41bf-af06-b96976b45a5a tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a087dc1-de11-4170-bb36-2b58eba41e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:56 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-cf5bde6f-8d8b-41bf-af06-b96976b45a5a tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02370b75-e296-4925-832f-b61834b4785f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:56 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-cf5bde6f-8d8b-41bf-af06-b96976b45a5a tempest-CreateVolumesFromSnapshotTest-1117622518 None] Volume 8ab11766-d206-4070-812a-a76677fea9ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ab11766-d206-4070-812a-a76677fea9ad', 'volume_size': 1} Aug 28 09:49:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-cf5bde6f-8d8b-41bf-af06-b96976b45a5a tempest-CreateVolumesFromSnapshotTest-1117622518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:56 devstack sudo[104633]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-211783ee-08b8-4403-a5c1-a7b507aba18b tempest-ProjectReaderTests-617012472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-39545fc3-9af9-4c53-b2d1-cafbe4c59077 1073741824" returned: 0 in 0.515s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:56 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-495dc63e-4e4d-430e-ae85-dbf534a47385 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:49:57 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-495dc63e-4e4d-430e-ae85-dbf534a47385 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Flow 'volume_create_manager' (de13ba21-60f8-44bb-b7a1-857d333d58ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:49:57 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-495dc63e-4e4d-430e-ae85-dbf534a47385 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d91b5e48-1594-424d-9136-bd61ba07d1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:57 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-495dc63e-4e4d-430e-ae85-dbf534a47385 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d91b5e48-1594-424d-9136-bd61ba07d1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-269088081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ed05add-3ee3-4db2-92cf-78864d1397f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aae33908983746b98ccde3d1e66e9f74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:57Z,use_quota=True,user_id='19b3519d9ca64c3cb159fe37ee6267f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:57 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-495dc63e-4e4d-430e-ae85-dbf534a47385 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49c88b36-3636-49cd-b65c-cd502cbf662a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:57 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-495dc63e-4e4d-430e-ae85-dbf534a47385 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49c88b36-3636-49cd-b65c-cd502cbf662a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:57 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-495dc63e-4e4d-430e-ae85-dbf534a47385 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa6bb8dd-29c0-4da6-b3c0-6c1e6a8e2e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:57 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-495dc63e-4e4d-430e-ae85-dbf534a47385 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa6bb8dd-29c0-4da6-b3c0-6c1e6a8e2e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ed05add-3ee3-4db2-92cf-78864d1397f7', 'volume_name': 'volume-3ed05add-3ee3-4db2-92cf-78864d1397f7', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:57 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-495dc63e-4e4d-430e-ae85-dbf534a47385 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4de0cbee-13fc-40d5-8fcb-7b6e134d3cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:57 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-495dc63e-4e4d-430e-ae85-dbf534a47385 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4de0cbee-13fc-40d5-8fcb-7b6e134d3cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:57 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-495dc63e-4e4d-430e-ae85-dbf534a47385 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15d5e031-7bd4-42ef-a2a9-86ce92369616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:57 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-495dc63e-4e4d-430e-ae85-dbf534a47385 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Volume 3ed05add-3ee3-4db2-92cf-78864d1397f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ed05add-3ee3-4db2-92cf-78864d1397f7', 'volume_size': 1} Aug 28 09:49:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-495dc63e-4e4d-430e-ae85-dbf534a47385 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-211783ee-08b8-4403-a5c1-a7b507aba18b tempest-ProjectReaderTests-617012472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-39545fc3-9af9-4c53-b2d1-cafbe4c59077 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:57 devstack sudo[104639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-39545fc3-9af9-4c53-b2d1-cafbe4c59077 Aug 28 09:49:57 devstack sudo[104639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:57 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-19937336-651e-4d05-a2c6-84b0509a6340 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:49:57 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-19937336-651e-4d05-a2c6-84b0509a6340 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Flow 'volume_create_manager' (203e6d30-3aa8-4209-92dc-1af66cd5ff8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:49:57 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-19937336-651e-4d05-a2c6-84b0509a6340 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4ea72bf-12e3-47b6-a3cb-b56490bf8984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:57 devstack sudo[104639]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:57 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-19937336-651e-4d05-a2c6-84b0509a6340 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4ea72bf-12e3-47b6-a3cb-b56490bf8984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1613187033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b31fab07-4632-4bb9-87d2-fda3a15bb9c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aae33908983746b98ccde3d1e66e9f74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:57Z,use_quota=True,user_id='19b3519d9ca64c3cb159fe37ee6267f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:57 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-19937336-651e-4d05-a2c6-84b0509a6340 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (221f3339-c8af-41de-aa7f-160514f6b339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:57 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-19937336-651e-4d05-a2c6-84b0509a6340 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (221f3339-c8af-41de-aa7f-160514f6b339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:57 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-19937336-651e-4d05-a2c6-84b0509a6340 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca14317b-e88a-498c-b5c4-b7b6824ab7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:57 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-19937336-651e-4d05-a2c6-84b0509a6340 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca14317b-e88a-498c-b5c4-b7b6824ab7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b31fab07-4632-4bb9-87d2-fda3a15bb9c7', 'volume_name': 'volume-b31fab07-4632-4bb9-87d2-fda3a15bb9c7', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:57 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-19937336-651e-4d05-a2c6-84b0509a6340 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c15027f-20bd-4d2d-bdbe-a60d88985961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:57 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-19937336-651e-4d05-a2c6-84b0509a6340 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c15027f-20bd-4d2d-bdbe-a60d88985961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:57 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-19937336-651e-4d05-a2c6-84b0509a6340 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (832bd77a-95d0-4e99-9ad0-bddb6e325c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:57 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-19937336-651e-4d05-a2c6-84b0509a6340 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Volume b31fab07-4632-4bb9-87d2-fda3a15bb9c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b31fab07-4632-4bb9-87d2-fda3a15bb9c7', 'volume_size': 1} Aug 28 09:49:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-19937336-651e-4d05-a2c6-84b0509a6340 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-211783ee-08b8-4403-a5c1-a7b507aba18b tempest-ProjectReaderTests-617012472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-39545fc3-9af9-4c53-b2d1-cafbe4c59077" returned: 0 in 0.335s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:57 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-211783ee-08b8-4403-a5c1-a7b507aba18b tempest-ProjectReaderTests-617012472 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:49:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-211783ee-08b8-4403-a5c1-a7b507aba18b tempest-ProjectReaderTests-617012472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-6e6558aa-7839-4868-97a0-e68078a5d109 tempest-CinderUnicodeTest-818840768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.810s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:57 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-6e6558aa-7839-4868-97a0-e68078a5d109 tempest-CinderUnicodeTest-818840768 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1abe3f4-755f-4ef4-a26f-cb64f0c7c661,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df14ebaa64c54b4a835bd39c0f4349d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:56Z,use_quota=True,user_id='e0a01d28781c461caa6150e64642401b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:49:57 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-6e6558aa-7839-4868-97a0-e68078a5d109 tempest-CinderUnicodeTest-818840768 None] Creating volume c1abe3f4-755f-4ef4-a26f-cb64f0c7c661 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:49:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-6e6558aa-7839-4868-97a0-e68078a5d109 tempest-CinderUnicodeTest-818840768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-6e6558aa-7839-4868-97a0-e68078a5d109 tempest-CinderUnicodeTest-818840768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:57 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-6e6558aa-7839-4868-97a0-e68078a5d109 tempest-CinderUnicodeTest-818840768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:49:57 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-6e6558aa-7839-4868-97a0-e68078a5d109 tempest-CinderUnicodeTest-818840768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:49:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-6e6558aa-7839-4868-97a0-e68078a5d109 tempest-CinderUnicodeTest-818840768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:57 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-6e6558aa-7839-4868-97a0-e68078a5d109 tempest-CinderUnicodeTest-818840768 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:49:57 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-6e6558aa-7839-4868-97a0-e68078a5d109 tempest-CinderUnicodeTest-818840768 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:49:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6e6558aa-7839-4868-97a0-e68078a5d109 tempest-CinderUnicodeTest-818840768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c1abe3f4-755f-4ef4-a26f-cb64f0c7c661 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:57 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-211783ee-08b8-4403-a5c1-a7b507aba18b tempest-ProjectReaderTests-617012472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f94ec05-f904-40a8-b184-a4cbbe4a7cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39545fc3-9af9-4c53-b2d1-cafbe4c59077', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:57 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-211783ee-08b8-4403-a5c1-a7b507aba18b tempest-ProjectReaderTests-617012472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2569e76-8b3c-46c5-986c-60185034ce4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:57 devstack sudo[104642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c1abe3f4-755f-4ef4-a26f-cb64f0c7c661 1073741824 Aug 28 09:49:57 devstack sudo[104642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:57 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-211783ee-08b8-4403-a5c1-a7b507aba18b tempest-ProjectReaderTests-617012472 None] Volume volume-39545fc3-9af9-4c53-b2d1-cafbe4c59077 (39545fc3-9af9-4c53-b2d1-cafbe4c59077): created successfully Aug 28 09:49:57 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-211783ee-08b8-4403-a5c1-a7b507aba18b tempest-ProjectReaderTests-617012472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2569e76-8b3c-46c5-986c-60185034ce4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:57 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-211783ee-08b8-4403-a5c1-a7b507aba18b tempest-ProjectReaderTests-617012472 None] Flow 'volume_create_manager' (64acac36-fa26-4821-b3ef-d6d9df64590b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:49:57 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-211783ee-08b8-4403-a5c1-a7b507aba18b tempest-ProjectReaderTests-617012472 None] Created volume successfully. Aug 28 09:49:57 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-8874f6e9-f050-44e5-a693-08988ea01d8c tempest-CreateVolumesFromSnapshotTest-1117622518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:49:57 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8874f6e9-f050-44e5-a693-08988ea01d8c tempest-CreateVolumesFromSnapshotTest-1117622518 None] Flow 'volume_create_manager' (516ec937-e1a0-44c9-8a90-1abc394a7411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:49:57 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8874f6e9-f050-44e5-a693-08988ea01d8c tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00f2d807-10ad-4a1a-95cc-a13ad650bc94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:57 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8874f6e9-f050-44e5-a693-08988ea01d8c tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00f2d807-10ad-4a1a-95cc-a13ad650bc94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1180271987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0653976f-a13c-4d85-af33-502d03b350ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aae33908983746b98ccde3d1e66e9f74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:58Z,use_quota=True,user_id='19b3519d9ca64c3cb159fe37ee6267f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:57 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8874f6e9-f050-44e5-a693-08988ea01d8c tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d70f1ed4-78e3-4e25-b52f-6b20d790b31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:57 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8874f6e9-f050-44e5-a693-08988ea01d8c tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d70f1ed4-78e3-4e25-b52f-6b20d790b31e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:57 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8874f6e9-f050-44e5-a693-08988ea01d8c tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f98c3d20-5d16-4c18-ad81-18ea5c0959b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:57 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8874f6e9-f050-44e5-a693-08988ea01d8c tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f98c3d20-5d16-4c18-ad81-18ea5c0959b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0653976f-a13c-4d85-af33-502d03b350ad', 'volume_name': 'volume-0653976f-a13c-4d85-af33-502d03b350ad', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:57 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8874f6e9-f050-44e5-a693-08988ea01d8c tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07e86ef5-f4ce-4d76-81f6-a6242b7705a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:57 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8874f6e9-f050-44e5-a693-08988ea01d8c tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07e86ef5-f4ce-4d76-81f6-a6242b7705a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:57 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8874f6e9-f050-44e5-a693-08988ea01d8c tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (487e0bab-a1d3-4250-a054-a4d7eacf3bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:57 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-8874f6e9-f050-44e5-a693-08988ea01d8c tempest-CreateVolumesFromSnapshotTest-1117622518 None] Volume 0653976f-a13c-4d85-af33-502d03b350ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0653976f-a13c-4d85-af33-502d03b350ad', 'volume_size': 1} Aug 28 09:49:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8874f6e9-f050-44e5-a693-08988ea01d8c tempest-CreateVolumesFromSnapshotTest-1117622518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:57 devstack sudo[104642]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6e6558aa-7839-4868-97a0-e68078a5d109 tempest-CinderUnicodeTest-818840768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c1abe3f4-755f-4ef4-a26f-cb64f0c7c661 1073741824" returned: 0 in 0.458s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6e6558aa-7839-4868-97a0-e68078a5d109 tempest-CinderUnicodeTest-818840768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c1abe3f4-755f-4ef4-a26f-cb64f0c7c661 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:57 devstack sudo[104648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c1abe3f4-755f-4ef4-a26f-cb64f0c7c661 Aug 28 09:49:57 devstack sudo[104648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:58 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-c775b293-0e32-4ae6-86c5-d5c26c3f9ab5 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:49:58 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-c775b293-0e32-4ae6-86c5-d5c26c3f9ab5 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Flow 'volume_create_manager' (7330a9c3-bd47-4060-aeaf-e2164e7864cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:49:58 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-c775b293-0e32-4ae6-86c5-d5c26c3f9ab5 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b59ec95-93da-4c1d-aa25-ba25b82c2768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:58 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-c775b293-0e32-4ae6-86c5-d5c26c3f9ab5 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b59ec95-93da-4c1d-aa25-ba25b82c2768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-145124716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eab16f37-138a-49b5-8191-305aefa83538,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aae33908983746b98ccde3d1e66e9f74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:58Z,use_quota=True,user_id='19b3519d9ca64c3cb159fe37ee6267f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:58 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-c775b293-0e32-4ae6-86c5-d5c26c3f9ab5 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0441805-819a-46aa-8bd9-ef4732c362d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:58 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-c775b293-0e32-4ae6-86c5-d5c26c3f9ab5 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0441805-819a-46aa-8bd9-ef4732c362d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:58 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-c775b293-0e32-4ae6-86c5-d5c26c3f9ab5 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b813821f-ba0b-42f1-8c31-cc34a7ca050e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:58 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-c775b293-0e32-4ae6-86c5-d5c26c3f9ab5 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b813821f-ba0b-42f1-8c31-cc34a7ca050e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eab16f37-138a-49b5-8191-305aefa83538', 'volume_name': 'volume-eab16f37-138a-49b5-8191-305aefa83538', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:58 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-c775b293-0e32-4ae6-86c5-d5c26c3f9ab5 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (856709d6-a23e-420b-bdc7-b6ca91cb2e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:58 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-c775b293-0e32-4ae6-86c5-d5c26c3f9ab5 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (856709d6-a23e-420b-bdc7-b6ca91cb2e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:58 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-c775b293-0e32-4ae6-86c5-d5c26c3f9ab5 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b605a4ef-c29d-40d0-ae57-f4241565aa00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:58 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-c775b293-0e32-4ae6-86c5-d5c26c3f9ab5 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Volume eab16f37-138a-49b5-8191-305aefa83538: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eab16f37-138a-49b5-8191-305aefa83538', 'volume_size': 1} Aug 28 09:49:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-c775b293-0e32-4ae6-86c5-d5c26c3f9ab5 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:58 devstack sudo[104648]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-6e6558aa-7839-4868-97a0-e68078a5d109 tempest-CinderUnicodeTest-818840768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c1abe3f4-755f-4ef4-a26f-cb64f0c7c661" returned: 0 in 0.278s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:58 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-6e6558aa-7839-4868-97a0-e68078a5d109 tempest-CinderUnicodeTest-818840768 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:49:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-6e6558aa-7839-4868-97a0-e68078a5d109 tempest-CinderUnicodeTest-818840768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-dff79692-ab55-4ca7-8a3b-82568f3bc2f3 tempest-ProjectReaderTests-1007845069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.602s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:58 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6e6558aa-7839-4868-97a0-e68078a5d109 tempest-CinderUnicodeTest-818840768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5278faf3-eb0c-4277-8d0a-eb9172a9b765) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1abe3f4-755f-4ef4-a26f-cb64f0c7c661', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:58 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6e6558aa-7839-4868-97a0-e68078a5d109 tempest-CinderUnicodeTest-818840768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3761f33e-816f-4978-903f-6f3d2231bafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:58 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-dff79692-ab55-4ca7-8a3b-82568f3bc2f3 tempest-ProjectReaderTests-1007845069 None] Creating offline snapshot 27738423-f213-47ae-945d-6bc1885b1371 of volume abf07dfb-a9c2-4df6-ac63-89bee6c0cd09 {{(pid=86081) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:49:58 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-6e6558aa-7839-4868-97a0-e68078a5d109 tempest-CinderUnicodeTest-818840768 None] Volume volume-c1abe3f4-755f-4ef4-a26f-cb64f0c7c661 (c1abe3f4-755f-4ef4-a26f-cb64f0c7c661): created successfully Aug 28 09:49:58 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6e6558aa-7839-4868-97a0-e68078a5d109 tempest-CinderUnicodeTest-818840768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3761f33e-816f-4978-903f-6f3d2231bafd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:58 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-6e6558aa-7839-4868-97a0-e68078a5d109 tempest-CinderUnicodeTest-818840768 None] Flow 'volume_create_manager' (03f81b15-42d4-48ba-88d3-5627b33c2d06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:49:58 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed56bdaf-1793-47c0-a500-03eb3f629033]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:49:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-dff79692-ab55-4ca7-8a3b-82568f3bc2f3 tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:58 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-6e6558aa-7839-4868-97a0-e68078a5d109 tempest-CinderUnicodeTest-818840768 None] Created volume successfully. Aug 28 09:49:58 devstack sudo[104651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09 Aug 28 09:49:58 devstack sudo[104651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:58 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-fe09e9ea-b28d-48e8-905e-5a476d3747a9 tempest-ProjectReaderTests-617012472 None] Acquiring lock "cinder-39545fc3-9af9-4c53-b2d1-cafbe4c59077-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:49:58 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-fe09e9ea-b28d-48e8-905e-5a476d3747a9 tempest-ProjectReaderTests-617012472 None] Lock "cinder-39545fc3-9af9-4c53-b2d1-cafbe4c59077-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:49:58 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-fe09e9ea-b28d-48e8-905e-5a476d3747a9 tempest-ProjectReaderTests-617012472 None] Acquiring lock "cinder-quobyte-39545fc3-9af9-4c53-b2d1-cafbe4c59077" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:49:58 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-fe09e9ea-b28d-48e8-905e-5a476d3747a9 tempest-ProjectReaderTests-617012472 None] Lock "cinder-quobyte-39545fc3-9af9-4c53-b2d1-cafbe4c59077" acquired by "delete_volume" :: waited 0.024s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:49:58 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[272c115a-86d3-4192-9d4c-86a76d474ea6]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:49:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fe09e9ea-b28d-48e8-905e-5a476d3747a9 tempest-ProjectReaderTests-617012472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-39545fc3-9af9-4c53-b2d1-cafbe4c59077 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:58 devstack sudo[104654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-39545fc3-9af9-4c53-b2d1-cafbe4c59077 Aug 28 09:49:58 devstack sudo[104654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:58 devstack sudo[104651]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-dff79692-ab55-4ca7-8a3b-82568f3bc2f3 tempest-ProjectReaderTests-1007845069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09" returned: 0 in 0.435s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-dff79692-ab55-4ca7-8a3b-82568f3bc2f3 tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09.27738423-f213-47ae-945d-6bc1885b1371 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:58 devstack sudo[104660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09.27738423-f213-47ae-945d-6bc1885b1371 1G Aug 28 09:49:58 devstack sudo[104660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:58 devstack sudo[104654]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fe09e9ea-b28d-48e8-905e-5a476d3747a9 tempest-ProjectReaderTests-617012472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-39545fc3-9af9-4c53-b2d1-cafbe4c59077" returned: 0 in 0.418s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fe09e9ea-b28d-48e8-905e-5a476d3747a9 tempest-ProjectReaderTests-617012472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-39545fc3-9af9-4c53-b2d1-cafbe4c59077 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:59 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-f907e7ed-aa95-46b0-9af9-294fd0f29b5f tempest-CinderUnicodeTest-818840768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:49:59 devstack sudo[104667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-39545fc3-9af9-4c53-b2d1-cafbe4c59077 Aug 28 09:49:59 devstack sudo[104667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:59 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f907e7ed-aa95-46b0-9af9-294fd0f29b5f tempest-CinderUnicodeTest-818840768 None] Flow 'volume_create_manager' (e9996f55-3034-4173-b747-9f62f455b4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:49:59 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f907e7ed-aa95-46b0-9af9-294fd0f29b5f tempest-CinderUnicodeTest-818840768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7082d7aa-b3f4-46d6-a9a8-e676ca2c5d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:59 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f907e7ed-aa95-46b0-9af9-294fd0f29b5f tempest-CinderUnicodeTest-818840768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7082d7aa-b3f4-46d6-a9a8-e676ca2c5d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:59Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1551720367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a29b8f36-6d9c-4cbd-9d45-092cf70f90e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df14ebaa64c54b4a835bd39c0f4349d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:59Z,use_quota=True,user_id='e0a01d28781c461caa6150e64642401b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:59 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f907e7ed-aa95-46b0-9af9-294fd0f29b5f tempest-CinderUnicodeTest-818840768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d10d19e-4ae4-4a65-ab80-cb53e4534837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:59 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f907e7ed-aa95-46b0-9af9-294fd0f29b5f tempest-CinderUnicodeTest-818840768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d10d19e-4ae4-4a65-ab80-cb53e4534837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:59 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f907e7ed-aa95-46b0-9af9-294fd0f29b5f tempest-CinderUnicodeTest-818840768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (487292a5-b48f-4135-9622-e6a58f561358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:59 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f907e7ed-aa95-46b0-9af9-294fd0f29b5f tempest-CinderUnicodeTest-818840768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (487292a5-b48f-4135-9622-e6a58f561358) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a29b8f36-6d9c-4cbd-9d45-092cf70f90e3', 'volume_name': 'volume-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:59 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f907e7ed-aa95-46b0-9af9-294fd0f29b5f tempest-CinderUnicodeTest-818840768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf96d479-8581-4d05-9202-9a6ee8f14dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:59 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f907e7ed-aa95-46b0-9af9-294fd0f29b5f tempest-CinderUnicodeTest-818840768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf96d479-8581-4d05-9202-9a6ee8f14dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:49:59 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f907e7ed-aa95-46b0-9af9-294fd0f29b5f tempest-CinderUnicodeTest-818840768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6740c1ca-a59f-4231-8629-4271eddfd645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:49:59 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-f907e7ed-aa95-46b0-9af9-294fd0f29b5f tempest-CinderUnicodeTest-818840768 None] Volume a29b8f36-6d9c-4cbd-9d45-092cf70f90e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3', 'volume_size': 1} Aug 28 09:49:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f907e7ed-aa95-46b0-9af9-294fd0f29b5f tempest-CinderUnicodeTest-818840768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:59 devstack sudo[104660]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-dff79692-ab55-4ca7-8a3b-82568f3bc2f3 tempest-ProjectReaderTests-1007845069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09.27738423-f213-47ae-945d-6bc1885b1371 1G" returned: 0 in 0.422s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-dff79692-ab55-4ca7-8a3b-82568f3bc2f3 tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09.27738423-f213-47ae-945d-6bc1885b1371 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:59 devstack sudo[104671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09.27738423-f213-47ae-945d-6bc1885b1371 Aug 28 09:49:59 devstack sudo[104671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:59 devstack sudo[104667]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fe09e9ea-b28d-48e8-905e-5a476d3747a9 tempest-ProjectReaderTests-617012472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-39545fc3-9af9-4c53-b2d1-cafbe4c59077" returned: 0 in 0.283s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:59 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-fe09e9ea-b28d-48e8-905e-5a476d3747a9 tempest-ProjectReaderTests-617012472 None] Lock "cinder-quobyte-39545fc3-9af9-4c53-b2d1-cafbe4c59077" released by "delete_volume" :: held 0.751s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:49:59 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-fe09e9ea-b28d-48e8-905e-5a476d3747a9 tempest-ProjectReaderTests-617012472 None] Created reservations ['80cde7b3-77e8-4619-8900-7b4c5150dce6', 'bba89376-8d80-49a6-ad22-93aeb27d6a24', '5f843a9a-91db-4bd3-a9e0-16ea040f4071', '9aa4a161-3a20-49e4-a7aa-7a4edf33659f'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:49:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-fe09e9ea-b28d-48e8-905e-5a476d3747a9 tempest-ProjectReaderTests-617012472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:49:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-fe09e9ea-b28d-48e8-905e-5a476d3747a9 tempest-ProjectReaderTests-617012472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:49:59 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-fe09e9ea-b28d-48e8-905e-5a476d3747a9 tempest-ProjectReaderTests-617012472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:49:59 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-fe09e9ea-b28d-48e8-905e-5a476d3747a9 tempest-ProjectReaderTests-617012472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:49:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-fe09e9ea-b28d-48e8-905e-5a476d3747a9 tempest-ProjectReaderTests-617012472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:49:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fe09e9ea-b28d-48e8-905e-5a476d3747a9 tempest-ProjectReaderTests-617012472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:59 devstack sudo[104671]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-dff79692-ab55-4ca7-8a3b-82568f3bc2f3 tempest-ProjectReaderTests-1007845069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09.27738423-f213-47ae-945d-6bc1885b1371" returned: 0 in 0.317s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:59 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-dff79692-ab55-4ca7-8a3b-82568f3bc2f3 tempest-ProjectReaderTests-1007845069 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09.27738423-f213-47ae-945d-6bc1885b1371 is being set with open permissions: ugo+rw Aug 28 09:49:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-dff79692-ab55-4ca7-8a3b-82568f3bc2f3 tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09.27738423-f213-47ae-945d-6bc1885b1371 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:59 devstack sudo[104680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:49:59 devstack sudo[104680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:59 devstack sudo[104681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09.27738423-f213-47ae-945d-6bc1885b1371 Aug 28 09:49:59 devstack sudo[104681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:49:59 devstack sudo[104680]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fe09e9ea-b28d-48e8-905e-5a476d3747a9 tempest-ProjectReaderTests-617012472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.269s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:59 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-fe09e9ea-b28d-48e8-905e-5a476d3747a9 tempest-ProjectReaderTests-617012472 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:49:59 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-fe09e9ea-b28d-48e8-905e-5a476d3747a9 tempest-ProjectReaderTests-617012472 None] Deleted volume successfully. Aug 28 09:49:59 devstack sudo[104681]: pam_unix(sudo:session): session closed for user root Aug 28 09:49:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-dff79692-ab55-4ca7-8a3b-82568f3bc2f3 tempest-ProjectReaderTests-1007845069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09.27738423-f213-47ae-945d-6bc1885b1371" returned: 0 in 0.280s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:49:59 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-fe09e9ea-b28d-48e8-905e-5a476d3747a9 tempest-ProjectReaderTests-617012472 None] Lock "cinder-39545fc3-9af9-4c53-b2d1-cafbe4c59077-delete_volume" released by "delete_volume" :: held 1.301s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:49:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-dff79692-ab55-4ca7-8a3b-82568f3bc2f3 tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:49:59 devstack sudo[104686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09.info Aug 28 09:49:59 devstack sudo[104686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:00 devstack sudo[104686]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:00 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-dff79692-ab55-4ca7-8a3b-82568f3bc2f3 tempest-ProjectReaderTests-1007845069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09.info" returned: 0 in 0.269s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:00 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-dff79692-ab55-4ca7-8a3b-82568f3bc2f3 tempest-ProjectReaderTests-1007845069 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09.info is being set with open permissions: ugo+rw Aug 28 09:50:00 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-dff79692-ab55-4ca7-8a3b-82568f3bc2f3 tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:00 devstack sudo[104689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09.info Aug 28 09:50:00 devstack sudo[104689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:00 devstack sudo[104689]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:00 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-dff79692-ab55-4ca7-8a3b-82568f3bc2f3 tempest-ProjectReaderTests-1007845069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09.info" returned: 0 in 0.255s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:00 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-dff79692-ab55-4ca7-8a3b-82568f3bc2f3 tempest-ProjectReaderTests-1007845069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.091s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:00 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-cf5bde6f-8d8b-41bf-af06-b96976b45a5a tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.499s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:00 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-cf5bde6f-8d8b-41bf-af06-b96976b45a5a tempest-CreateVolumesFromSnapshotTest-1117622518 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1041031140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ab11766-d206-4070-812a-a76677fea9ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aae33908983746b98ccde3d1e66e9f74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:57Z,use_quota=True,user_id='19b3519d9ca64c3cb159fe37ee6267f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:50:00 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-cf5bde6f-8d8b-41bf-af06-b96976b45a5a tempest-CreateVolumesFromSnapshotTest-1117622518 None] Creating volume 8ab11766-d206-4070-812a-a76677fea9ad {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:50:00 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-cf5bde6f-8d8b-41bf-af06-b96976b45a5a tempest-CreateVolumesFromSnapshotTest-1117622518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:50:00 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-cf5bde6f-8d8b-41bf-af06-b96976b45a5a tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:00 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-cf5bde6f-8d8b-41bf-af06-b96976b45a5a tempest-CreateVolumesFromSnapshotTest-1117622518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:50:00 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-cf5bde6f-8d8b-41bf-af06-b96976b45a5a tempest-CreateVolumesFromSnapshotTest-1117622518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:50:00 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-cf5bde6f-8d8b-41bf-af06-b96976b45a5a tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:00 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-cf5bde6f-8d8b-41bf-af06-b96976b45a5a tempest-CreateVolumesFromSnapshotTest-1117622518 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:50:00 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-cf5bde6f-8d8b-41bf-af06-b96976b45a5a tempest-CreateVolumesFromSnapshotTest-1117622518 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:50:00 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-cf5bde6f-8d8b-41bf-af06-b96976b45a5a tempest-CreateVolumesFromSnapshotTest-1117622518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8ab11766-d206-4070-812a-a76677fea9ad 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:00 devstack sudo[104692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8ab11766-d206-4070-812a-a76677fea9ad 1073741824 Aug 28 09:50:00 devstack sudo[104692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:00 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-dff79692-ab55-4ca7-8a3b-82568f3bc2f3 tempest-ProjectReaderTests-1007845069 None] Create snapshot completed successfully Aug 28 09:50:00 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-1bef9a47-55cb-4e0a-950f-707d6afce22e tempest-ProjectReaderTests-1007845069 None] Acquiring lock "cinder-27738423-f213-47ae-945d-6bc1885b1371-delete_snapshot" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:00 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-1bef9a47-55cb-4e0a-950f-707d6afce22e tempest-ProjectReaderTests-1007845069 None] Lock "cinder-27738423-f213-47ae-945d-6bc1885b1371-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:00 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-1bef9a47-55cb-4e0a-950f-707d6afce22e tempest-ProjectReaderTests-1007845069 None] Acquiring lock "cinder-quobyte-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:00 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-1bef9a47-55cb-4e0a-950f-707d6afce22e tempest-ProjectReaderTests-1007845069 None] Lock "cinder-quobyte-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:00 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-1bef9a47-55cb-4e0a-950f-707d6afce22e tempest-ProjectReaderTests-1007845069 None] Acquiring lock "cinder-quobyte-27738423-f213-47ae-945d-6bc1885b1371" by "_delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:00 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-1bef9a47-55cb-4e0a-950f-707d6afce22e tempest-ProjectReaderTests-1007845069 None] Lock "cinder-quobyte-27738423-f213-47ae-945d-6bc1885b1371" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:00 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-1bef9a47-55cb-4e0a-950f-707d6afce22e tempest-ProjectReaderTests-1007845069 None] Deleting offline snapshot 27738423-f213-47ae-945d-6bc1885b1371 of volume abf07dfb-a9c2-4df6-ac63-89bee6c0cd09 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:50:00 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-1bef9a47-55cb-4e0a-950f-707d6afce22e tempest-ProjectReaderTests-1007845069 None] snapshot_file for this snap is: volume-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09.27738423-f213-47ae-945d-6bc1885b1371 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:50:00 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[741ca8e1-072a-4ebb-838b-e8e8a4d08c6a]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:50:00 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1bef9a47-55cb-4e0a-950f-707d6afce22e tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09.27738423-f213-47ae-945d-6bc1885b1371 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:00 devstack sudo[104692]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:00 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-cf5bde6f-8d8b-41bf-af06-b96976b45a5a tempest-CreateVolumesFromSnapshotTest-1117622518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8ab11766-d206-4070-812a-a76677fea9ad 1073741824" returned: 0 in 0.516s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:00 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-cf5bde6f-8d8b-41bf-af06-b96976b45a5a tempest-CreateVolumesFromSnapshotTest-1117622518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8ab11766-d206-4070-812a-a76677fea9ad {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:00 devstack sudo[104699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8ab11766-d206-4070-812a-a76677fea9ad Aug 28 09:50:00 devstack sudo[104699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:00 devstack sudo[104698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09.27738423-f213-47ae-945d-6bc1885b1371 Aug 28 09:50:00 devstack sudo[104698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:01 devstack sudo[104699]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-cf5bde6f-8d8b-41bf-af06-b96976b45a5a tempest-CreateVolumesFromSnapshotTest-1117622518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8ab11766-d206-4070-812a-a76677fea9ad" returned: 0 in 0.293s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:01 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-cf5bde6f-8d8b-41bf-af06-b96976b45a5a tempest-CreateVolumesFromSnapshotTest-1117622518 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:50:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-cf5bde6f-8d8b-41bf-af06-b96976b45a5a tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-495dc63e-4e4d-430e-ae85-dbf534a47385 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.123s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:01 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-495dc63e-4e4d-430e-ae85-dbf534a47385 tempest-CreateVolumesFromSnapshotTest-1117622518 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-269088081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ed05add-3ee3-4db2-92cf-78864d1397f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aae33908983746b98ccde3d1e66e9f74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:57Z,use_quota=True,user_id='19b3519d9ca64c3cb159fe37ee6267f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:50:01 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-495dc63e-4e4d-430e-ae85-dbf534a47385 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Creating volume 3ed05add-3ee3-4db2-92cf-78864d1397f7 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:50:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-495dc63e-4e4d-430e-ae85-dbf534a47385 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:50:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-495dc63e-4e4d-430e-ae85-dbf534a47385 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:01 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-495dc63e-4e4d-430e-ae85-dbf534a47385 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:50:01 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-495dc63e-4e4d-430e-ae85-dbf534a47385 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:50:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-495dc63e-4e4d-430e-ae85-dbf534a47385 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:01 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-495dc63e-4e4d-430e-ae85-dbf534a47385 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:50:01 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-495dc63e-4e4d-430e-ae85-dbf534a47385 tempest-CreateVolumesFromSnapshotTest-1117622518 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:50:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-495dc63e-4e4d-430e-ae85-dbf534a47385 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3ed05add-3ee3-4db2-92cf-78864d1397f7 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:01 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-cf5bde6f-8d8b-41bf-af06-b96976b45a5a tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02370b75-e296-4925-832f-b61834b4785f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ab11766-d206-4070-812a-a76677fea9ad', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:01 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-cf5bde6f-8d8b-41bf-af06-b96976b45a5a tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aafb523-7f15-4299-be70-c01df5a83737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:01 devstack sudo[104707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3ed05add-3ee3-4db2-92cf-78864d1397f7 1073741824 Aug 28 09:50:01 devstack sudo[104707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:01 devstack sudo[104698]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1bef9a47-55cb-4e0a-950f-707d6afce22e tempest-ProjectReaderTests-1007845069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09.27738423-f213-47ae-945d-6bc1885b1371" returned: 0 in 0.418s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:01 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-1bef9a47-55cb-4e0a-950f-707d6afce22e tempest-ProjectReaderTests-1007845069 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:50:01 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-cf5bde6f-8d8b-41bf-af06-b96976b45a5a tempest-CreateVolumesFromSnapshotTest-1117622518 None] Volume volume-8ab11766-d206-4070-812a-a76677fea9ad (8ab11766-d206-4070-812a-a76677fea9ad): created successfully Aug 28 09:50:01 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-cf5bde6f-8d8b-41bf-af06-b96976b45a5a tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aafb523-7f15-4299-be70-c01df5a83737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:01 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-cf5bde6f-8d8b-41bf-af06-b96976b45a5a tempest-CreateVolumesFromSnapshotTest-1117622518 None] Flow 'volume_create_manager' (fac89e5e-2e6f-451e-8b9f-45e097896e10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:50:01 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44f2da7-eef5-46b3-bc3f-c09443978cc4]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:50:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1bef9a47-55cb-4e0a-950f-707d6afce22e tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:01 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-cf5bde6f-8d8b-41bf-af06-b96976b45a5a tempest-CreateVolumesFromSnapshotTest-1117622518 None] Created volume successfully. Aug 28 09:50:01 devstack sudo[104709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09 Aug 28 09:50:01 devstack sudo[104709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:01 devstack sudo[104707]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-495dc63e-4e4d-430e-ae85-dbf534a47385 tempest-CreateVolumesFromSnapshotTest-1117622518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3ed05add-3ee3-4db2-92cf-78864d1397f7 1073741824" returned: 0 in 0.470s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:01 devstack sudo[104709]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-495dc63e-4e4d-430e-ae85-dbf534a47385 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3ed05add-3ee3-4db2-92cf-78864d1397f7 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1bef9a47-55cb-4e0a-950f-707d6afce22e tempest-ProjectReaderTests-1007845069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09" returned: 0 in 0.430s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1bef9a47-55cb-4e0a-950f-707d6afce22e tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09.27738423-f213-47ae-945d-6bc1885b1371 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:01 devstack sudo[104718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3ed05add-3ee3-4db2-92cf-78864d1397f7 Aug 28 09:50:01 devstack sudo[104718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:01 devstack sudo[104719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09.27738423-f213-47ae-945d-6bc1885b1371 Aug 28 09:50:01 devstack sudo[104719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:01 devstack sudo[104718]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-495dc63e-4e4d-430e-ae85-dbf534a47385 tempest-CreateVolumesFromSnapshotTest-1117622518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3ed05add-3ee3-4db2-92cf-78864d1397f7" returned: 0 in 0.287s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:01 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-495dc63e-4e4d-430e-ae85-dbf534a47385 tempest-CreateVolumesFromSnapshotTest-1117622518 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:50:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-495dc63e-4e4d-430e-ae85-dbf534a47385 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-19937336-651e-4d05-a2c6-84b0509a6340 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.586s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:01 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-19937336-651e-4d05-a2c6-84b0509a6340 tempest-CreateVolumesFromSnapshotTest-1117622518 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1613187033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b31fab07-4632-4bb9-87d2-fda3a15bb9c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aae33908983746b98ccde3d1e66e9f74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:57Z,use_quota=True,user_id='19b3519d9ca64c3cb159fe37ee6267f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:50:01 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-19937336-651e-4d05-a2c6-84b0509a6340 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Creating volume b31fab07-4632-4bb9-87d2-fda3a15bb9c7 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:50:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-19937336-651e-4d05-a2c6-84b0509a6340 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:50:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-19937336-651e-4d05-a2c6-84b0509a6340 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:02 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-19937336-651e-4d05-a2c6-84b0509a6340 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:50:02 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-19937336-651e-4d05-a2c6-84b0509a6340 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:50:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-19937336-651e-4d05-a2c6-84b0509a6340 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:02 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-19937336-651e-4d05-a2c6-84b0509a6340 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:50:02 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-19937336-651e-4d05-a2c6-84b0509a6340 tempest-CreateVolumesFromSnapshotTest-1117622518 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:50:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-19937336-651e-4d05-a2c6-84b0509a6340 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b31fab07-4632-4bb9-87d2-fda3a15bb9c7 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:02 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-495dc63e-4e4d-430e-ae85-dbf534a47385 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15d5e031-7bd4-42ef-a2a9-86ce92369616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ed05add-3ee3-4db2-92cf-78864d1397f7', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:02 devstack sudo[104726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b31fab07-4632-4bb9-87d2-fda3a15bb9c7 1073741824 Aug 28 09:50:02 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-495dc63e-4e4d-430e-ae85-dbf534a47385 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43fe7d02-5a92-439e-80fd-b4ec8e701243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:02 devstack sudo[104726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:02 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-495dc63e-4e4d-430e-ae85-dbf534a47385 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Volume volume-3ed05add-3ee3-4db2-92cf-78864d1397f7 (3ed05add-3ee3-4db2-92cf-78864d1397f7): created successfully Aug 28 09:50:02 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-495dc63e-4e4d-430e-ae85-dbf534a47385 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43fe7d02-5a92-439e-80fd-b4ec8e701243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:02 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-495dc63e-4e4d-430e-ae85-dbf534a47385 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Flow 'volume_create_manager' (de13ba21-60f8-44bb-b7a1-857d333d58ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:50:02 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-495dc63e-4e4d-430e-ae85-dbf534a47385 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Created volume successfully. Aug 28 09:50:02 devstack sudo[104719]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1bef9a47-55cb-4e0a-950f-707d6afce22e tempest-ProjectReaderTests-1007845069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09.27738423-f213-47ae-945d-6bc1885b1371" returned: 0 in 0.428s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1bef9a47-55cb-4e0a-950f-707d6afce22e tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09.27738423-f213-47ae-945d-6bc1885b1371 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:02 devstack sudo[104729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09.27738423-f213-47ae-945d-6bc1885b1371 Aug 28 09:50:02 devstack sudo[104729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:02 devstack sudo[104729]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1bef9a47-55cb-4e0a-950f-707d6afce22e tempest-ProjectReaderTests-1007845069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09.27738423-f213-47ae-945d-6bc1885b1371" returned: 0 in 0.312s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:02 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-1bef9a47-55cb-4e0a-950f-707d6afce22e tempest-ProjectReaderTests-1007845069 None] Lock "cinder-quobyte-27738423-f213-47ae-945d-6bc1885b1371" released by "_delete_snapshot" :: held 1.701s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:02 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-1bef9a47-55cb-4e0a-950f-707d6afce22e tempest-ProjectReaderTests-1007845069 None] Lock "cinder-quobyte-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09" released by "delete_snapshot" :: held 1.728s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:02 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-1bef9a47-55cb-4e0a-950f-707d6afce22e tempest-ProjectReaderTests-1007845069 None] Created reservations ['9ac8c402-f9b7-4a3d-b3aa-13f05d9f1c3b', '68756f42-9a37-41d0-97a0-771bcc422fb7', '75d90407-7c9b-4930-aa5c-d02abcd6cc26', 'a1b97e19-d50d-412d-84e0-1b77e84e57a1'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:50:02 devstack sudo[104726]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-19937336-651e-4d05-a2c6-84b0509a6340 tempest-CreateVolumesFromSnapshotTest-1117622518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b31fab07-4632-4bb9-87d2-fda3a15bb9c7 1073741824" returned: 0 in 0.574s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-19937336-651e-4d05-a2c6-84b0509a6340 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b31fab07-4632-4bb9-87d2-fda3a15bb9c7 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:02 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-1bef9a47-55cb-4e0a-950f-707d6afce22e tempest-ProjectReaderTests-1007845069 None] Delete snapshot completed successfully. Aug 28 09:50:02 devstack sudo[104736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b31fab07-4632-4bb9-87d2-fda3a15bb9c7 Aug 28 09:50:02 devstack sudo[104736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:02 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-1bef9a47-55cb-4e0a-950f-707d6afce22e tempest-ProjectReaderTests-1007845069 None] Lock "cinder-27738423-f213-47ae-945d-6bc1885b1371-delete_snapshot" released by "delete_snapshot" :: held 1.916s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:02 devstack sudo[104736]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-19937336-651e-4d05-a2c6-84b0509a6340 tempest-CreateVolumesFromSnapshotTest-1117622518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b31fab07-4632-4bb9-87d2-fda3a15bb9c7" returned: 0 in 0.250s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:02 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-19937336-651e-4d05-a2c6-84b0509a6340 tempest-CreateVolumesFromSnapshotTest-1117622518 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:50:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-19937336-651e-4d05-a2c6-84b0509a6340 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8874f6e9-f050-44e5-a693-08988ea01d8c tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.098s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:02 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-8874f6e9-f050-44e5-a693-08988ea01d8c tempest-CreateVolumesFromSnapshotTest-1117622518 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1180271987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0653976f-a13c-4d85-af33-502d03b350ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aae33908983746b98ccde3d1e66e9f74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:58Z,use_quota=True,user_id='19b3519d9ca64c3cb159fe37ee6267f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:50:02 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-8874f6e9-f050-44e5-a693-08988ea01d8c tempest-CreateVolumesFromSnapshotTest-1117622518 None] Creating volume 0653976f-a13c-4d85-af33-502d03b350ad {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:50:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8874f6e9-f050-44e5-a693-08988ea01d8c tempest-CreateVolumesFromSnapshotTest-1117622518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:50:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8874f6e9-f050-44e5-a693-08988ea01d8c tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:02 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-8874f6e9-f050-44e5-a693-08988ea01d8c tempest-CreateVolumesFromSnapshotTest-1117622518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:50:02 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-8874f6e9-f050-44e5-a693-08988ea01d8c tempest-CreateVolumesFromSnapshotTest-1117622518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:50:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8874f6e9-f050-44e5-a693-08988ea01d8c tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:02 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-8874f6e9-f050-44e5-a693-08988ea01d8c tempest-CreateVolumesFromSnapshotTest-1117622518 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:50:02 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-8874f6e9-f050-44e5-a693-08988ea01d8c tempest-CreateVolumesFromSnapshotTest-1117622518 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:50:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8874f6e9-f050-44e5-a693-08988ea01d8c tempest-CreateVolumesFromSnapshotTest-1117622518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-0653976f-a13c-4d85-af33-502d03b350ad 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:02 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-59a62147-9dfc-4620-af0f-5023fc3695f8 tempest-ProjectReaderTests-1007845069 None] Acquiring lock "cinder-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:02 devstack sudo[104739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-0653976f-a13c-4d85-af33-502d03b350ad 1073741824 Aug 28 09:50:02 devstack sudo[104739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:02 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-19937336-651e-4d05-a2c6-84b0509a6340 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (832bd77a-95d0-4e99-9ad0-bddb6e325c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b31fab07-4632-4bb9-87d2-fda3a15bb9c7', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:02 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-19937336-651e-4d05-a2c6-84b0509a6340 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f826245-45c0-43b0-92dc-c6fedbc083f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:02 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-59a62147-9dfc-4620-af0f-5023fc3695f8 tempest-ProjectReaderTests-1007845069 None] Lock "cinder-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:02 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-19937336-651e-4d05-a2c6-84b0509a6340 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Volume volume-b31fab07-4632-4bb9-87d2-fda3a15bb9c7 (b31fab07-4632-4bb9-87d2-fda3a15bb9c7): created successfully Aug 28 09:50:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-19937336-651e-4d05-a2c6-84b0509a6340 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f826245-45c0-43b0-92dc-c6fedbc083f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-19937336-651e-4d05-a2c6-84b0509a6340 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Flow 'volume_create_manager' (203e6d30-3aa8-4209-92dc-1af66cd5ff8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:50:03 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-19937336-651e-4d05-a2c6-84b0509a6340 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Created volume successfully. Aug 28 09:50:03 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-59a62147-9dfc-4620-af0f-5023fc3695f8 tempest-ProjectReaderTests-1007845069 None] Acquiring lock "cinder-quobyte-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:03 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-59a62147-9dfc-4620-af0f-5023fc3695f8 tempest-ProjectReaderTests-1007845069 None] Lock "cinder-quobyte-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09" acquired by "delete_volume" :: waited 0.034s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:03 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b3cffc-0c98-42f9-bc1f-65aca80bf5a6]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:50:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-59a62147-9dfc-4620-af0f-5023fc3695f8 tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:03 devstack sudo[104742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09 Aug 28 09:50:03 devstack sudo[104742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:03 devstack sudo[104739]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8874f6e9-f050-44e5-a693-08988ea01d8c tempest-CreateVolumesFromSnapshotTest-1117622518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-0653976f-a13c-4d85-af33-502d03b350ad 1073741824" returned: 0 in 0.507s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8874f6e9-f050-44e5-a693-08988ea01d8c tempest-CreateVolumesFromSnapshotTest-1117622518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-0653976f-a13c-4d85-af33-502d03b350ad {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:03 devstack sudo[104748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-0653976f-a13c-4d85-af33-502d03b350ad Aug 28 09:50:03 devstack sudo[104748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:03 devstack sudo[104742]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-59a62147-9dfc-4620-af0f-5023fc3695f8 tempest-ProjectReaderTests-1007845069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09" returned: 0 in 0.425s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-59a62147-9dfc-4620-af0f-5023fc3695f8 tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:03 devstack sudo[104753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09 Aug 28 09:50:03 devstack sudo[104753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:03 devstack sudo[104748]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8874f6e9-f050-44e5-a693-08988ea01d8c tempest-CreateVolumesFromSnapshotTest-1117622518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-0653976f-a13c-4d85-af33-502d03b350ad" returned: 0 in 0.306s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:03 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-8874f6e9-f050-44e5-a693-08988ea01d8c tempest-CreateVolumesFromSnapshotTest-1117622518 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:50:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8874f6e9-f050-44e5-a693-08988ea01d8c tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-c775b293-0e32-4ae6-86c5-d5c26c3f9ab5 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.598s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:03 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-c775b293-0e32-4ae6-86c5-d5c26c3f9ab5 tempest-CreateVolumesFromSnapshotTest-1117622518 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-145124716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eab16f37-138a-49b5-8191-305aefa83538,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aae33908983746b98ccde3d1e66e9f74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:58Z,use_quota=True,user_id='19b3519d9ca64c3cb159fe37ee6267f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:50:03 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-c775b293-0e32-4ae6-86c5-d5c26c3f9ab5 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Creating volume eab16f37-138a-49b5-8191-305aefa83538 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:50:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-c775b293-0e32-4ae6-86c5-d5c26c3f9ab5 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:50:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-c775b293-0e32-4ae6-86c5-d5c26c3f9ab5 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:03 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-c775b293-0e32-4ae6-86c5-d5c26c3f9ab5 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:50:03 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-c775b293-0e32-4ae6-86c5-d5c26c3f9ab5 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:50:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-c775b293-0e32-4ae6-86c5-d5c26c3f9ab5 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:03 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-c775b293-0e32-4ae6-86c5-d5c26c3f9ab5 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:50:03 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-c775b293-0e32-4ae6-86c5-d5c26c3f9ab5 tempest-CreateVolumesFromSnapshotTest-1117622518 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:50:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c775b293-0e32-4ae6-86c5-d5c26c3f9ab5 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-eab16f37-138a-49b5-8191-305aefa83538 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:03 devstack sudo[104756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-eab16f37-138a-49b5-8191-305aefa83538 1073741824 Aug 28 09:50:03 devstack sudo[104756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8874f6e9-f050-44e5-a693-08988ea01d8c tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (487e0bab-a1d3-4250-a054-a4d7eacf3bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0653976f-a13c-4d85-af33-502d03b350ad', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8874f6e9-f050-44e5-a693-08988ea01d8c tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2e50774-e1ab-456e-b4ab-a1651486a9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:03 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-8874f6e9-f050-44e5-a693-08988ea01d8c tempest-CreateVolumesFromSnapshotTest-1117622518 None] Volume volume-0653976f-a13c-4d85-af33-502d03b350ad (0653976f-a13c-4d85-af33-502d03b350ad): created successfully Aug 28 09:50:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8874f6e9-f050-44e5-a693-08988ea01d8c tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2e50774-e1ab-456e-b4ab-a1651486a9a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-8874f6e9-f050-44e5-a693-08988ea01d8c tempest-CreateVolumesFromSnapshotTest-1117622518 None] Flow 'volume_create_manager' (516ec937-e1a0-44c9-8a90-1abc394a7411) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:50:03 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6a68b35-d973-40dc-95aa-8d72e100aa2d tempest-ProjectReaderTests-6117886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:50:03 devstack sudo[104753]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a6a68b35-d973-40dc-95aa-8d72e100aa2d tempest-ProjectReaderTests-6117886 None] Flow 'volume_create_manager' (4c8774b0-115a-4408-b6c7-2ee175b10a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:50:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a6a68b35-d973-40dc-95aa-8d72e100aa2d tempest-ProjectReaderTests-6117886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (858b9d22-d081-47fb-9aef-959e7eb5a421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-59a62147-9dfc-4620-af0f-5023fc3695f8 tempest-ProjectReaderTests-1007845069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09" returned: 0 in 0.303s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:03 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-8874f6e9-f050-44e5-a693-08988ea01d8c tempest-CreateVolumesFromSnapshotTest-1117622518 None] Created volume successfully. Aug 28 09:50:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a6a68b35-d973-40dc-95aa-8d72e100aa2d tempest-ProjectReaderTests-6117886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (858b9d22-d081-47fb-9aef-959e7eb5a421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:50:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1661604006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ff8aee1-56d9-462f-84ff-ffb74882b957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab5b18ffc2444a34be7fada14ea01d20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:50:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:50:04Z,use_quota=True,user_id='208954225d424ce792ed89e1459e9e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a6a68b35-d973-40dc-95aa-8d72e100aa2d tempest-ProjectReaderTests-6117886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d590e480-a1f7-48c2-a66b-ad048c9cfc28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a6a68b35-d973-40dc-95aa-8d72e100aa2d tempest-ProjectReaderTests-6117886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d590e480-a1f7-48c2-a66b-ad048c9cfc28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a6a68b35-d973-40dc-95aa-8d72e100aa2d tempest-ProjectReaderTests-6117886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (393b88d9-66ad-466c-8e42-218e734279fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a6a68b35-d973-40dc-95aa-8d72e100aa2d tempest-ProjectReaderTests-6117886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (393b88d9-66ad-466c-8e42-218e734279fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ff8aee1-56d9-462f-84ff-ffb74882b957', 'volume_name': 'volume-3ff8aee1-56d9-462f-84ff-ffb74882b957', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a6a68b35-d973-40dc-95aa-8d72e100aa2d tempest-ProjectReaderTests-6117886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4836a0f2-fa42-484f-9d8d-60c40f78832d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a6a68b35-d973-40dc-95aa-8d72e100aa2d tempest-ProjectReaderTests-6117886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4836a0f2-fa42-484f-9d8d-60c40f78832d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:03 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a6a68b35-d973-40dc-95aa-8d72e100aa2d tempest-ProjectReaderTests-6117886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bc11c59-3c51-4405-91c6-dc066991100b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:03 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-a6a68b35-d973-40dc-95aa-8d72e100aa2d tempest-ProjectReaderTests-6117886 None] Volume 3ff8aee1-56d9-462f-84ff-ffb74882b957: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ff8aee1-56d9-462f-84ff-ffb74882b957', 'volume_size': 1} Aug 28 09:50:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a6a68b35-d973-40dc-95aa-8d72e100aa2d tempest-ProjectReaderTests-6117886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:50:03 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-59a62147-9dfc-4620-af0f-5023fc3695f8 tempest-ProjectReaderTests-1007845069 None] Lock "cinder-quobyte-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09" released by "delete_volume" :: held 0.866s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:04 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-59a62147-9dfc-4620-af0f-5023fc3695f8 tempest-ProjectReaderTests-1007845069 None] Created reservations ['eb348172-497f-4227-920e-3ba88eea6fac', '6ce97db0-766b-4b99-af19-2c3a7ce4e8eb', '97c3f14f-ad33-4e7f-a931-f151da780a4e', '8b12d390-27c8-42b2-a772-67c50db08a1f'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:50:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-59a62147-9dfc-4620-af0f-5023fc3695f8 tempest-ProjectReaderTests-1007845069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:50:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-59a62147-9dfc-4620-af0f-5023fc3695f8 tempest-ProjectReaderTests-1007845069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:04 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-59a62147-9dfc-4620-af0f-5023fc3695f8 tempest-ProjectReaderTests-1007845069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:50:04 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-59a62147-9dfc-4620-af0f-5023fc3695f8 tempest-ProjectReaderTests-1007845069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:50:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-59a62147-9dfc-4620-af0f-5023fc3695f8 tempest-ProjectReaderTests-1007845069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-59a62147-9dfc-4620-af0f-5023fc3695f8 tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:04 devstack sudo[104763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:50:04 devstack sudo[104763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:04 devstack sudo[104756]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c775b293-0e32-4ae6-86c5-d5c26c3f9ab5 tempest-CreateVolumesFromSnapshotTest-1117622518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-eab16f37-138a-49b5-8191-305aefa83538 1073741824" returned: 0 in 0.475s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c775b293-0e32-4ae6-86c5-d5c26c3f9ab5 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-eab16f37-138a-49b5-8191-305aefa83538 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:04 devstack sudo[104765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-eab16f37-138a-49b5-8191-305aefa83538 Aug 28 09:50:04 devstack sudo[104765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:04 devstack sudo[104763]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-59a62147-9dfc-4620-af0f-5023fc3695f8 tempest-ProjectReaderTests-1007845069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.262s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:04 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-59a62147-9dfc-4620-af0f-5023fc3695f8 tempest-ProjectReaderTests-1007845069 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:50:04 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-59a62147-9dfc-4620-af0f-5023fc3695f8 tempest-ProjectReaderTests-1007845069 None] Deleted volume successfully. Aug 28 09:50:04 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-59a62147-9dfc-4620-af0f-5023fc3695f8 tempest-ProjectReaderTests-1007845069 None] Lock "cinder-abf07dfb-a9c2-4df6-ac63-89bee6c0cd09-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:04 devstack sudo[104765]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c775b293-0e32-4ae6-86c5-d5c26c3f9ab5 tempest-CreateVolumesFromSnapshotTest-1117622518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-eab16f37-138a-49b5-8191-305aefa83538" returned: 0 in 0.242s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:04 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-c775b293-0e32-4ae6-86c5-d5c26c3f9ab5 tempest-CreateVolumesFromSnapshotTest-1117622518 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:50:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-c775b293-0e32-4ae6-86c5-d5c26c3f9ab5 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f907e7ed-aa95-46b0-9af9-294fd0f29b5f tempest-CinderUnicodeTest-818840768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.448s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:04 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-f907e7ed-aa95-46b0-9af9-294fd0f29b5f tempest-CinderUnicodeTest-818840768 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:49:59Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1551720367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a29b8f36-6d9c-4cbd-9d45-092cf70f90e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df14ebaa64c54b4a835bd39c0f4349d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:49:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:49:59Z,use_quota=True,user_id='e0a01d28781c461caa6150e64642401b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:50:04 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-f907e7ed-aa95-46b0-9af9-294fd0f29b5f tempest-CinderUnicodeTest-818840768 None] Creating volume a29b8f36-6d9c-4cbd-9d45-092cf70f90e3 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:50:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f907e7ed-aa95-46b0-9af9-294fd0f29b5f tempest-CinderUnicodeTest-818840768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:50:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f907e7ed-aa95-46b0-9af9-294fd0f29b5f tempest-CinderUnicodeTest-818840768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:04 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-f907e7ed-aa95-46b0-9af9-294fd0f29b5f tempest-CinderUnicodeTest-818840768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:50:04 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-f907e7ed-aa95-46b0-9af9-294fd0f29b5f tempest-CinderUnicodeTest-818840768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:50:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f907e7ed-aa95-46b0-9af9-294fd0f29b5f tempest-CinderUnicodeTest-818840768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:04 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-f907e7ed-aa95-46b0-9af9-294fd0f29b5f tempest-CinderUnicodeTest-818840768 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:50:04 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-f907e7ed-aa95-46b0-9af9-294fd0f29b5f tempest-CinderUnicodeTest-818840768 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:50:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f907e7ed-aa95-46b0-9af9-294fd0f29b5f tempest-CinderUnicodeTest-818840768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:04 devstack sudo[104775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3 1073741824 Aug 28 09:50:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-c775b293-0e32-4ae6-86c5-d5c26c3f9ab5 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b605a4ef-c29d-40d0-ae57-f4241565aa00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eab16f37-138a-49b5-8191-305aefa83538', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:04 devstack sudo[104775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-c775b293-0e32-4ae6-86c5-d5c26c3f9ab5 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14ab2ecf-76d6-466f-b711-226e204247b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:04 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-c775b293-0e32-4ae6-86c5-d5c26c3f9ab5 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Volume volume-eab16f37-138a-49b5-8191-305aefa83538 (eab16f37-138a-49b5-8191-305aefa83538): created successfully Aug 28 09:50:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-c775b293-0e32-4ae6-86c5-d5c26c3f9ab5 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14ab2ecf-76d6-466f-b711-226e204247b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:04 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-c775b293-0e32-4ae6-86c5-d5c26c3f9ab5 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Flow 'volume_create_manager' (7330a9c3-bd47-4060-aeaf-e2164e7864cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:50:04 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-c775b293-0e32-4ae6-86c5-d5c26c3f9ab5 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Created volume successfully. Aug 28 09:50:04 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-91c2ee1e-5eda-4807-a7e1-17d0405b7618 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Acquiring lock "cinder-eab16f37-138a-49b5-8191-305aefa83538-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:04 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-91c2ee1e-5eda-4807-a7e1-17d0405b7618 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "cinder-eab16f37-138a-49b5-8191-305aefa83538-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:04 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-91c2ee1e-5eda-4807-a7e1-17d0405b7618 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Acquiring lock "cinder-quobyte-eab16f37-138a-49b5-8191-305aefa83538" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:04 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-91c2ee1e-5eda-4807-a7e1-17d0405b7618 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "cinder-quobyte-eab16f37-138a-49b5-8191-305aefa83538" acquired by "delete_volume" :: waited 0.016s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:04 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1b5924-b6b8-4165-af99-c53d0e4d627b]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:50:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-91c2ee1e-5eda-4807-a7e1-17d0405b7618 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-eab16f37-138a-49b5-8191-305aefa83538 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:04 devstack sudo[104780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-eab16f37-138a-49b5-8191-305aefa83538 Aug 28 09:50:04 devstack sudo[104780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:05 devstack sudo[104775]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f907e7ed-aa95-46b0-9af9-294fd0f29b5f tempest-CinderUnicodeTest-818840768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3 1073741824" returned: 0 in 0.463s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f907e7ed-aa95-46b0-9af9-294fd0f29b5f tempest-CinderUnicodeTest-818840768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:05 devstack sudo[104782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3 Aug 28 09:50:05 devstack sudo[104782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:05 devstack sudo[104780]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-91c2ee1e-5eda-4807-a7e1-17d0405b7618 tempest-CreateVolumesFromSnapshotTest-1117622518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-eab16f37-138a-49b5-8191-305aefa83538" returned: 0 in 0.376s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-91c2ee1e-5eda-4807-a7e1-17d0405b7618 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-eab16f37-138a-49b5-8191-305aefa83538 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:05 devstack sudo[104787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-eab16f37-138a-49b5-8191-305aefa83538 Aug 28 09:50:05 devstack sudo[104787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:05 devstack sudo[104782]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-f907e7ed-aa95-46b0-9af9-294fd0f29b5f tempest-CinderUnicodeTest-818840768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3" returned: 0 in 0.280s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:05 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-f907e7ed-aa95-46b0-9af9-294fd0f29b5f tempest-CinderUnicodeTest-818840768 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:50:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-f907e7ed-aa95-46b0-9af9-294fd0f29b5f tempest-CinderUnicodeTest-818840768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a6a68b35-d973-40dc-95aa-8d72e100aa2d tempest-ProjectReaderTests-6117886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.361s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:05 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-a6a68b35-d973-40dc-95aa-8d72e100aa2d tempest-ProjectReaderTests-6117886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:50:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1661604006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ff8aee1-56d9-462f-84ff-ffb74882b957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab5b18ffc2444a34be7fada14ea01d20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:50:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:50:04Z,use_quota=True,user_id='208954225d424ce792ed89e1459e9e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:50:05 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-a6a68b35-d973-40dc-95aa-8d72e100aa2d tempest-ProjectReaderTests-6117886 None] Creating volume 3ff8aee1-56d9-462f-84ff-ffb74882b957 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:50:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a6a68b35-d973-40dc-95aa-8d72e100aa2d tempest-ProjectReaderTests-6117886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:50:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a6a68b35-d973-40dc-95aa-8d72e100aa2d tempest-ProjectReaderTests-6117886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:05 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-a6a68b35-d973-40dc-95aa-8d72e100aa2d tempest-ProjectReaderTests-6117886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:50:05 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-a6a68b35-d973-40dc-95aa-8d72e100aa2d tempest-ProjectReaderTests-6117886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:50:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a6a68b35-d973-40dc-95aa-8d72e100aa2d tempest-ProjectReaderTests-6117886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:05 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-a6a68b35-d973-40dc-95aa-8d72e100aa2d tempest-ProjectReaderTests-6117886 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:50:05 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-a6a68b35-d973-40dc-95aa-8d72e100aa2d tempest-ProjectReaderTests-6117886 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:50:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a6a68b35-d973-40dc-95aa-8d72e100aa2d tempest-ProjectReaderTests-6117886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3ff8aee1-56d9-462f-84ff-ffb74882b957 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:05 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f907e7ed-aa95-46b0-9af9-294fd0f29b5f tempest-CinderUnicodeTest-818840768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6740c1ca-a59f-4231-8629-4271eddfd645) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:05 devstack sudo[104790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3ff8aee1-56d9-462f-84ff-ffb74882b957 1073741824 Aug 28 09:50:05 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f907e7ed-aa95-46b0-9af9-294fd0f29b5f tempest-CinderUnicodeTest-818840768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53160167-4920-4e15-bba3-ed68ae1c252c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:05 devstack sudo[104790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:05 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-f907e7ed-aa95-46b0-9af9-294fd0f29b5f tempest-CinderUnicodeTest-818840768 None] Volume volume-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3 (a29b8f36-6d9c-4cbd-9d45-092cf70f90e3): created successfully Aug 28 09:50:05 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f907e7ed-aa95-46b0-9af9-294fd0f29b5f tempest-CinderUnicodeTest-818840768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53160167-4920-4e15-bba3-ed68ae1c252c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:05 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-f907e7ed-aa95-46b0-9af9-294fd0f29b5f tempest-CinderUnicodeTest-818840768 None] Flow 'volume_create_manager' (e9996f55-3034-4173-b747-9f62f455b4ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:50:05 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-f907e7ed-aa95-46b0-9af9-294fd0f29b5f tempest-CinderUnicodeTest-818840768 None] Created volume successfully. Aug 28 09:50:05 devstack sudo[104787]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-91c2ee1e-5eda-4807-a7e1-17d0405b7618 tempest-CreateVolumesFromSnapshotTest-1117622518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-eab16f37-138a-49b5-8191-305aefa83538" returned: 0 in 0.298s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:05 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-91c2ee1e-5eda-4807-a7e1-17d0405b7618 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "cinder-quobyte-eab16f37-138a-49b5-8191-305aefa83538" released by "delete_volume" :: held 0.718s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:05 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-91c2ee1e-5eda-4807-a7e1-17d0405b7618 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Created reservations ['635775e9-d7fa-43be-a71e-95a49fc1a1d8', '487f6b02-d107-4a5e-bf5c-dcbb955f1829', 'ff1b26b0-1af2-47a5-b302-49743907cef4', 'd9f6cb89-0c0b-4149-a6d1-dd5bb8a6d76d'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:50:05 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaf0be35-5804-4ace-8bdc-2823d0117573 tempest-ProjectReaderTests-1007845069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:50:05 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-aaf0be35-5804-4ace-8bdc-2823d0117573 tempest-ProjectReaderTests-1007845069 None] Flow 'volume_create_manager' (98bf02e4-8b56-4bc2-b1ca-5a96da496043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:50:05 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-aaf0be35-5804-4ace-8bdc-2823d0117573 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0346fdd3-e8e5-4987-af44-bf69ed7cdacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:05 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-aaf0be35-5804-4ace-8bdc-2823d0117573 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0346fdd3-e8e5-4987-af44-bf69ed7cdacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:50:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1022236380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44e84932-0093-494e-9b61-c9fa48c69ccb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0a1ea6b99c7413e9fb54892d96af172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:50:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:50:06Z,use_quota=True,user_id='40fe0546d5a249bcb1fd3247e64d4590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:05 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-aaf0be35-5804-4ace-8bdc-2823d0117573 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4258464f-da45-4472-bf81-5a51b1828306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:05 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-aaf0be35-5804-4ace-8bdc-2823d0117573 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4258464f-da45-4472-bf81-5a51b1828306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:05 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-aaf0be35-5804-4ace-8bdc-2823d0117573 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71b70334-feab-495d-9ba7-3247b6759a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:05 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-aaf0be35-5804-4ace-8bdc-2823d0117573 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71b70334-feab-495d-9ba7-3247b6759a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44e84932-0093-494e-9b61-c9fa48c69ccb', 'volume_name': 'volume-44e84932-0093-494e-9b61-c9fa48c69ccb', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:05 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-aaf0be35-5804-4ace-8bdc-2823d0117573 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4792c14-05cf-46fa-9279-41640000b2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:05 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-aaf0be35-5804-4ace-8bdc-2823d0117573 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4792c14-05cf-46fa-9279-41640000b2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:05 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-aaf0be35-5804-4ace-8bdc-2823d0117573 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21ce6ee9-6cb9-415a-b0a7-9ce3f3018042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:05 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-aaf0be35-5804-4ace-8bdc-2823d0117573 tempest-ProjectReaderTests-1007845069 None] Volume 44e84932-0093-494e-9b61-c9fa48c69ccb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44e84932-0093-494e-9b61-c9fa48c69ccb', 'volume_size': 1} Aug 28 09:50:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-aaf0be35-5804-4ace-8bdc-2823d0117573 tempest-ProjectReaderTests-1007845069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:50:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-91c2ee1e-5eda-4807-a7e1-17d0405b7618 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:50:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-91c2ee1e-5eda-4807-a7e1-17d0405b7618 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:05 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-91c2ee1e-5eda-4807-a7e1-17d0405b7618 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:50:05 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-91c2ee1e-5eda-4807-a7e1-17d0405b7618 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:50:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-91c2ee1e-5eda-4807-a7e1-17d0405b7618 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-91c2ee1e-5eda-4807-a7e1-17d0405b7618 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:05 devstack sudo[104797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:50:05 devstack sudo[104797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:05 devstack sudo[104790]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a6a68b35-d973-40dc-95aa-8d72e100aa2d tempest-ProjectReaderTests-6117886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3ff8aee1-56d9-462f-84ff-ffb74882b957 1073741824" returned: 0 in 0.527s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a6a68b35-d973-40dc-95aa-8d72e100aa2d tempest-ProjectReaderTests-6117886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3ff8aee1-56d9-462f-84ff-ffb74882b957 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:05 devstack sudo[104799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3ff8aee1-56d9-462f-84ff-ffb74882b957 Aug 28 09:50:05 devstack sudo[104799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:05 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-d087cc98-bc5d-424e-88fd-c1639b225584 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Acquiring lock "cinder-0653976f-a13c-4d85-af33-502d03b350ad-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:05 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-d087cc98-bc5d-424e-88fd-c1639b225584 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "cinder-0653976f-a13c-4d85-af33-502d03b350ad-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:06 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-d087cc98-bc5d-424e-88fd-c1639b225584 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Acquiring lock "cinder-quobyte-0653976f-a13c-4d85-af33-502d03b350ad" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:06 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-d087cc98-bc5d-424e-88fd-c1639b225584 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "cinder-quobyte-0653976f-a13c-4d85-af33-502d03b350ad" acquired by "delete_volume" :: waited 0.015s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:06 devstack sudo[104797]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-91c2ee1e-5eda-4807-a7e1-17d0405b7618 tempest-CreateVolumesFromSnapshotTest-1117622518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.290s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:06 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-91c2ee1e-5eda-4807-a7e1-17d0405b7618 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:50:06 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-91c2ee1e-5eda-4807-a7e1-17d0405b7618 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Deleted volume successfully. Aug 28 09:50:06 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f850bf-d427-4381-a27c-27c3da059ff8]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:50:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d087cc98-bc5d-424e-88fd-c1639b225584 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-0653976f-a13c-4d85-af33-502d03b350ad {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:06 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-91c2ee1e-5eda-4807-a7e1-17d0405b7618 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "cinder-eab16f37-138a-49b5-8191-305aefa83538-delete_volume" released by "delete_volume" :: held 1.311s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:06 devstack sudo[104802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-0653976f-a13c-4d85-af33-502d03b350ad Aug 28 09:50:06 devstack sudo[104802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:06 devstack sudo[104799]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a6a68b35-d973-40dc-95aa-8d72e100aa2d tempest-ProjectReaderTests-6117886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3ff8aee1-56d9-462f-84ff-ffb74882b957" returned: 0 in 0.310s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:06 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-a6a68b35-d973-40dc-95aa-8d72e100aa2d tempest-ProjectReaderTests-6117886 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:50:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a6a68b35-d973-40dc-95aa-8d72e100aa2d tempest-ProjectReaderTests-6117886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-aaf0be35-5804-4ace-8bdc-2823d0117573 tempest-ProjectReaderTests-1007845069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.465s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:06 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-aaf0be35-5804-4ace-8bdc-2823d0117573 tempest-ProjectReaderTests-1007845069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:50:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1022236380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44e84932-0093-494e-9b61-c9fa48c69ccb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0a1ea6b99c7413e9fb54892d96af172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:50:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:50:06Z,use_quota=True,user_id='40fe0546d5a249bcb1fd3247e64d4590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:50:06 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-aaf0be35-5804-4ace-8bdc-2823d0117573 tempest-ProjectReaderTests-1007845069 None] Creating volume 44e84932-0093-494e-9b61-c9fa48c69ccb {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:50:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-aaf0be35-5804-4ace-8bdc-2823d0117573 tempest-ProjectReaderTests-1007845069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:50:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-aaf0be35-5804-4ace-8bdc-2823d0117573 tempest-ProjectReaderTests-1007845069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:06 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-aaf0be35-5804-4ace-8bdc-2823d0117573 tempest-ProjectReaderTests-1007845069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:50:06 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-aaf0be35-5804-4ace-8bdc-2823d0117573 tempest-ProjectReaderTests-1007845069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:50:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-aaf0be35-5804-4ace-8bdc-2823d0117573 tempest-ProjectReaderTests-1007845069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:06 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-aaf0be35-5804-4ace-8bdc-2823d0117573 tempest-ProjectReaderTests-1007845069 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:50:06 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-aaf0be35-5804-4ace-8bdc-2823d0117573 tempest-ProjectReaderTests-1007845069 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:50:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-aaf0be35-5804-4ace-8bdc-2823d0117573 tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44e84932-0093-494e-9b61-c9fa48c69ccb 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:06 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a6a68b35-d973-40dc-95aa-8d72e100aa2d tempest-ProjectReaderTests-6117886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bc11c59-3c51-4405-91c6-dc066991100b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ff8aee1-56d9-462f-84ff-ffb74882b957', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:06 devstack sudo[104805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44e84932-0093-494e-9b61-c9fa48c69ccb 1073741824 Aug 28 09:50:06 devstack sudo[104805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:06 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a6a68b35-d973-40dc-95aa-8d72e100aa2d tempest-ProjectReaderTests-6117886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5555ee3-46b5-4965-91cf-9c6d586ef666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:06 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-a6a68b35-d973-40dc-95aa-8d72e100aa2d tempest-ProjectReaderTests-6117886 None] Volume volume-3ff8aee1-56d9-462f-84ff-ffb74882b957 (3ff8aee1-56d9-462f-84ff-ffb74882b957): created successfully Aug 28 09:50:06 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a6a68b35-d973-40dc-95aa-8d72e100aa2d tempest-ProjectReaderTests-6117886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5555ee3-46b5-4965-91cf-9c6d586ef666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:06 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-a6a68b35-d973-40dc-95aa-8d72e100aa2d tempest-ProjectReaderTests-6117886 None] Flow 'volume_create_manager' (4c8774b0-115a-4408-b6c7-2ee175b10a7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:50:06 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-a6a68b35-d973-40dc-95aa-8d72e100aa2d tempest-ProjectReaderTests-6117886 None] Created volume successfully. Aug 28 09:50:06 devstack sudo[104802]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d087cc98-bc5d-424e-88fd-c1639b225584 tempest-CreateVolumesFromSnapshotTest-1117622518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-0653976f-a13c-4d85-af33-502d03b350ad" returned: 0 in 0.404s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d087cc98-bc5d-424e-88fd-c1639b225584 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-0653976f-a13c-4d85-af33-502d03b350ad {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:06 devstack sudo[104813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-0653976f-a13c-4d85-af33-502d03b350ad Aug 28 09:50:06 devstack sudo[104813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-21cc12ee-f0a4-4380-9c35-480999c35997 tempest-CinderUnicodeTest-818840768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:50:06 devstack sudo[104805]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-aaf0be35-5804-4ace-8bdc-2823d0117573 tempest-ProjectReaderTests-1007845069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44e84932-0093-494e-9b61-c9fa48c69ccb 1073741824" returned: 0 in 0.578s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:06 devstack sudo[104813]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d087cc98-bc5d-424e-88fd-c1639b225584 tempest-CreateVolumesFromSnapshotTest-1117622518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-0653976f-a13c-4d85-af33-502d03b350ad" returned: 0 in 0.343s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:06 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-d087cc98-bc5d-424e-88fd-c1639b225584 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "cinder-quobyte-0653976f-a13c-4d85-af33-502d03b350ad" released by "delete_volume" :: held 0.802s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:06 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-aaf0be35-5804-4ace-8bdc-2823d0117573 tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44e84932-0093-494e-9b61-c9fa48c69ccb {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:06 devstack sudo[104819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44e84932-0093-494e-9b61-c9fa48c69ccb Aug 28 09:50:06 devstack sudo[104819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:06 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-d087cc98-bc5d-424e-88fd-c1639b225584 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Created reservations ['86c864e4-0efc-47f7-8ee1-4e8cb6a922d9', '09ce0ad0-6cb7-4b40-b5c5-ce7b28c0e2bc', '2b04dc64-6dda-44c0-b014-e0152e40709d', 'e17ea45d-a28f-4935-a707-892774df9d44'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:50:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-d087cc98-bc5d-424e-88fd-c1639b225584 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:50:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-d087cc98-bc5d-424e-88fd-c1639b225584 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:07 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-d087cc98-bc5d-424e-88fd-c1639b225584 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:50:07 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-d087cc98-bc5d-424e-88fd-c1639b225584 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:50:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-d087cc98-bc5d-424e-88fd-c1639b225584 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d087cc98-bc5d-424e-88fd-c1639b225584 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:07 devstack sudo[104821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:50:07 devstack sudo[104821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:07 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c1ac8654-4584-41b7-8d02-b566698e2952 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Acquiring lock "cinder-b31fab07-4632-4bb9-87d2-fda3a15bb9c7-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:07 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c1ac8654-4584-41b7-8d02-b566698e2952 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "cinder-b31fab07-4632-4bb9-87d2-fda3a15bb9c7-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:07 devstack sudo[104819]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-aaf0be35-5804-4ace-8bdc-2823d0117573 tempest-ProjectReaderTests-1007845069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44e84932-0093-494e-9b61-c9fa48c69ccb" returned: 0 in 0.350s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:07 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-aaf0be35-5804-4ace-8bdc-2823d0117573 tempest-ProjectReaderTests-1007845069 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:50:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-aaf0be35-5804-4ace-8bdc-2823d0117573 tempest-ProjectReaderTests-1007845069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-21cc12ee-f0a4-4380-9c35-480999c35997 tempest-CinderUnicodeTest-818840768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.507s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:07 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c1ac8654-4584-41b7-8d02-b566698e2952 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Acquiring lock "cinder-quobyte-b31fab07-4632-4bb9-87d2-fda3a15bb9c7" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:07 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-582f19ce-7d57-47c9-adf8-36187b946ac8 tempest-ProjectReaderTests-6117886 None] Acquiring lock "cinder-3ff8aee1-56d9-462f-84ff-ffb74882b957-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:07 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-aaf0be35-5804-4ace-8bdc-2823d0117573 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21ce6ee9-6cb9-415a-b0a7-9ce3f3018042) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44e84932-0093-494e-9b61-c9fa48c69ccb', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:07 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-aaf0be35-5804-4ace-8bdc-2823d0117573 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (128451c8-82d4-406e-b242-a6d2b5de7e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:07 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-21cc12ee-f0a4-4380-9c35-480999c35997 tempest-CinderUnicodeTest-818840768 None] Creating offline snapshot 29b88444-068e-4bfd-a59a-0f0332cb720f of volume a29b8f36-6d9c-4cbd-9d45-092cf70f90e3 {{(pid=86081) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:50:07 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c1ac8654-4584-41b7-8d02-b566698e2952 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "cinder-quobyte-b31fab07-4632-4bb9-87d2-fda3a15bb9c7" acquired by "delete_volume" :: waited 0.053s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:07 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-582f19ce-7d57-47c9-adf8-36187b946ac8 tempest-ProjectReaderTests-6117886 None] Lock "cinder-3ff8aee1-56d9-462f-84ff-ffb74882b957-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:07 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[f849eac3-a166-4bc1-a9f2-fa81d7a0b8aa]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:50:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-21cc12ee-f0a4-4380-9c35-480999c35997 tempest-CinderUnicodeTest-818840768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:07 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-aaf0be35-5804-4ace-8bdc-2823d0117573 tempest-ProjectReaderTests-1007845069 None] Volume volume-44e84932-0093-494e-9b61-c9fa48c69ccb (44e84932-0093-494e-9b61-c9fa48c69ccb): created successfully Aug 28 09:50:07 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-aaf0be35-5804-4ace-8bdc-2823d0117573 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (128451c8-82d4-406e-b242-a6d2b5de7e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:07 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-aaf0be35-5804-4ace-8bdc-2823d0117573 tempest-ProjectReaderTests-1007845069 None] Flow 'volume_create_manager' (98bf02e4-8b56-4bc2-b1ca-5a96da496043) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:50:07 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[287e26ac-8733-4c37-8d96-d3237f94a644]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:50:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c1ac8654-4584-41b7-8d02-b566698e2952 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b31fab07-4632-4bb9-87d2-fda3a15bb9c7 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:07 devstack sudo[104821]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d087cc98-bc5d-424e-88fd-c1639b225584 tempest-CreateVolumesFromSnapshotTest-1117622518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.316s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:07 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-aaf0be35-5804-4ace-8bdc-2823d0117573 tempest-ProjectReaderTests-1007845069 None] Created volume successfully. Aug 28 09:50:07 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-d087cc98-bc5d-424e-88fd-c1639b225584 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:50:07 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-d087cc98-bc5d-424e-88fd-c1639b225584 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Deleted volume successfully. Aug 28 09:50:07 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-582f19ce-7d57-47c9-adf8-36187b946ac8 tempest-ProjectReaderTests-6117886 None] Acquiring lock "cinder-quobyte-3ff8aee1-56d9-462f-84ff-ffb74882b957" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:07 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-d087cc98-bc5d-424e-88fd-c1639b225584 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "cinder-0653976f-a13c-4d85-af33-502d03b350ad-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:07 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-582f19ce-7d57-47c9-adf8-36187b946ac8 tempest-ProjectReaderTests-6117886 None] Lock "cinder-quobyte-3ff8aee1-56d9-462f-84ff-ffb74882b957" acquired by "delete_volume" :: waited 0.019s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:07 devstack sudo[104825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3 Aug 28 09:50:07 devstack sudo[104825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:07 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[981ae25b-59e3-4579-afdf-8baceaa228c4]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:50:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-582f19ce-7d57-47c9-adf8-36187b946ac8 tempest-ProjectReaderTests-6117886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3ff8aee1-56d9-462f-84ff-ffb74882b957 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:07 devstack sudo[104826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b31fab07-4632-4bb9-87d2-fda3a15bb9c7 Aug 28 09:50:07 devstack sudo[104826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:07 devstack sudo[104828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3ff8aee1-56d9-462f-84ff-ffb74882b957 Aug 28 09:50:07 devstack sudo[104828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:07 devstack sudo[104825]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-21cc12ee-f0a4-4380-9c35-480999c35997 tempest-CinderUnicodeTest-818840768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3" returned: 0 in 0.421s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-21cc12ee-f0a4-4380-9c35-480999c35997 tempest-CinderUnicodeTest-818840768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3.29b88444-068e-4bfd-a59a-0f0332cb720f 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:07 devstack sudo[104826]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:07 devstack sudo[104838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3.29b88444-068e-4bfd-a59a-0f0332cb720f 1G Aug 28 09:50:07 devstack sudo[104838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c1ac8654-4584-41b7-8d02-b566698e2952 tempest-CreateVolumesFromSnapshotTest-1117622518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b31fab07-4632-4bb9-87d2-fda3a15bb9c7" returned: 0 in 0.430s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c1ac8654-4584-41b7-8d02-b566698e2952 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b31fab07-4632-4bb9-87d2-fda3a15bb9c7 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:07 devstack sudo[104841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b31fab07-4632-4bb9-87d2-fda3a15bb9c7 Aug 28 09:50:07 devstack sudo[104841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:07 devstack sudo[104828]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-582f19ce-7d57-47c9-adf8-36187b946ac8 tempest-ProjectReaderTests-6117886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3ff8aee1-56d9-462f-84ff-ffb74882b957" returned: 0 in 0.428s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-582f19ce-7d57-47c9-adf8-36187b946ac8 tempest-ProjectReaderTests-6117886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3ff8aee1-56d9-462f-84ff-ffb74882b957 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:07 devstack sudo[104845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3ff8aee1-56d9-462f-84ff-ffb74882b957 Aug 28 09:50:07 devstack sudo[104845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-76119df8-639a-47bc-b360-f07af426006a tempest-ProjectReaderTests-1007845069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:50:08 devstack sudo[104841]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c1ac8654-4584-41b7-8d02-b566698e2952 tempest-CreateVolumesFromSnapshotTest-1117622518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b31fab07-4632-4bb9-87d2-fda3a15bb9c7" returned: 0 in 0.321s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:08 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c1ac8654-4584-41b7-8d02-b566698e2952 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "cinder-quobyte-b31fab07-4632-4bb9-87d2-fda3a15bb9c7" released by "delete_volume" :: held 0.823s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:08 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-c1ac8654-4584-41b7-8d02-b566698e2952 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Created reservations ['5241e662-7ec8-4997-b8d5-85a74411411b', '62259fa4-f809-497d-8ef2-d212547f0939', '6f741d6b-d843-401f-b11d-3aa819092b12', '18ef327e-34a2-4493-9a7d-ad4c8c6b82fb'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:50:08 devstack sudo[104845]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-582f19ce-7d57-47c9-adf8-36187b946ac8 tempest-ProjectReaderTests-6117886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3ff8aee1-56d9-462f-84ff-ffb74882b957" returned: 0 in 0.328s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:08 devstack sudo[104838]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:08 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-582f19ce-7d57-47c9-adf8-36187b946ac8 tempest-ProjectReaderTests-6117886 None] Lock "cinder-quobyte-3ff8aee1-56d9-462f-84ff-ffb74882b957" released by "delete_volume" :: held 0.808s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-21cc12ee-f0a4-4380-9c35-480999c35997 tempest-CinderUnicodeTest-818840768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3.29b88444-068e-4bfd-a59a-0f0332cb720f 1G" returned: 0 in 0.519s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-21cc12ee-f0a4-4380-9c35-480999c35997 tempest-CinderUnicodeTest-818840768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3.29b88444-068e-4bfd-a59a-0f0332cb720f {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-c1ac8654-4584-41b7-8d02-b566698e2952 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:50:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-c1ac8654-4584-41b7-8d02-b566698e2952 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:08 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-c1ac8654-4584-41b7-8d02-b566698e2952 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:50:08 devstack sudo[104853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3.29b88444-068e-4bfd-a59a-0f0332cb720f Aug 28 09:50:08 devstack sudo[104853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:08 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-c1ac8654-4584-41b7-8d02-b566698e2952 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:50:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-c1ac8654-4584-41b7-8d02-b566698e2952 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c1ac8654-4584-41b7-8d02-b566698e2952 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:08 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-99a3ca8d-03ce-4222-84e6-a35f9de806d7 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Acquiring lock "cinder-3ed05add-3ee3-4db2-92cf-78864d1397f7-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:08 devstack sudo[104855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:50:08 devstack sudo[104855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:08 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-99a3ca8d-03ce-4222-84e6-a35f9de806d7 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "cinder-3ed05add-3ee3-4db2-92cf-78864d1397f7-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:08 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-582f19ce-7d57-47c9-adf8-36187b946ac8 tempest-ProjectReaderTests-6117886 None] Created reservations ['d8f90052-9770-4e18-ab38-72b83b34936e', 'be91852b-b9cf-487f-a5f5-ebf6bff35906', 'be60e7f0-e803-4032-9793-d77f7b2d7d11', '2cf2f31d-cdfd-4d9f-afa7-ed85f3028f71'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:50:08 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-99a3ca8d-03ce-4222-84e6-a35f9de806d7 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Acquiring lock "cinder-quobyte-3ed05add-3ee3-4db2-92cf-78864d1397f7" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:08 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-99a3ca8d-03ce-4222-84e6-a35f9de806d7 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "cinder-quobyte-3ed05add-3ee3-4db2-92cf-78864d1397f7" acquired by "delete_volume" :: waited 0.025s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-582f19ce-7d57-47c9-adf8-36187b946ac8 tempest-ProjectReaderTests-6117886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:50:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-582f19ce-7d57-47c9-adf8-36187b946ac8 tempest-ProjectReaderTests-6117886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:08 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-582f19ce-7d57-47c9-adf8-36187b946ac8 tempest-ProjectReaderTests-6117886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:50:08 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-582f19ce-7d57-47c9-adf8-36187b946ac8 tempest-ProjectReaderTests-6117886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:50:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-582f19ce-7d57-47c9-adf8-36187b946ac8 tempest-ProjectReaderTests-6117886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-582f19ce-7d57-47c9-adf8-36187b946ac8 tempest-ProjectReaderTests-6117886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:08 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[4574a9ef-223e-416d-a62e-5fc22385cf35]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:50:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-99a3ca8d-03ce-4222-84e6-a35f9de806d7 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3ed05add-3ee3-4db2-92cf-78864d1397f7 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:08 devstack sudo[104858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:50:08 devstack sudo[104858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:08 devstack sudo[104855]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c1ac8654-4584-41b7-8d02-b566698e2952 tempest-CreateVolumesFromSnapshotTest-1117622518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.301s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:08 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-c1ac8654-4584-41b7-8d02-b566698e2952 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:50:08 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-c1ac8654-4584-41b7-8d02-b566698e2952 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Deleted volume successfully. Aug 28 09:50:08 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c1ac8654-4584-41b7-8d02-b566698e2952 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "cinder-b31fab07-4632-4bb9-87d2-fda3a15bb9c7-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:08 devstack sudo[104853]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-21cc12ee-f0a4-4380-9c35-480999c35997 tempest-CinderUnicodeTest-818840768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3.29b88444-068e-4bfd-a59a-0f0332cb720f" returned: 0 in 0.399s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:08 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-21cc12ee-f0a4-4380-9c35-480999c35997 tempest-CinderUnicodeTest-818840768 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3.29b88444-068e-4bfd-a59a-0f0332cb720f is being set with open permissions: ugo+rw Aug 28 09:50:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-21cc12ee-f0a4-4380-9c35-480999c35997 tempest-CinderUnicodeTest-818840768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3.29b88444-068e-4bfd-a59a-0f0332cb720f {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:08 devstack sudo[104861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3ed05add-3ee3-4db2-92cf-78864d1397f7 Aug 28 09:50:08 devstack sudo[104861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:08 devstack sudo[104864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3.29b88444-068e-4bfd-a59a-0f0332cb720f Aug 28 09:50:08 devstack sudo[104864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:08 devstack sudo[104858]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-582f19ce-7d57-47c9-adf8-36187b946ac8 tempest-ProjectReaderTests-6117886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.266s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:08 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-582f19ce-7d57-47c9-adf8-36187b946ac8 tempest-ProjectReaderTests-6117886 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:50:08 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-582f19ce-7d57-47c9-adf8-36187b946ac8 tempest-ProjectReaderTests-6117886 None] Deleted volume successfully. Aug 28 09:50:08 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-582f19ce-7d57-47c9-adf8-36187b946ac8 tempest-ProjectReaderTests-6117886 None] Lock "cinder-3ff8aee1-56d9-462f-84ff-ffb74882b957-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:08 devstack sudo[104864]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-21cc12ee-f0a4-4380-9c35-480999c35997 tempest-CinderUnicodeTest-818840768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3.29b88444-068e-4bfd-a59a-0f0332cb720f" returned: 0 in 0.260s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:08 devstack sudo[104861]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-99a3ca8d-03ce-4222-84e6-a35f9de806d7 tempest-CreateVolumesFromSnapshotTest-1117622518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3ed05add-3ee3-4db2-92cf-78864d1397f7" returned: 0 in 0.392s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-99a3ca8d-03ce-4222-84e6-a35f9de806d7 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3ed05add-3ee3-4db2-92cf-78864d1397f7 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-21cc12ee-f0a4-4380-9c35-480999c35997 tempest-CinderUnicodeTest-818840768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:09 devstack sudo[104872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3ed05add-3ee3-4db2-92cf-78864d1397f7 Aug 28 09:50:09 devstack sudo[104872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:09 devstack sudo[104874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3.info Aug 28 09:50:09 devstack sudo[104874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:09 devstack sudo[104872]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-99a3ca8d-03ce-4222-84e6-a35f9de806d7 tempest-CreateVolumesFromSnapshotTest-1117622518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-3ed05add-3ee3-4db2-92cf-78864d1397f7" returned: 0 in 0.274s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:09 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-99a3ca8d-03ce-4222-84e6-a35f9de806d7 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "cinder-quobyte-3ed05add-3ee3-4db2-92cf-78864d1397f7" released by "delete_volume" :: held 0.741s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:09 devstack sudo[104874]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-21cc12ee-f0a4-4380-9c35-480999c35997 tempest-CinderUnicodeTest-818840768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3.info" returned: 0 in 0.277s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:09 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-21cc12ee-f0a4-4380-9c35-480999c35997 tempest-CinderUnicodeTest-818840768 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3.info is being set with open permissions: ugo+rw Aug 28 09:50:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-21cc12ee-f0a4-4380-9c35-480999c35997 tempest-CinderUnicodeTest-818840768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:09 devstack sudo[104878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3.info Aug 28 09:50:09 devstack sudo[104878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:09 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-99a3ca8d-03ce-4222-84e6-a35f9de806d7 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Created reservations ['49ff9d10-4016-4c2d-a8b2-36cd65d01d82', 'c78508db-c7d8-4aaf-a4be-b05e2d9bb01b', '7a8ca7ba-80d9-4612-ad8e-235ad5219a37', 'f53f80dd-2ad6-45e3-9fa2-f15ea1c4b331'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:50:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-99a3ca8d-03ce-4222-84e6-a35f9de806d7 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:50:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-99a3ca8d-03ce-4222-84e6-a35f9de806d7 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:09 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-99a3ca8d-03ce-4222-84e6-a35f9de806d7 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:50:09 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-99a3ca8d-03ce-4222-84e6-a35f9de806d7 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:50:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-99a3ca8d-03ce-4222-84e6-a35f9de806d7 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-99a3ca8d-03ce-4222-84e6-a35f9de806d7 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:09 devstack sudo[104881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:50:09 devstack sudo[104881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:09 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ae764571-72fe-4803-8877-3fab4dd41eba tempest-CreateVolumesFromSnapshotTest-1117622518 None] Acquiring lock "cinder-8ab11766-d206-4070-812a-a76677fea9ad-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:09 devstack sudo[104878]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-21cc12ee-f0a4-4380-9c35-480999c35997 tempest-CinderUnicodeTest-818840768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3.info" returned: 0 in 0.311s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-21cc12ee-f0a4-4380-9c35-480999c35997 tempest-CinderUnicodeTest-818840768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.342s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-76119df8-639a-47bc-b360-f07af426006a tempest-ProjectReaderTests-1007845069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.581s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:09 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ae764571-72fe-4803-8877-3fab4dd41eba tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "cinder-8ab11766-d206-4070-812a-a76677fea9ad-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:09 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-76119df8-639a-47bc-b360-f07af426006a tempest-ProjectReaderTests-1007845069 None] Creating offline snapshot dd38fbc3-85fa-48a1-af7f-46b474284013 of volume 44e84932-0093-494e-9b61-c9fa48c69ccb {{(pid=86081) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:50:09 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[060cb3a6-490f-4f7c-8e8f-21d7687926ce]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:50:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-76119df8-639a-47bc-b360-f07af426006a tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44e84932-0093-494e-9b61-c9fa48c69ccb {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:09 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-21cc12ee-f0a4-4380-9c35-480999c35997 tempest-CinderUnicodeTest-818840768 None] Create snapshot completed successfully Aug 28 09:50:09 devstack sudo[104881]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:09 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ae764571-72fe-4803-8877-3fab4dd41eba tempest-CreateVolumesFromSnapshotTest-1117622518 None] Acquiring lock "cinder-quobyte-8ab11766-d206-4070-812a-a76677fea9ad" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-99a3ca8d-03ce-4222-84e6-a35f9de806d7 tempest-CreateVolumesFromSnapshotTest-1117622518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.327s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:09 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-99a3ca8d-03ce-4222-84e6-a35f9de806d7 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:50:09 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-99a3ca8d-03ce-4222-84e6-a35f9de806d7 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Deleted volume successfully. Aug 28 09:50:09 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ae764571-72fe-4803-8877-3fab4dd41eba tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "cinder-quobyte-8ab11766-d206-4070-812a-a76677fea9ad" acquired by "delete_volume" :: waited 0.033s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:09 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-99a3ca8d-03ce-4222-84e6-a35f9de806d7 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "cinder-3ed05add-3ee3-4db2-92cf-78864d1397f7-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:09 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eaed4cf-e2f4-485b-aa9a-10cad9591f6f]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:50:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ae764571-72fe-4803-8877-3fab4dd41eba tempest-CreateVolumesFromSnapshotTest-1117622518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8ab11766-d206-4070-812a-a76677fea9ad {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:09 devstack sudo[104885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44e84932-0093-494e-9b61-c9fa48c69ccb Aug 28 09:50:09 devstack sudo[104885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:09 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4dbaded7-19d8-41d1-a03d-e29ca6390bbb tempest-CinderUnicodeTest-818840768 None] Acquiring lock "cinder-29b88444-068e-4bfd-a59a-0f0332cb720f-delete_snapshot" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:09 devstack sudo[104886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8ab11766-d206-4070-812a-a76677fea9ad Aug 28 09:50:09 devstack sudo[104886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:10 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4dbaded7-19d8-41d1-a03d-e29ca6390bbb tempest-CinderUnicodeTest-818840768 None] Lock "cinder-29b88444-068e-4bfd-a59a-0f0332cb720f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:10 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4dbaded7-19d8-41d1-a03d-e29ca6390bbb tempest-CinderUnicodeTest-818840768 None] Acquiring lock "cinder-quobyte-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:10 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4dbaded7-19d8-41d1-a03d-e29ca6390bbb tempest-CinderUnicodeTest-818840768 None] Lock "cinder-quobyte-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:10 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4dbaded7-19d8-41d1-a03d-e29ca6390bbb tempest-CinderUnicodeTest-818840768 None] Acquiring lock "cinder-quobyte-29b88444-068e-4bfd-a59a-0f0332cb720f" by "_delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:10 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4dbaded7-19d8-41d1-a03d-e29ca6390bbb tempest-CinderUnicodeTest-818840768 None] Lock "cinder-quobyte-29b88444-068e-4bfd-a59a-0f0332cb720f" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:10 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-4dbaded7-19d8-41d1-a03d-e29ca6390bbb tempest-CinderUnicodeTest-818840768 None] Deleting offline snapshot 29b88444-068e-4bfd-a59a-0f0332cb720f of volume a29b8f36-6d9c-4cbd-9d45-092cf70f90e3 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:50:10 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-4dbaded7-19d8-41d1-a03d-e29ca6390bbb tempest-CinderUnicodeTest-818840768 None] snapshot_file for this snap is: volume-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3.29b88444-068e-4bfd-a59a-0f0332cb720f {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:50:10 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c62b94e-bfd4-4dd1-a2a6-633d04e1a1ce]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:50:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4dbaded7-19d8-41d1-a03d-e29ca6390bbb tempest-CinderUnicodeTest-818840768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3.29b88444-068e-4bfd-a59a-0f0332cb720f {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:10 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-19c43cf2-0fdf-49a3-8fa7-fc39a6b387f7 tempest-ProjectReaderTests-6117886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:50:10 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-19c43cf2-0fdf-49a3-8fa7-fc39a6b387f7 tempest-ProjectReaderTests-6117886 None] Flow 'volume_create_manager' (5853a41a-b4a6-434e-ba51-7a62739d15e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:50:10 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-19c43cf2-0fdf-49a3-8fa7-fc39a6b387f7 tempest-ProjectReaderTests-6117886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a339ce6-53ae-4632-8fd6-d4af5c596a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:10 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-19c43cf2-0fdf-49a3-8fa7-fc39a6b387f7 tempest-ProjectReaderTests-6117886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a339ce6-53ae-4632-8fd6-d4af5c596a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:50:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1370478562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85e983b9-e915-4cd7-9fb7-5443f4595ce1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab5b18ffc2444a34be7fada14ea01d20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:50:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:50:10Z,use_quota=True,user_id='208954225d424ce792ed89e1459e9e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:10 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-19c43cf2-0fdf-49a3-8fa7-fc39a6b387f7 tempest-ProjectReaderTests-6117886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c3e8370-c030-4198-b7b4-9edb2b8f9047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:10 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-19c43cf2-0fdf-49a3-8fa7-fc39a6b387f7 tempest-ProjectReaderTests-6117886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c3e8370-c030-4198-b7b4-9edb2b8f9047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:10 devstack sudo[104885]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:10 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-19c43cf2-0fdf-49a3-8fa7-fc39a6b387f7 tempest-ProjectReaderTests-6117886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfe361d3-fb55-4a47-b1ea-4d8c1be772fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:10 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-19c43cf2-0fdf-49a3-8fa7-fc39a6b387f7 tempest-ProjectReaderTests-6117886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfe361d3-fb55-4a47-b1ea-4d8c1be772fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85e983b9-e915-4cd7-9fb7-5443f4595ce1', 'volume_name': 'volume-85e983b9-e915-4cd7-9fb7-5443f4595ce1', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:10 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-19c43cf2-0fdf-49a3-8fa7-fc39a6b387f7 tempest-ProjectReaderTests-6117886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee653da6-aa0a-4473-ae84-d233e6b47ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:10 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-19c43cf2-0fdf-49a3-8fa7-fc39a6b387f7 tempest-ProjectReaderTests-6117886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee653da6-aa0a-4473-ae84-d233e6b47ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:10 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-19c43cf2-0fdf-49a3-8fa7-fc39a6b387f7 tempest-ProjectReaderTests-6117886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (945e1375-1e09-425f-ac28-4cc67455c7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:10 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-19c43cf2-0fdf-49a3-8fa7-fc39a6b387f7 tempest-ProjectReaderTests-6117886 None] Volume 85e983b9-e915-4cd7-9fb7-5443f4595ce1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85e983b9-e915-4cd7-9fb7-5443f4595ce1', 'volume_size': 1} Aug 28 09:50:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-19c43cf2-0fdf-49a3-8fa7-fc39a6b387f7 tempest-ProjectReaderTests-6117886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:50:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-76119df8-639a-47bc-b360-f07af426006a tempest-ProjectReaderTests-1007845069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44e84932-0093-494e-9b61-c9fa48c69ccb" returned: 0 in 0.534s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-76119df8-639a-47bc-b360-f07af426006a tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44e84932-0093-494e-9b61-c9fa48c69ccb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44e84932-0093-494e-9b61-c9fa48c69ccb.dd38fbc3-85fa-48a1-af7f-46b474284013 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:10 devstack sudo[104890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3.29b88444-068e-4bfd-a59a-0f0332cb720f Aug 28 09:50:10 devstack sudo[104890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:10 devstack sudo[104894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44e84932-0093-494e-9b61-c9fa48c69ccb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44e84932-0093-494e-9b61-c9fa48c69ccb.dd38fbc3-85fa-48a1-af7f-46b474284013 1G Aug 28 09:50:10 devstack sudo[104894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:10 devstack sudo[104886]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ae764571-72fe-4803-8877-3fab4dd41eba tempest-CreateVolumesFromSnapshotTest-1117622518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8ab11766-d206-4070-812a-a76677fea9ad" returned: 0 in 0.512s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ae764571-72fe-4803-8877-3fab4dd41eba tempest-CreateVolumesFromSnapshotTest-1117622518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8ab11766-d206-4070-812a-a76677fea9ad {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:10 devstack sudo[104900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8ab11766-d206-4070-812a-a76677fea9ad Aug 28 09:50:10 devstack sudo[104900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:10 devstack sudo[104890]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4dbaded7-19d8-41d1-a03d-e29ca6390bbb tempest-CinderUnicodeTest-818840768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3.29b88444-068e-4bfd-a59a-0f0332cb720f" returned: 0 in 0.402s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:10 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-4dbaded7-19d8-41d1-a03d-e29ca6390bbb tempest-CinderUnicodeTest-818840768 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:50:10 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[750f2b9a-0a66-476f-814b-74ad8ce80d15]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:50:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4dbaded7-19d8-41d1-a03d-e29ca6390bbb tempest-CinderUnicodeTest-818840768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:10 devstack sudo[104900]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ae764571-72fe-4803-8877-3fab4dd41eba tempest-CreateVolumesFromSnapshotTest-1117622518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8ab11766-d206-4070-812a-a76677fea9ad" returned: 0 in 0.285s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:10 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ae764571-72fe-4803-8877-3fab4dd41eba tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "cinder-quobyte-8ab11766-d206-4070-812a-a76677fea9ad" released by "delete_volume" :: held 0.853s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:10 devstack sudo[104894]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-76119df8-639a-47bc-b360-f07af426006a tempest-ProjectReaderTests-1007845069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44e84932-0093-494e-9b61-c9fa48c69ccb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44e84932-0093-494e-9b61-c9fa48c69ccb.dd38fbc3-85fa-48a1-af7f-46b474284013 1G" returned: 0 in 0.414s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-76119df8-639a-47bc-b360-f07af426006a tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44e84932-0093-494e-9b61-c9fa48c69ccb -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44e84932-0093-494e-9b61-c9fa48c69ccb.dd38fbc3-85fa-48a1-af7f-46b474284013 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:10 devstack sudo[104908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3 Aug 28 09:50:10 devstack sudo[104908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:10 devstack sudo[104910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44e84932-0093-494e-9b61-c9fa48c69ccb -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44e84932-0093-494e-9b61-c9fa48c69ccb.dd38fbc3-85fa-48a1-af7f-46b474284013 Aug 28 09:50:10 devstack sudo[104910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:10 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-ae764571-72fe-4803-8877-3fab4dd41eba tempest-CreateVolumesFromSnapshotTest-1117622518 None] Created reservations ['b527f045-6a20-447e-8b79-43e449c75c59', 'b1dad5aa-e43a-44a0-9436-e1b014a439ef', 'bce66cab-a940-4165-af52-abb875abdff8', 'b95319a7-4f08-4df5-8d0c-c4fd4b6ac739'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:50:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ae764571-72fe-4803-8877-3fab4dd41eba tempest-CreateVolumesFromSnapshotTest-1117622518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:50:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ae764571-72fe-4803-8877-3fab4dd41eba tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:10 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ae764571-72fe-4803-8877-3fab4dd41eba tempest-CreateVolumesFromSnapshotTest-1117622518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:50:10 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ae764571-72fe-4803-8877-3fab4dd41eba tempest-CreateVolumesFromSnapshotTest-1117622518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:50:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ae764571-72fe-4803-8877-3fab4dd41eba tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ae764571-72fe-4803-8877-3fab4dd41eba tempest-CreateVolumesFromSnapshotTest-1117622518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:10 devstack sudo[104913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:50:10 devstack sudo[104913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:10 devstack sudo[104910]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-76119df8-639a-47bc-b360-f07af426006a tempest-ProjectReaderTests-1007845069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44e84932-0093-494e-9b61-c9fa48c69ccb -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44e84932-0093-494e-9b61-c9fa48c69ccb.dd38fbc3-85fa-48a1-af7f-46b474284013" returned: 0 in 0.321s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:10 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-76119df8-639a-47bc-b360-f07af426006a tempest-ProjectReaderTests-1007845069 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44e84932-0093-494e-9b61-c9fa48c69ccb.dd38fbc3-85fa-48a1-af7f-46b474284013 is being set with open permissions: ugo+rw Aug 28 09:50:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-76119df8-639a-47bc-b360-f07af426006a tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44e84932-0093-494e-9b61-c9fa48c69ccb.dd38fbc3-85fa-48a1-af7f-46b474284013 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:10 devstack sudo[104921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44e84932-0093-494e-9b61-c9fa48c69ccb.dd38fbc3-85fa-48a1-af7f-46b474284013 Aug 28 09:50:10 devstack sudo[104908]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:10 devstack sudo[104921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4dbaded7-19d8-41d1-a03d-e29ca6390bbb tempest-CinderUnicodeTest-818840768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3" returned: 0 in 0.463s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4dbaded7-19d8-41d1-a03d-e29ca6390bbb tempest-CinderUnicodeTest-818840768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3.29b88444-068e-4bfd-a59a-0f0332cb720f {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:11 devstack sudo[104923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3.29b88444-068e-4bfd-a59a-0f0332cb720f Aug 28 09:50:11 devstack sudo[104923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:11 devstack sudo[104913]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ae764571-72fe-4803-8877-3fab4dd41eba tempest-CreateVolumesFromSnapshotTest-1117622518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.303s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:11 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-ae764571-72fe-4803-8877-3fab4dd41eba tempest-CreateVolumesFromSnapshotTest-1117622518 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:50:11 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-ae764571-72fe-4803-8877-3fab4dd41eba tempest-CreateVolumesFromSnapshotTest-1117622518 None] Deleted volume successfully. Aug 28 09:50:11 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-ae764571-72fe-4803-8877-3fab4dd41eba tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "cinder-8ab11766-d206-4070-812a-a76677fea9ad-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:11 devstack sudo[104921]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-76119df8-639a-47bc-b360-f07af426006a tempest-ProjectReaderTests-1007845069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44e84932-0093-494e-9b61-c9fa48c69ccb.dd38fbc3-85fa-48a1-af7f-46b474284013" returned: 0 in 0.270s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-76119df8-639a-47bc-b360-f07af426006a tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44e84932-0093-494e-9b61-c9fa48c69ccb.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:11 devstack sudo[104930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44e84932-0093-494e-9b61-c9fa48c69ccb.info Aug 28 09:50:11 devstack sudo[104930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:11 devstack sudo[104923]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4dbaded7-19d8-41d1-a03d-e29ca6390bbb tempest-CinderUnicodeTest-818840768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3.29b88444-068e-4bfd-a59a-0f0332cb720f" returned: 0 in 0.373s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4dbaded7-19d8-41d1-a03d-e29ca6390bbb tempest-CinderUnicodeTest-818840768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3.29b88444-068e-4bfd-a59a-0f0332cb720f {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:11 devstack sudo[104932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3.29b88444-068e-4bfd-a59a-0f0332cb720f Aug 28 09:50:11 devstack sudo[104932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:11 devstack sudo[104930]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-76119df8-639a-47bc-b360-f07af426006a tempest-ProjectReaderTests-1007845069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44e84932-0093-494e-9b61-c9fa48c69ccb.info" returned: 0 in 0.270s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:11 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-76119df8-639a-47bc-b360-f07af426006a tempest-ProjectReaderTests-1007845069 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44e84932-0093-494e-9b61-c9fa48c69ccb.info is being set with open permissions: ugo+rw Aug 28 09:50:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-76119df8-639a-47bc-b360-f07af426006a tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44e84932-0093-494e-9b61-c9fa48c69ccb.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:11 devstack sudo[104935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44e84932-0093-494e-9b61-c9fa48c69ccb.info Aug 28 09:50:11 devstack sudo[104935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:11 devstack sudo[104932]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4dbaded7-19d8-41d1-a03d-e29ca6390bbb tempest-CinderUnicodeTest-818840768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3.29b88444-068e-4bfd-a59a-0f0332cb720f" returned: 0 in 0.254s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:11 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4dbaded7-19d8-41d1-a03d-e29ca6390bbb tempest-CinderUnicodeTest-818840768 None] Lock "cinder-quobyte-29b88444-068e-4bfd-a59a-0f0332cb720f" released by "_delete_snapshot" :: held 1.602s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:11 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4dbaded7-19d8-41d1-a03d-e29ca6390bbb tempest-CinderUnicodeTest-818840768 None] Lock "cinder-quobyte-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3" released by "delete_snapshot" :: held 1.632s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:11 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-4dbaded7-19d8-41d1-a03d-e29ca6390bbb tempest-CinderUnicodeTest-818840768 None] Created reservations ['06ce09d8-e8c9-47a5-a2ae-e050ad29fa0b', '95fae9f4-78dc-474d-977d-2f19e746e2c3', 'dcaedacb-f143-4593-9237-f3c596689f6b', '072d45b0-8e38-4af3-a9ac-26ea5b68dde2'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:50:11 devstack sudo[104935]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-76119df8-639a-47bc-b360-f07af426006a tempest-ProjectReaderTests-1007845069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44e84932-0093-494e-9b61-c9fa48c69ccb.info" returned: 0 in 0.268s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-76119df8-639a-47bc-b360-f07af426006a tempest-ProjectReaderTests-1007845069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.189s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-19c43cf2-0fdf-49a3-8fa7-fc39a6b387f7 tempest-ProjectReaderTests-6117886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.600s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:11 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-19c43cf2-0fdf-49a3-8fa7-fc39a6b387f7 tempest-ProjectReaderTests-6117886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:50:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1370478562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85e983b9-e915-4cd7-9fb7-5443f4595ce1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab5b18ffc2444a34be7fada14ea01d20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:50:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:50:10Z,use_quota=True,user_id='208954225d424ce792ed89e1459e9e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:50:11 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-19c43cf2-0fdf-49a3-8fa7-fc39a6b387f7 tempest-ProjectReaderTests-6117886 None] Creating volume 85e983b9-e915-4cd7-9fb7-5443f4595ce1 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:50:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-19c43cf2-0fdf-49a3-8fa7-fc39a6b387f7 tempest-ProjectReaderTests-6117886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:50:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-19c43cf2-0fdf-49a3-8fa7-fc39a6b387f7 tempest-ProjectReaderTests-6117886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:11 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-19c43cf2-0fdf-49a3-8fa7-fc39a6b387f7 tempest-ProjectReaderTests-6117886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:50:11 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-19c43cf2-0fdf-49a3-8fa7-fc39a6b387f7 tempest-ProjectReaderTests-6117886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:50:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-19c43cf2-0fdf-49a3-8fa7-fc39a6b387f7 tempest-ProjectReaderTests-6117886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:11 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-19c43cf2-0fdf-49a3-8fa7-fc39a6b387f7 tempest-ProjectReaderTests-6117886 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:50:11 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-19c43cf2-0fdf-49a3-8fa7-fc39a6b387f7 tempest-ProjectReaderTests-6117886 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:50:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-19c43cf2-0fdf-49a3-8fa7-fc39a6b387f7 tempest-ProjectReaderTests-6117886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-85e983b9-e915-4cd7-9fb7-5443f4595ce1 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:11 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-4dbaded7-19d8-41d1-a03d-e29ca6390bbb tempest-CinderUnicodeTest-818840768 None] Delete snapshot completed successfully. Aug 28 09:50:11 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2e697b4c-6da9-4d27-bcd1-28674ee3d839 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Acquiring lock "cinder-022772fd-676c-4808-b0ce-88cf9b85d963-delete_snapshot" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:11 devstack sudo[104939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-85e983b9-e915-4cd7-9fb7-5443f4595ce1 1073741824 Aug 28 09:50:11 devstack sudo[104939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:11 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4dbaded7-19d8-41d1-a03d-e29ca6390bbb tempest-CinderUnicodeTest-818840768 None] Lock "cinder-29b88444-068e-4bfd-a59a-0f0332cb720f-delete_snapshot" released by "delete_snapshot" :: held 1.855s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:11 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2e697b4c-6da9-4d27-bcd1-28674ee3d839 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "cinder-022772fd-676c-4808-b0ce-88cf9b85d963-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:11 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2e697b4c-6da9-4d27-bcd1-28674ee3d839 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Acquiring lock "cinder-quobyte-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:11 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-76119df8-639a-47bc-b360-f07af426006a tempest-ProjectReaderTests-1007845069 None] Create snapshot completed successfully Aug 28 09:50:11 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2e697b4c-6da9-4d27-bcd1-28674ee3d839 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "cinder-quobyte-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:11 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2e697b4c-6da9-4d27-bcd1-28674ee3d839 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Acquiring lock "cinder-quobyte-022772fd-676c-4808-b0ce-88cf9b85d963" by "_delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:11 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2e697b4c-6da9-4d27-bcd1-28674ee3d839 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "cinder-quobyte-022772fd-676c-4808-b0ce-88cf9b85d963" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:11 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-2e697b4c-6da9-4d27-bcd1-28674ee3d839 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Deleting offline snapshot 022772fd-676c-4808-b0ce-88cf9b85d963 of volume 464f3f82-06e2-4d2f-a459-aa86c9e0d4f9 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:50:11 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-2e697b4c-6da9-4d27-bcd1-28674ee3d839 tempest-CreateVolumesFromSnapshotTest-1117622518 None] snapshot_file for this snap is: volume-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9.022772fd-676c-4808-b0ce-88cf9b85d963 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:50:11 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3711de-e63f-4e0f-84ec-9be55f923225]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:50:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2e697b4c-6da9-4d27-bcd1-28674ee3d839 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9.022772fd-676c-4808-b0ce-88cf9b85d963 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:12 devstack sudo[104941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9.022772fd-676c-4808-b0ce-88cf9b85d963 Aug 28 09:50:12 devstack sudo[104941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:12 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-09dc9343-9e0e-41db-923d-4400ae4fd275 tempest-CinderUnicodeTest-818840768 None] Acquiring lock "cinder-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:12 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-09dc9343-9e0e-41db-923d-4400ae4fd275 tempest-CinderUnicodeTest-818840768 None] Lock "cinder-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:12 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-0208c572-ed52-4408-8049-63419eba4c69 tempest-ProjectReaderTests-1007845069 None] Acquiring lock "cinder-dd38fbc3-85fa-48a1-af7f-46b474284013-delete_snapshot" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:12 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-09dc9343-9e0e-41db-923d-4400ae4fd275 tempest-CinderUnicodeTest-818840768 None] Acquiring lock "cinder-quobyte-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:12 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-0208c572-ed52-4408-8049-63419eba4c69 tempest-ProjectReaderTests-1007845069 None] Lock "cinder-dd38fbc3-85fa-48a1-af7f-46b474284013-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:12 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-0208c572-ed52-4408-8049-63419eba4c69 tempest-ProjectReaderTests-1007845069 None] Acquiring lock "cinder-quobyte-44e84932-0093-494e-9b61-c9fa48c69ccb" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:12 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-09dc9343-9e0e-41db-923d-4400ae4fd275 tempest-CinderUnicodeTest-818840768 None] Lock "cinder-quobyte-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3" acquired by "delete_volume" :: waited 0.027s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:12 devstack sudo[104939]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-19c43cf2-0fdf-49a3-8fa7-fc39a6b387f7 tempest-ProjectReaderTests-6117886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-85e983b9-e915-4cd7-9fb7-5443f4595ce1 1073741824" returned: 0 in 0.509s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:12 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-0208c572-ed52-4408-8049-63419eba4c69 tempest-ProjectReaderTests-1007845069 None] Lock "cinder-quobyte-44e84932-0093-494e-9b61-c9fa48c69ccb" acquired by "delete_snapshot" :: waited 0.051s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:12 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-0208c572-ed52-4408-8049-63419eba4c69 tempest-ProjectReaderTests-1007845069 None] Acquiring lock "cinder-quobyte-dd38fbc3-85fa-48a1-af7f-46b474284013" by "_delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:12 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[db71b70a-5634-4e02-af7b-63740d24abcc]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:50:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-09dc9343-9e0e-41db-923d-4400ae4fd275 tempest-CinderUnicodeTest-818840768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:12 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-0208c572-ed52-4408-8049-63419eba4c69 tempest-ProjectReaderTests-1007845069 None] Lock "cinder-quobyte-dd38fbc3-85fa-48a1-af7f-46b474284013" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:12 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-0208c572-ed52-4408-8049-63419eba4c69 tempest-ProjectReaderTests-1007845069 None] Deleting offline snapshot dd38fbc3-85fa-48a1-af7f-46b474284013 of volume 44e84932-0093-494e-9b61-c9fa48c69ccb {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:50:12 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-0208c572-ed52-4408-8049-63419eba4c69 tempest-ProjectReaderTests-1007845069 None] snapshot_file for this snap is: volume-44e84932-0093-494e-9b61-c9fa48c69ccb.dd38fbc3-85fa-48a1-af7f-46b474284013 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:50:12 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[781ff3f7-1f20-47ae-9207-8d5bb4311627]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:50:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-19c43cf2-0fdf-49a3-8fa7-fc39a6b387f7 tempest-ProjectReaderTests-6117886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-85e983b9-e915-4cd7-9fb7-5443f4595ce1 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0208c572-ed52-4408-8049-63419eba4c69 tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44e84932-0093-494e-9b61-c9fa48c69ccb.dd38fbc3-85fa-48a1-af7f-46b474284013 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:12 devstack sudo[104941]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2e697b4c-6da9-4d27-bcd1-28674ee3d839 tempest-CreateVolumesFromSnapshotTest-1117622518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9.022772fd-676c-4808-b0ce-88cf9b85d963" returned: 0 in 0.501s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:12 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-2e697b4c-6da9-4d27-bcd1-28674ee3d839 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:50:12 devstack sudo[104952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-85e983b9-e915-4cd7-9fb7-5443f4595ce1 Aug 28 09:50:12 devstack sudo[104952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:12 devstack sudo[104948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3 Aug 28 09:50:12 devstack sudo[104948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:12 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a1b7df-0440-4d12-9946-5976cceec126]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:50:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2e697b4c-6da9-4d27-bcd1-28674ee3d839 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:12 devstack sudo[104953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44e84932-0093-494e-9b61-c9fa48c69ccb.dd38fbc3-85fa-48a1-af7f-46b474284013 Aug 28 09:50:12 devstack sudo[104953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:12 devstack sudo[104956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9 Aug 28 09:50:12 devstack sudo[104956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:12 devstack sudo[104952]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-19c43cf2-0fdf-49a3-8fa7-fc39a6b387f7 tempest-ProjectReaderTests-6117886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-85e983b9-e915-4cd7-9fb7-5443f4595ce1" returned: 0 in 0.286s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:12 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-19c43cf2-0fdf-49a3-8fa7-fc39a6b387f7 tempest-ProjectReaderTests-6117886 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:50:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-19c43cf2-0fdf-49a3-8fa7-fc39a6b387f7 tempest-ProjectReaderTests-6117886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:12 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-19c43cf2-0fdf-49a3-8fa7-fc39a6b387f7 tempest-ProjectReaderTests-6117886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (945e1375-1e09-425f-ac28-4cc67455c7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85e983b9-e915-4cd7-9fb7-5443f4595ce1', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:12 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-19c43cf2-0fdf-49a3-8fa7-fc39a6b387f7 tempest-ProjectReaderTests-6117886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5913c62e-4c5e-4fb7-abb7-bcfc01e11ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:12 devstack sudo[104948]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-09dc9343-9e0e-41db-923d-4400ae4fd275 tempest-CinderUnicodeTest-818840768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3" returned: 0 in 0.408s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-09dc9343-9e0e-41db-923d-4400ae4fd275 tempest-CinderUnicodeTest-818840768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:12 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-19c43cf2-0fdf-49a3-8fa7-fc39a6b387f7 tempest-ProjectReaderTests-6117886 None] Volume volume-85e983b9-e915-4cd7-9fb7-5443f4595ce1 (85e983b9-e915-4cd7-9fb7-5443f4595ce1): created successfully Aug 28 09:50:12 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-19c43cf2-0fdf-49a3-8fa7-fc39a6b387f7 tempest-ProjectReaderTests-6117886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5913c62e-4c5e-4fb7-abb7-bcfc01e11ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:12 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-19c43cf2-0fdf-49a3-8fa7-fc39a6b387f7 tempest-ProjectReaderTests-6117886 None] Flow 'volume_create_manager' (5853a41a-b4a6-434e-ba51-7a62739d15e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:50:12 devstack sudo[104964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3 Aug 28 09:50:12 devstack sudo[104964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:12 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-19c43cf2-0fdf-49a3-8fa7-fc39a6b387f7 tempest-ProjectReaderTests-6117886 None] Created volume successfully. Aug 28 09:50:12 devstack sudo[104953]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0208c572-ed52-4408-8049-63419eba4c69 tempest-ProjectReaderTests-1007845069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44e84932-0093-494e-9b61-c9fa48c69ccb.dd38fbc3-85fa-48a1-af7f-46b474284013" returned: 0 in 0.429s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:12 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-0208c572-ed52-4408-8049-63419eba4c69 tempest-ProjectReaderTests-1007845069 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44e84932-0093-494e-9b61-c9fa48c69ccb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:50:12 devstack sudo[104956]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2e697b4c-6da9-4d27-bcd1-28674ee3d839 tempest-CreateVolumesFromSnapshotTest-1117622518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9" returned: 0 in 0.396s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2e697b4c-6da9-4d27-bcd1-28674ee3d839 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9.022772fd-676c-4808-b0ce-88cf9b85d963 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:12 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[19de9e85-7717-4827-ad7c-e4bf8ab4eecb]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:50:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0208c572-ed52-4408-8049-63419eba4c69 tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44e84932-0093-494e-9b61-c9fa48c69ccb {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:12 devstack sudo[104973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9.022772fd-676c-4808-b0ce-88cf9b85d963 Aug 28 09:50:12 devstack sudo[104973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:13 devstack sudo[104974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44e84932-0093-494e-9b61-c9fa48c69ccb Aug 28 09:50:13 devstack sudo[104974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:13 devstack sudo[104964]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-09dc9343-9e0e-41db-923d-4400ae4fd275 tempest-CinderUnicodeTest-818840768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3" returned: 0 in 0.283s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:13 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-09dc9343-9e0e-41db-923d-4400ae4fd275 tempest-CinderUnicodeTest-818840768 None] Lock "cinder-quobyte-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3" released by "delete_volume" :: held 0.760s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:13 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-09dc9343-9e0e-41db-923d-4400ae4fd275 tempest-CinderUnicodeTest-818840768 None] Created reservations ['37d61892-3c40-4b79-ad75-f13782fb8252', '16606611-cfc8-4d27-b040-2966694a2742', '391c79c1-f7ef-4605-b627-3c452660e590', '65532bfd-7a62-41e9-8f17-f925ee368272'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:50:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-09dc9343-9e0e-41db-923d-4400ae4fd275 tempest-CinderUnicodeTest-818840768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:50:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-09dc9343-9e0e-41db-923d-4400ae4fd275 tempest-CinderUnicodeTest-818840768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:13 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-09dc9343-9e0e-41db-923d-4400ae4fd275 tempest-CinderUnicodeTest-818840768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:50:13 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-09dc9343-9e0e-41db-923d-4400ae4fd275 tempest-CinderUnicodeTest-818840768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:50:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-09dc9343-9e0e-41db-923d-4400ae4fd275 tempest-CinderUnicodeTest-818840768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-09dc9343-9e0e-41db-923d-4400ae4fd275 tempest-CinderUnicodeTest-818840768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:13 devstack sudo[104982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:50:13 devstack sudo[104982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:13 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a11debca-55f6-4a03-abc1-18eda95cd31c tempest-ProjectReaderTests-6117886 None] Acquiring lock "cinder-85e983b9-e915-4cd7-9fb7-5443f4595ce1-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:13 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a11debca-55f6-4a03-abc1-18eda95cd31c tempest-ProjectReaderTests-6117886 None] Lock "cinder-85e983b9-e915-4cd7-9fb7-5443f4595ce1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:13 devstack sudo[104974]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0208c572-ed52-4408-8049-63419eba4c69 tempest-ProjectReaderTests-1007845069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44e84932-0093-494e-9b61-c9fa48c69ccb" returned: 0 in 0.454s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0208c572-ed52-4408-8049-63419eba4c69 tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44e84932-0093-494e-9b61-c9fa48c69ccb.dd38fbc3-85fa-48a1-af7f-46b474284013 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:13 devstack sudo[104973]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2e697b4c-6da9-4d27-bcd1-28674ee3d839 tempest-CreateVolumesFromSnapshotTest-1117622518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9.022772fd-676c-4808-b0ce-88cf9b85d963" returned: 0 in 0.495s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2e697b4c-6da9-4d27-bcd1-28674ee3d839 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9.022772fd-676c-4808-b0ce-88cf9b85d963 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:13 devstack sudo[104987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44e84932-0093-494e-9b61-c9fa48c69ccb.dd38fbc3-85fa-48a1-af7f-46b474284013 Aug 28 09:50:13 devstack sudo[104987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:13 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8c18b502-6d1d-4d03-9583-09523d841293 tempest-CinderUnicodeTest-818840768 None] Acquiring lock "cinder-c1abe3f4-755f-4ef4-a26f-cb64f0c7c661-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:13 devstack sudo[104988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9.022772fd-676c-4808-b0ce-88cf9b85d963 Aug 28 09:50:13 devstack sudo[104988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:13 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a11debca-55f6-4a03-abc1-18eda95cd31c tempest-ProjectReaderTests-6117886 None] Acquiring lock "cinder-quobyte-85e983b9-e915-4cd7-9fb7-5443f4595ce1" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:13 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a11debca-55f6-4a03-abc1-18eda95cd31c tempest-ProjectReaderTests-6117886 None] Lock "cinder-quobyte-85e983b9-e915-4cd7-9fb7-5443f4595ce1" acquired by "delete_volume" :: waited 0.032s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:13 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8c18b502-6d1d-4d03-9583-09523d841293 tempest-CinderUnicodeTest-818840768 None] Lock "cinder-c1abe3f4-755f-4ef4-a26f-cb64f0c7c661-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:13 devstack sudo[104982]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-09dc9343-9e0e-41db-923d-4400ae4fd275 tempest-CinderUnicodeTest-818840768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.308s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:13 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-09dc9343-9e0e-41db-923d-4400ae4fd275 tempest-CinderUnicodeTest-818840768 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:50:13 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc83c8a7-9c48-4579-bcd6-79a77e33610d]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:50:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a11debca-55f6-4a03-abc1-18eda95cd31c tempest-ProjectReaderTests-6117886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-85e983b9-e915-4cd7-9fb7-5443f4595ce1 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:13 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-09dc9343-9e0e-41db-923d-4400ae4fd275 tempest-CinderUnicodeTest-818840768 None] Deleted volume successfully. Aug 28 09:50:13 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8c18b502-6d1d-4d03-9583-09523d841293 tempest-CinderUnicodeTest-818840768 None] Acquiring lock "cinder-quobyte-c1abe3f4-755f-4ef4-a26f-cb64f0c7c661" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:13 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-09dc9343-9e0e-41db-923d-4400ae4fd275 tempest-CinderUnicodeTest-818840768 None] Lock "cinder-a29b8f36-6d9c-4cbd-9d45-092cf70f90e3-delete_volume" released by "delete_volume" :: held 1.404s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:13 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8c18b502-6d1d-4d03-9583-09523d841293 tempest-CinderUnicodeTest-818840768 None] Lock "cinder-quobyte-c1abe3f4-755f-4ef4-a26f-cb64f0c7c661" acquired by "delete_volume" :: waited 0.025s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:13 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[aebbf932-8f21-4368-b1ea-e8246a4304da]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:50:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8c18b502-6d1d-4d03-9583-09523d841293 tempest-CinderUnicodeTest-818840768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c1abe3f4-755f-4ef4-a26f-cb64f0c7c661 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:13 devstack sudo[104992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-85e983b9-e915-4cd7-9fb7-5443f4595ce1 Aug 28 09:50:13 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:13 devstack sudo[104988]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2e697b4c-6da9-4d27-bcd1-28674ee3d839 tempest-CreateVolumesFromSnapshotTest-1117622518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9.022772fd-676c-4808-b0ce-88cf9b85d963" returned: 0 in 0.359s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:13 devstack sudo[104993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c1abe3f4-755f-4ef4-a26f-cb64f0c7c661 Aug 28 09:50:13 devstack sudo[104993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:13 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2e697b4c-6da9-4d27-bcd1-28674ee3d839 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "cinder-quobyte-022772fd-676c-4808-b0ce-88cf9b85d963" released by "_delete_snapshot" :: held 1.880s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:13 devstack sudo[104987]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:13 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2e697b4c-6da9-4d27-bcd1-28674ee3d839 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "cinder-quobyte-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9" released by "delete_snapshot" :: held 1.906s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0208c572-ed52-4408-8049-63419eba4c69 tempest-ProjectReaderTests-1007845069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44e84932-0093-494e-9b61-c9fa48c69ccb.dd38fbc3-85fa-48a1-af7f-46b474284013" returned: 0 in 0.461s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0208c572-ed52-4408-8049-63419eba4c69 tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44e84932-0093-494e-9b61-c9fa48c69ccb.dd38fbc3-85fa-48a1-af7f-46b474284013 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:13 devstack sudo[105001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44e84932-0093-494e-9b61-c9fa48c69ccb.dd38fbc3-85fa-48a1-af7f-46b474284013 Aug 28 09:50:13 devstack sudo[105001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:13 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-2e697b4c-6da9-4d27-bcd1-28674ee3d839 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Created reservations ['621df17d-4457-4c68-bfa1-bf0839789eed', 'ed4a3c2a-cfc1-43e4-85a2-5315280f3029', '480e6ffb-478e-4012-a9c6-f86b64339095', '95bbf484-60f3-45de-a0c5-32b7607790f8'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:50:14 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-2e697b4c-6da9-4d27-bcd1-28674ee3d839 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Delete snapshot completed successfully. Aug 28 09:50:14 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2e697b4c-6da9-4d27-bcd1-28674ee3d839 tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "cinder-022772fd-676c-4808-b0ce-88cf9b85d963-delete_snapshot" released by "delete_snapshot" :: held 2.146s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:14 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a11debca-55f6-4a03-abc1-18eda95cd31c tempest-ProjectReaderTests-6117886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-85e983b9-e915-4cd7-9fb7-5443f4595ce1" returned: 0 in 0.513s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a11debca-55f6-4a03-abc1-18eda95cd31c tempest-ProjectReaderTests-6117886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-85e983b9-e915-4cd7-9fb7-5443f4595ce1 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:14 devstack sudo[105009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-85e983b9-e915-4cd7-9fb7-5443f4595ce1 Aug 28 09:50:14 devstack sudo[105009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:14 devstack sudo[104993]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8c18b502-6d1d-4d03-9583-09523d841293 tempest-CinderUnicodeTest-818840768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c1abe3f4-755f-4ef4-a26f-cb64f0c7c661" returned: 0 in 0.454s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8c18b502-6d1d-4d03-9583-09523d841293 tempest-CinderUnicodeTest-818840768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c1abe3f4-755f-4ef4-a26f-cb64f0c7c661 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:14 devstack sudo[105011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c1abe3f4-755f-4ef4-a26f-cb64f0c7c661 Aug 28 09:50:14 devstack sudo[105011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:14 devstack sudo[105001]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0208c572-ed52-4408-8049-63419eba4c69 tempest-ProjectReaderTests-1007845069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44e84932-0093-494e-9b61-c9fa48c69ccb.dd38fbc3-85fa-48a1-af7f-46b474284013" returned: 0 in 0.362s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:14 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-0208c572-ed52-4408-8049-63419eba4c69 tempest-ProjectReaderTests-1007845069 None] Lock "cinder-quobyte-dd38fbc3-85fa-48a1-af7f-46b474284013" released by "_delete_snapshot" :: held 1.835s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:14 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-0208c572-ed52-4408-8049-63419eba4c69 tempest-ProjectReaderTests-1007845069 None] Lock "cinder-quobyte-44e84932-0093-494e-9b61-c9fa48c69ccb" released by "delete_snapshot" :: held 1.884s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:14 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-0208c572-ed52-4408-8049-63419eba4c69 tempest-ProjectReaderTests-1007845069 None] Created reservations ['c8e4e7b4-c5d6-4cf9-82d8-4ea2cb53ce3f', '120eb3b0-d0e2-4926-b228-1a13cb3332c6', 'd49350fe-81eb-4280-9b17-a61688775eab', 'f07d582e-f0ca-46f3-b93e-c56eaf124eb2'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:50:14 devstack sudo[105009]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a11debca-55f6-4a03-abc1-18eda95cd31c tempest-ProjectReaderTests-6117886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-85e983b9-e915-4cd7-9fb7-5443f4595ce1" returned: 0 in 0.274s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:14 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a11debca-55f6-4a03-abc1-18eda95cd31c tempest-ProjectReaderTests-6117886 None] Lock "cinder-quobyte-85e983b9-e915-4cd7-9fb7-5443f4595ce1" released by "delete_volume" :: held 0.851s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:14 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-0208c572-ed52-4408-8049-63419eba4c69 tempest-ProjectReaderTests-1007845069 None] Delete snapshot completed successfully. Aug 28 09:50:14 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-0208c572-ed52-4408-8049-63419eba4c69 tempest-ProjectReaderTests-1007845069 None] Lock "cinder-dd38fbc3-85fa-48a1-af7f-46b474284013-delete_snapshot" released by "delete_snapshot" :: held 2.076s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:14 devstack sudo[105011]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8c18b502-6d1d-4d03-9583-09523d841293 tempest-CinderUnicodeTest-818840768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-c1abe3f4-755f-4ef4-a26f-cb64f0c7c661" returned: 0 in 0.278s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:14 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8c18b502-6d1d-4d03-9583-09523d841293 tempest-CinderUnicodeTest-818840768 None] Lock "cinder-quobyte-c1abe3f4-755f-4ef4-a26f-cb64f0c7c661" released by "delete_volume" :: held 0.780s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:14 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-a11debca-55f6-4a03-abc1-18eda95cd31c tempest-ProjectReaderTests-6117886 None] Created reservations ['646e2b13-9ed3-4123-a458-83858d7f566b', '1bb38f2c-f5e4-4be8-b375-f84165b78025', 'b05837fe-5acf-4989-8f27-9d67e5376729', 'c6633e7f-d31d-4725-8065-7dc87d9da3f3'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:50:14 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-8c18b502-6d1d-4d03-9583-09523d841293 tempest-CinderUnicodeTest-818840768 None] Created reservations ['6248790a-6e51-4829-8f49-cc0a96da93a0', 'ba156c62-27b2-4c17-9bf7-9e3ae110e55a', '5af537cb-3027-4b96-b076-8487de7cbccb', 'c862460b-84e6-4454-a6b3-1ab979c6afb3'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:50:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a11debca-55f6-4a03-abc1-18eda95cd31c tempest-ProjectReaderTests-6117886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:50:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a11debca-55f6-4a03-abc1-18eda95cd31c tempest-ProjectReaderTests-6117886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:14 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-a11debca-55f6-4a03-abc1-18eda95cd31c tempest-ProjectReaderTests-6117886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:50:14 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-a11debca-55f6-4a03-abc1-18eda95cd31c tempest-ProjectReaderTests-6117886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:50:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a11debca-55f6-4a03-abc1-18eda95cd31c tempest-ProjectReaderTests-6117886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a11debca-55f6-4a03-abc1-18eda95cd31c tempest-ProjectReaderTests-6117886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:14 devstack sudo[105016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:50:14 devstack sudo[105016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8c18b502-6d1d-4d03-9583-09523d841293 tempest-CinderUnicodeTest-818840768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:50:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8c18b502-6d1d-4d03-9583-09523d841293 tempest-CinderUnicodeTest-818840768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:14 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-8c18b502-6d1d-4d03-9583-09523d841293 tempest-CinderUnicodeTest-818840768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:50:14 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-8c18b502-6d1d-4d03-9583-09523d841293 tempest-CinderUnicodeTest-818840768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:50:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8c18b502-6d1d-4d03-9583-09523d841293 tempest-CinderUnicodeTest-818840768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8c18b502-6d1d-4d03-9583-09523d841293 tempest-CinderUnicodeTest-818840768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:14 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-d6f86bb6-de56-4592-992b-74bf73867c64 tempest-ProjectReaderTests-1007845069 None] Acquiring lock "cinder-44e84932-0093-494e-9b61-c9fa48c69ccb-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:14 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-d6f86bb6-de56-4592-992b-74bf73867c64 tempest-ProjectReaderTests-1007845069 None] Lock "cinder-44e84932-0093-494e-9b61-c9fa48c69ccb-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:14 devstack sudo[105018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:50:14 devstack sudo[105018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:14 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-d6f86bb6-de56-4592-992b-74bf73867c64 tempest-ProjectReaderTests-1007845069 None] Acquiring lock "cinder-quobyte-44e84932-0093-494e-9b61-c9fa48c69ccb" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:14 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-d6f86bb6-de56-4592-992b-74bf73867c64 tempest-ProjectReaderTests-1007845069 None] Lock "cinder-quobyte-44e84932-0093-494e-9b61-c9fa48c69ccb" acquired by "delete_volume" :: waited 0.021s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:14 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a431b0-005b-44e7-a48c-38d9e0665151]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:50:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d6f86bb6-de56-4592-992b-74bf73867c64 tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44e84932-0093-494e-9b61-c9fa48c69ccb {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:14 devstack sudo[105016]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a11debca-55f6-4a03-abc1-18eda95cd31c tempest-ProjectReaderTests-6117886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.347s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:14 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-a11debca-55f6-4a03-abc1-18eda95cd31c tempest-ProjectReaderTests-6117886 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:50:14 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-a11debca-55f6-4a03-abc1-18eda95cd31c tempest-ProjectReaderTests-6117886 None] Deleted volume successfully. Aug 28 09:50:14 devstack sudo[105020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44e84932-0093-494e-9b61-c9fa48c69ccb Aug 28 09:50:14 devstack sudo[105020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:14 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a11debca-55f6-4a03-abc1-18eda95cd31c tempest-ProjectReaderTests-6117886 None] Lock "cinder-85e983b9-e915-4cd7-9fb7-5443f4595ce1-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:15 devstack sudo[105018]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8c18b502-6d1d-4d03-9583-09523d841293 tempest-CinderUnicodeTest-818840768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.481s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:15 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-8c18b502-6d1d-4d03-9583-09523d841293 tempest-CinderUnicodeTest-818840768 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:50:15 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-8c18b502-6d1d-4d03-9583-09523d841293 tempest-CinderUnicodeTest-818840768 None] Deleted volume successfully. Aug 28 09:50:15 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8c18b502-6d1d-4d03-9583-09523d841293 tempest-CinderUnicodeTest-818840768 None] Lock "cinder-c1abe3f4-755f-4ef4-a26f-cb64f0c7c661-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:15 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-3f971c4a-1e45-456e-8541-9dbd58dc825b tempest-CreateVolumesFromSnapshotTest-1117622518 None] Acquiring lock "cinder-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:15 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-3f971c4a-1e45-456e-8541-9dbd58dc825b tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "cinder-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:15 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writing DB stats cinder:SELECT=258,cinder:INSERT=93,cinder:UPDATE=347,cinder:DELETE=31 {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:50:15 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-b69b9488-3adb-4b28-ab14-56b2a61333f9 tempest-ProjectReaderTests-6117886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:50:15 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b69b9488-3adb-4b28-ab14-56b2a61333f9 tempest-ProjectReaderTests-6117886 None] Flow 'volume_create_manager' (bf61f076-3a13-485b-afb1-879bd6665e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:50:15 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b69b9488-3adb-4b28-ab14-56b2a61333f9 tempest-ProjectReaderTests-6117886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d578d5c-956d-4848-8779-efb7464e0698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:15 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b69b9488-3adb-4b28-ab14-56b2a61333f9 tempest-ProjectReaderTests-6117886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d578d5c-956d-4848-8779-efb7464e0698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1502931591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7da32ea-c8c5-49e5-9718-4bb0d94d16b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab5b18ffc2444a34be7fada14ea01d20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:50:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:50:15Z,use_quota=True,user_id='208954225d424ce792ed89e1459e9e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:15 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b69b9488-3adb-4b28-ab14-56b2a61333f9 tempest-ProjectReaderTests-6117886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8660b51c-230b-47e7-8d38-21ec39bad345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:15 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b69b9488-3adb-4b28-ab14-56b2a61333f9 tempest-ProjectReaderTests-6117886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8660b51c-230b-47e7-8d38-21ec39bad345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:15 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b69b9488-3adb-4b28-ab14-56b2a61333f9 tempest-ProjectReaderTests-6117886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (128b573c-989c-4796-9eba-7ea0f1fb4be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:15 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b69b9488-3adb-4b28-ab14-56b2a61333f9 tempest-ProjectReaderTests-6117886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (128b573c-989c-4796-9eba-7ea0f1fb4be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7da32ea-c8c5-49e5-9718-4bb0d94d16b4', 'volume_name': 'volume-b7da32ea-c8c5-49e5-9718-4bb0d94d16b4', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:15 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b69b9488-3adb-4b28-ab14-56b2a61333f9 tempest-ProjectReaderTests-6117886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (637decca-38fc-47f8-80bc-c952af0a865f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:15 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b69b9488-3adb-4b28-ab14-56b2a61333f9 tempest-ProjectReaderTests-6117886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (637decca-38fc-47f8-80bc-c952af0a865f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:15 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b69b9488-3adb-4b28-ab14-56b2a61333f9 tempest-ProjectReaderTests-6117886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97a2e882-0e51-42d0-940c-6938d23e20d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:15 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-b69b9488-3adb-4b28-ab14-56b2a61333f9 tempest-ProjectReaderTests-6117886 None] Volume b7da32ea-c8c5-49e5-9718-4bb0d94d16b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7da32ea-c8c5-49e5-9718-4bb0d94d16b4', 'volume_size': 1} Aug 28 09:50:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b69b9488-3adb-4b28-ab14-56b2a61333f9 tempest-ProjectReaderTests-6117886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:50:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b69b9488-3adb-4b28-ab14-56b2a61333f9 tempest-ProjectReaderTests-6117886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:15 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-b69b9488-3adb-4b28-ab14-56b2a61333f9 tempest-ProjectReaderTests-6117886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1502931591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7da32ea-c8c5-49e5-9718-4bb0d94d16b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab5b18ffc2444a34be7fada14ea01d20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:50:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:50:15Z,use_quota=True,user_id='208954225d424ce792ed89e1459e9e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:50:15 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-b69b9488-3adb-4b28-ab14-56b2a61333f9 tempest-ProjectReaderTests-6117886 None] Creating volume b7da32ea-c8c5-49e5-9718-4bb0d94d16b4 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:50:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b69b9488-3adb-4b28-ab14-56b2a61333f9 tempest-ProjectReaderTests-6117886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:50:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b69b9488-3adb-4b28-ab14-56b2a61333f9 tempest-ProjectReaderTests-6117886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:15 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-b69b9488-3adb-4b28-ab14-56b2a61333f9 tempest-ProjectReaderTests-6117886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:50:15 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-b69b9488-3adb-4b28-ab14-56b2a61333f9 tempest-ProjectReaderTests-6117886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:50:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b69b9488-3adb-4b28-ab14-56b2a61333f9 tempest-ProjectReaderTests-6117886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:15 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-b69b9488-3adb-4b28-ab14-56b2a61333f9 tempest-ProjectReaderTests-6117886 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:50:15 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-b69b9488-3adb-4b28-ab14-56b2a61333f9 tempest-ProjectReaderTests-6117886 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:50:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b69b9488-3adb-4b28-ab14-56b2a61333f9 tempest-ProjectReaderTests-6117886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b7da32ea-c8c5-49e5-9718-4bb0d94d16b4 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:15 devstack sudo[105020]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:15 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-3f971c4a-1e45-456e-8541-9dbd58dc825b tempest-CreateVolumesFromSnapshotTest-1117622518 None] Acquiring lock "cinder-quobyte-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d6f86bb6-de56-4592-992b-74bf73867c64 tempest-ProjectReaderTests-1007845069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44e84932-0093-494e-9b61-c9fa48c69ccb" returned: 0 in 0.597s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d6f86bb6-de56-4592-992b-74bf73867c64 tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44e84932-0093-494e-9b61-c9fa48c69ccb {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:15 devstack sudo[105029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b7da32ea-c8c5-49e5-9718-4bb0d94d16b4 1073741824 Aug 28 09:50:15 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:15 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-3f971c4a-1e45-456e-8541-9dbd58dc825b tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "cinder-quobyte-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9" acquired by "delete_volume" :: waited 0.036s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:15 devstack sudo[105031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44e84932-0093-494e-9b61-c9fa48c69ccb Aug 28 09:50:15 devstack sudo[105031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:15 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e04d0e-836d-4271-b56b-f56ceb53152e]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:50:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3f971c4a-1e45-456e-8541-9dbd58dc825b tempest-CreateVolumesFromSnapshotTest-1117622518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:15 devstack sudo[105045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9 Aug 28 09:50:15 devstack sudo[105045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:15 devstack sudo[105031]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d6f86bb6-de56-4592-992b-74bf73867c64 tempest-ProjectReaderTests-1007845069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-44e84932-0093-494e-9b61-c9fa48c69ccb" returned: 0 in 0.398s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:15 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-d6f86bb6-de56-4592-992b-74bf73867c64 tempest-ProjectReaderTests-1007845069 None] Lock "cinder-quobyte-44e84932-0093-494e-9b61-c9fa48c69ccb" released by "delete_volume" :: held 1.099s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:15 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writing DB stats cinder:SELECT=270,cinder:UPDATE=374,cinder:INSERT=98,cinder:DELETE=33 {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:50:15 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-d6f86bb6-de56-4592-992b-74bf73867c64 tempest-ProjectReaderTests-1007845069 None] Created reservations ['bd757e00-f4db-4d8e-aa66-a48e559d4d8a', 'b76df91e-87ea-4945-a7c9-9119b4ef1058', 'a95e0142-fd43-4e79-b43d-766fc9414336', '687f5b10-b08c-4e5c-8b38-fe33886a9a18'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:50:15 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b69b9488-3adb-4b28-ab14-56b2a61333f9 tempest-ProjectReaderTests-6117886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b7da32ea-c8c5-49e5-9718-4bb0d94d16b4 1073741824" returned: 0 in 0.628s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b69b9488-3adb-4b28-ab14-56b2a61333f9 tempest-ProjectReaderTests-6117886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b7da32ea-c8c5-49e5-9718-4bb0d94d16b4 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-d6f86bb6-de56-4592-992b-74bf73867c64 tempest-ProjectReaderTests-1007845069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:50:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-d6f86bb6-de56-4592-992b-74bf73867c64 tempest-ProjectReaderTests-1007845069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:16 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-d6f86bb6-de56-4592-992b-74bf73867c64 tempest-ProjectReaderTests-1007845069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:50:16 devstack sudo[105076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b7da32ea-c8c5-49e5-9718-4bb0d94d16b4 Aug 28 09:50:16 devstack sudo[105076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:16 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-d6f86bb6-de56-4592-992b-74bf73867c64 tempest-ProjectReaderTests-1007845069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:50:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-d6f86bb6-de56-4592-992b-74bf73867c64 tempest-ProjectReaderTests-1007845069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d6f86bb6-de56-4592-992b-74bf73867c64 tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:16 devstack sudo[105081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:50:16 devstack sudo[105081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:16 devstack sudo[105045]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3f971c4a-1e45-456e-8541-9dbd58dc825b tempest-CreateVolumesFromSnapshotTest-1117622518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9" returned: 0 in 0.708s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3f971c4a-1e45-456e-8541-9dbd58dc825b tempest-CreateVolumesFromSnapshotTest-1117622518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:16 devstack sudo[105083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9 Aug 28 09:50:16 devstack sudo[105083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:16 devstack sudo[105081]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d6f86bb6-de56-4592-992b-74bf73867c64 tempest-ProjectReaderTests-1007845069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.320s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:16 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-d6f86bb6-de56-4592-992b-74bf73867c64 tempest-ProjectReaderTests-1007845069 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:50:16 devstack sudo[105076]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:16 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-d6f86bb6-de56-4592-992b-74bf73867c64 tempest-ProjectReaderTests-1007845069 None] Deleted volume successfully. Aug 28 09:50:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b69b9488-3adb-4b28-ab14-56b2a61333f9 tempest-ProjectReaderTests-6117886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b7da32ea-c8c5-49e5-9718-4bb0d94d16b4" returned: 0 in 0.412s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:16 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-b69b9488-3adb-4b28-ab14-56b2a61333f9 tempest-ProjectReaderTests-6117886 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:50:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b69b9488-3adb-4b28-ab14-56b2a61333f9 tempest-ProjectReaderTests-6117886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:16 devstack sudo[105083]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3f971c4a-1e45-456e-8541-9dbd58dc825b tempest-CreateVolumesFromSnapshotTest-1117622518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9" returned: 0 in 0.297s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:16 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b69b9488-3adb-4b28-ab14-56b2a61333f9 tempest-ProjectReaderTests-6117886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97a2e882-0e51-42d0-940c-6938d23e20d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7da32ea-c8c5-49e5-9718-4bb0d94d16b4', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:16 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b69b9488-3adb-4b28-ab14-56b2a61333f9 tempest-ProjectReaderTests-6117886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4126bdb7-fd54-47c6-a078-0ec2043adbce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:16 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-3f971c4a-1e45-456e-8541-9dbd58dc825b tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "cinder-quobyte-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9" released by "delete_volume" :: held 1.095s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:16 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-d6f86bb6-de56-4592-992b-74bf73867c64 tempest-ProjectReaderTests-1007845069 None] Lock "cinder-44e84932-0093-494e-9b61-c9fa48c69ccb-delete_volume" released by "delete_volume" :: held 1.873s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:16 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-b69b9488-3adb-4b28-ab14-56b2a61333f9 tempest-ProjectReaderTests-6117886 None] Volume volume-b7da32ea-c8c5-49e5-9718-4bb0d94d16b4 (b7da32ea-c8c5-49e5-9718-4bb0d94d16b4): created successfully Aug 28 09:50:16 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b69b9488-3adb-4b28-ab14-56b2a61333f9 tempest-ProjectReaderTests-6117886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4126bdb7-fd54-47c6-a078-0ec2043adbce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:16 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b69b9488-3adb-4b28-ab14-56b2a61333f9 tempest-ProjectReaderTests-6117886 None] Flow 'volume_create_manager' (bf61f076-3a13-485b-afb1-879bd6665e01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:50:16 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-b69b9488-3adb-4b28-ab14-56b2a61333f9 tempest-ProjectReaderTests-6117886 None] Created volume successfully. Aug 28 09:50:16 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-3f971c4a-1e45-456e-8541-9dbd58dc825b tempest-CreateVolumesFromSnapshotTest-1117622518 None] Created reservations ['6fafbe62-30fe-4f03-84b7-1c71517989cb', 'b1b4174b-dedb-4b9f-8b42-d4b8e24304d9', '10225bdf-f270-4d41-8ffc-9f379a19e6d7', '64d37989-d4bd-4f73-a89b-a351ba95b960'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:50:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-3f971c4a-1e45-456e-8541-9dbd58dc825b tempest-CreateVolumesFromSnapshotTest-1117622518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:50:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-3f971c4a-1e45-456e-8541-9dbd58dc825b tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:16 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-3f971c4a-1e45-456e-8541-9dbd58dc825b tempest-CreateVolumesFromSnapshotTest-1117622518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:50:16 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-3f971c4a-1e45-456e-8541-9dbd58dc825b tempest-CreateVolumesFromSnapshotTest-1117622518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:50:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-3f971c4a-1e45-456e-8541-9dbd58dc825b tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3f971c4a-1e45-456e-8541-9dbd58dc825b tempest-CreateVolumesFromSnapshotTest-1117622518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:16 devstack sudo[105089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:50:16 devstack sudo[105089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:16 devstack sudo[105089]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3f971c4a-1e45-456e-8541-9dbd58dc825b tempest-CreateVolumesFromSnapshotTest-1117622518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.274s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:16 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-3f971c4a-1e45-456e-8541-9dbd58dc825b tempest-CreateVolumesFromSnapshotTest-1117622518 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:50:16 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-3f971c4a-1e45-456e-8541-9dbd58dc825b tempest-CreateVolumesFromSnapshotTest-1117622518 None] Deleted volume successfully. Aug 28 09:50:16 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-3f971c4a-1e45-456e-8541-9dbd58dc825b tempest-CreateVolumesFromSnapshotTest-1117622518 None] Lock "cinder-464f3f82-06e2-4d2f-a459-aa86c9e0d4f9-delete_volume" released by "delete_volume" :: held 1.766s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:17 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4b098a67-3cab-45f7-aa9c-e70c9178fb75 tempest-ProjectReaderTests-6117886 None] Acquiring lock "cinder-b7da32ea-c8c5-49e5-9718-4bb0d94d16b4-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:17 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4b098a67-3cab-45f7-aa9c-e70c9178fb75 tempest-ProjectReaderTests-6117886 None] Lock "cinder-b7da32ea-c8c5-49e5-9718-4bb0d94d16b4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:17 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4b098a67-3cab-45f7-aa9c-e70c9178fb75 tempest-ProjectReaderTests-6117886 None] Acquiring lock "cinder-quobyte-b7da32ea-c8c5-49e5-9718-4bb0d94d16b4" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:17 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4b098a67-3cab-45f7-aa9c-e70c9178fb75 tempest-ProjectReaderTests-6117886 None] Lock "cinder-quobyte-b7da32ea-c8c5-49e5-9718-4bb0d94d16b4" acquired by "delete_volume" :: waited 0.022s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:17 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-088b5864-43b3-4b5b-8782-4314121244c0 tempest-ProjectReaderTests-1007845069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:50:17 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-088b5864-43b3-4b5b-8782-4314121244c0 tempest-ProjectReaderTests-1007845069 None] Flow 'volume_create_manager' (751dda46-2bfd-4f09-88d4-dc800d50a1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:50:17 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-088b5864-43b3-4b5b-8782-4314121244c0 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d51717ee-9580-47c6-8087-b20351f720b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:17 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df93f6b-e605-478a-a319-5bb660558412]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:50:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4b098a67-3cab-45f7-aa9c-e70c9178fb75 tempest-ProjectReaderTests-6117886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b7da32ea-c8c5-49e5-9718-4bb0d94d16b4 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:17 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-088b5864-43b3-4b5b-8782-4314121244c0 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d51717ee-9580-47c6-8087-b20351f720b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2090934703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0a1ea6b99c7413e9fb54892d96af172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:50:17Z,use_quota=True,user_id='40fe0546d5a249bcb1fd3247e64d4590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:17 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-088b5864-43b3-4b5b-8782-4314121244c0 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cffe6f7-bc64-4464-96f1-4a362badafab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:17 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-088b5864-43b3-4b5b-8782-4314121244c0 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cffe6f7-bc64-4464-96f1-4a362badafab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:17 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-088b5864-43b3-4b5b-8782-4314121244c0 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3de80b3-e8b5-43bf-b408-da38550279a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:17 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-088b5864-43b3-4b5b-8782-4314121244c0 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3de80b3-e8b5-43bf-b408-da38550279a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4f67b92-e3d7-42e4-b0de-fcb9bedaec5b', 'volume_name': 'volume-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:17 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-088b5864-43b3-4b5b-8782-4314121244c0 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d415579-fd28-4af5-9c3d-84225929f2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:17 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-088b5864-43b3-4b5b-8782-4314121244c0 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d415579-fd28-4af5-9c3d-84225929f2db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:17 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-088b5864-43b3-4b5b-8782-4314121244c0 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a29fb75-a53d-4b72-887f-47a58efeaf29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:17 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-088b5864-43b3-4b5b-8782-4314121244c0 tempest-ProjectReaderTests-1007845069 None] Volume d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b', 'volume_size': 1} Aug 28 09:50:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-088b5864-43b3-4b5b-8782-4314121244c0 tempest-ProjectReaderTests-1007845069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:50:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-088b5864-43b3-4b5b-8782-4314121244c0 tempest-ProjectReaderTests-1007845069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:17 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-088b5864-43b3-4b5b-8782-4314121244c0 tempest-ProjectReaderTests-1007845069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2090934703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0a1ea6b99c7413e9fb54892d96af172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:50:17Z,use_quota=True,user_id='40fe0546d5a249bcb1fd3247e64d4590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:50:17 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-088b5864-43b3-4b5b-8782-4314121244c0 tempest-ProjectReaderTests-1007845069 None] Creating volume d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:50:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-088b5864-43b3-4b5b-8782-4314121244c0 tempest-ProjectReaderTests-1007845069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:50:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-088b5864-43b3-4b5b-8782-4314121244c0 tempest-ProjectReaderTests-1007845069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:17 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-088b5864-43b3-4b5b-8782-4314121244c0 tempest-ProjectReaderTests-1007845069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:50:17 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-088b5864-43b3-4b5b-8782-4314121244c0 tempest-ProjectReaderTests-1007845069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:50:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-088b5864-43b3-4b5b-8782-4314121244c0 tempest-ProjectReaderTests-1007845069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:17 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-088b5864-43b3-4b5b-8782-4314121244c0 tempest-ProjectReaderTests-1007845069 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:50:17 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-088b5864-43b3-4b5b-8782-4314121244c0 tempest-ProjectReaderTests-1007845069 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:50:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-088b5864-43b3-4b5b-8782-4314121244c0 tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:17 devstack sudo[105092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b7da32ea-c8c5-49e5-9718-4bb0d94d16b4 Aug 28 09:50:17 devstack sudo[105092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:17 devstack sudo[105093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b 1073741824 Aug 28 09:50:17 devstack sudo[105093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:17 devstack sudo[105092]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4b098a67-3cab-45f7-aa9c-e70c9178fb75 tempest-ProjectReaderTests-6117886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b7da32ea-c8c5-49e5-9718-4bb0d94d16b4" returned: 0 in 0.414s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4b098a67-3cab-45f7-aa9c-e70c9178fb75 tempest-ProjectReaderTests-6117886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b7da32ea-c8c5-49e5-9718-4bb0d94d16b4 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:17 devstack sudo[105102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b7da32ea-c8c5-49e5-9718-4bb0d94d16b4 Aug 28 09:50:17 devstack sudo[105102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:18 devstack sudo[105093]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-088b5864-43b3-4b5b-8782-4314121244c0 tempest-ProjectReaderTests-1007845069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b 1073741824" returned: 0 in 0.511s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-088b5864-43b3-4b5b-8782-4314121244c0 tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:18 devstack sudo[105106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b Aug 28 09:50:18 devstack sudo[105102]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4b098a67-3cab-45f7-aa9c-e70c9178fb75 tempest-ProjectReaderTests-6117886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b7da32ea-c8c5-49e5-9718-4bb0d94d16b4" returned: 0 in 0.293s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:18 devstack sudo[105106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:18 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4b098a67-3cab-45f7-aa9c-e70c9178fb75 tempest-ProjectReaderTests-6117886 None] Lock "cinder-quobyte-b7da32ea-c8c5-49e5-9718-4bb0d94d16b4" released by "delete_volume" :: held 0.789s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:18 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-4b098a67-3cab-45f7-aa9c-e70c9178fb75 tempest-ProjectReaderTests-6117886 None] Created reservations ['652e738e-d5c2-4ec8-b7b1-ed8596be3e5a', '1eb952f9-ae23-40d1-bc1f-e0b5dc2c8b7e', '257294b2-0d32-4ce3-8cb3-e8f591267731', '8d893ec9-39ee-4ce6-9b52-a6f2318043a7'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:50:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-4b098a67-3cab-45f7-aa9c-e70c9178fb75 tempest-ProjectReaderTests-6117886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:50:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-4b098a67-3cab-45f7-aa9c-e70c9178fb75 tempest-ProjectReaderTests-6117886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:18 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-4b098a67-3cab-45f7-aa9c-e70c9178fb75 tempest-ProjectReaderTests-6117886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:50:18 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-4b098a67-3cab-45f7-aa9c-e70c9178fb75 tempest-ProjectReaderTests-6117886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:50:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-4b098a67-3cab-45f7-aa9c-e70c9178fb75 tempest-ProjectReaderTests-6117886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4b098a67-3cab-45f7-aa9c-e70c9178fb75 tempest-ProjectReaderTests-6117886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:18 devstack sudo[105106]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-088b5864-43b3-4b5b-8782-4314121244c0 tempest-ProjectReaderTests-1007845069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b" returned: 0 in 0.359s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:18 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-088b5864-43b3-4b5b-8782-4314121244c0 tempest-ProjectReaderTests-1007845069 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:50:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-088b5864-43b3-4b5b-8782-4314121244c0 tempest-ProjectReaderTests-1007845069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:18 devstack sudo[105109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:50:18 devstack sudo[105109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:18 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-088b5864-43b3-4b5b-8782-4314121244c0 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a29fb75-a53d-4b72-887f-47a58efeaf29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:18 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-088b5864-43b3-4b5b-8782-4314121244c0 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c17e664-1dbc-4caf-b05d-197511ccb0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:18 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-088b5864-43b3-4b5b-8782-4314121244c0 tempest-ProjectReaderTests-1007845069 None] Volume volume-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b (d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b): created successfully Aug 28 09:50:18 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-088b5864-43b3-4b5b-8782-4314121244c0 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c17e664-1dbc-4caf-b05d-197511ccb0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:18 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-088b5864-43b3-4b5b-8782-4314121244c0 tempest-ProjectReaderTests-1007845069 None] Flow 'volume_create_manager' (751dda46-2bfd-4f09-88d4-dc800d50a1ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:50:18 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-088b5864-43b3-4b5b-8782-4314121244c0 tempest-ProjectReaderTests-1007845069 None] Created volume successfully. Aug 28 09:50:18 devstack sudo[105109]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4b098a67-3cab-45f7-aa9c-e70c9178fb75 tempest-ProjectReaderTests-6117886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.351s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:18 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-4b098a67-3cab-45f7-aa9c-e70c9178fb75 tempest-ProjectReaderTests-6117886 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:50:18 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-4b098a67-3cab-45f7-aa9c-e70c9178fb75 tempest-ProjectReaderTests-6117886 None] Deleted volume successfully. Aug 28 09:50:18 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-4b098a67-3cab-45f7-aa9c-e70c9178fb75 tempest-ProjectReaderTests-6117886 None] Lock "cinder-b7da32ea-c8c5-49e5-9718-4bb0d94d16b4-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:19 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-37e730c9-9f51-42f7-a037-5ed3340e099b tempest-ProjectReaderTests-6117886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:50:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-37e730c9-9f51-42f7-a037-5ed3340e099b tempest-ProjectReaderTests-6117886 None] Flow 'volume_create_manager' (ad8adf7e-02f5-400b-85e8-fa87e28052d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:50:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-37e730c9-9f51-42f7-a037-5ed3340e099b tempest-ProjectReaderTests-6117886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bc53538-1557-4f94-ab22-575bd49433c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-37e730c9-9f51-42f7-a037-5ed3340e099b tempest-ProjectReaderTests-6117886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bc53538-1557-4f94-ab22-575bd49433c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-624547792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39927993-8ec8-4f71-a530-539b0feadbce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab5b18ffc2444a34be7fada14ea01d20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:50:19Z,use_quota=True,user_id='208954225d424ce792ed89e1459e9e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-37e730c9-9f51-42f7-a037-5ed3340e099b tempest-ProjectReaderTests-6117886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d75aa5f7-3db9-41a5-b553-2c7196fc95ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-37e730c9-9f51-42f7-a037-5ed3340e099b tempest-ProjectReaderTests-6117886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d75aa5f7-3db9-41a5-b553-2c7196fc95ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-37e730c9-9f51-42f7-a037-5ed3340e099b tempest-ProjectReaderTests-6117886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f03dabcd-f1e4-4d9c-ba84-9157525cedcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-37e730c9-9f51-42f7-a037-5ed3340e099b tempest-ProjectReaderTests-6117886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f03dabcd-f1e4-4d9c-ba84-9157525cedcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39927993-8ec8-4f71-a530-539b0feadbce', 'volume_name': 'volume-39927993-8ec8-4f71-a530-539b0feadbce', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-37e730c9-9f51-42f7-a037-5ed3340e099b tempest-ProjectReaderTests-6117886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7e68428-fb82-4d0f-8303-7a149322229d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-37e730c9-9f51-42f7-a037-5ed3340e099b tempest-ProjectReaderTests-6117886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7e68428-fb82-4d0f-8303-7a149322229d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-37e730c9-9f51-42f7-a037-5ed3340e099b tempest-ProjectReaderTests-6117886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a967cd37-d8b4-4100-97e6-426072dc355a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:19 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-37e730c9-9f51-42f7-a037-5ed3340e099b tempest-ProjectReaderTests-6117886 None] Volume 39927993-8ec8-4f71-a530-539b0feadbce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39927993-8ec8-4f71-a530-539b0feadbce', 'volume_size': 1} Aug 28 09:50:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-37e730c9-9f51-42f7-a037-5ed3340e099b tempest-ProjectReaderTests-6117886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:50:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-37e730c9-9f51-42f7-a037-5ed3340e099b tempest-ProjectReaderTests-6117886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:19 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-37e730c9-9f51-42f7-a037-5ed3340e099b tempest-ProjectReaderTests-6117886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-624547792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39927993-8ec8-4f71-a530-539b0feadbce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab5b18ffc2444a34be7fada14ea01d20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:50:19Z,use_quota=True,user_id='208954225d424ce792ed89e1459e9e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:50:19 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-37e730c9-9f51-42f7-a037-5ed3340e099b tempest-ProjectReaderTests-6117886 None] Creating volume 39927993-8ec8-4f71-a530-539b0feadbce {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:50:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-37e730c9-9f51-42f7-a037-5ed3340e099b tempest-ProjectReaderTests-6117886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:50:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-37e730c9-9f51-42f7-a037-5ed3340e099b tempest-ProjectReaderTests-6117886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:19 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-37e730c9-9f51-42f7-a037-5ed3340e099b tempest-ProjectReaderTests-6117886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:50:19 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-37e730c9-9f51-42f7-a037-5ed3340e099b tempest-ProjectReaderTests-6117886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:50:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-37e730c9-9f51-42f7-a037-5ed3340e099b tempest-ProjectReaderTests-6117886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:19 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-37e730c9-9f51-42f7-a037-5ed3340e099b tempest-ProjectReaderTests-6117886 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:50:19 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-37e730c9-9f51-42f7-a037-5ed3340e099b tempest-ProjectReaderTests-6117886 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:50:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-37e730c9-9f51-42f7-a037-5ed3340e099b tempest-ProjectReaderTests-6117886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-39927993-8ec8-4f71-a530-539b0feadbce 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:19 devstack sudo[105114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-39927993-8ec8-4f71-a530-539b0feadbce 1073741824 Aug 28 09:50:19 devstack sudo[105114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-fad88c83-9252-4ab6-933d-d7e2e918eabf tempest-ProjectReaderTests-1007845069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:50:19 devstack sudo[105114]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-37e730c9-9f51-42f7-a037-5ed3340e099b tempest-ProjectReaderTests-6117886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-39927993-8ec8-4f71-a530-539b0feadbce 1073741824" returned: 0 in 0.556s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-37e730c9-9f51-42f7-a037-5ed3340e099b tempest-ProjectReaderTests-6117886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-39927993-8ec8-4f71-a530-539b0feadbce {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:19 devstack sudo[105121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-39927993-8ec8-4f71-a530-539b0feadbce Aug 28 09:50:19 devstack sudo[105121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:20 devstack sudo[105121]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-37e730c9-9f51-42f7-a037-5ed3340e099b tempest-ProjectReaderTests-6117886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-39927993-8ec8-4f71-a530-539b0feadbce" returned: 0 in 0.283s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:20 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-37e730c9-9f51-42f7-a037-5ed3340e099b tempest-ProjectReaderTests-6117886 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:50:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-37e730c9-9f51-42f7-a037-5ed3340e099b tempest-ProjectReaderTests-6117886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-fad88c83-9252-4ab6-933d-d7e2e918eabf tempest-ProjectReaderTests-1007845069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.376s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:20 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-37e730c9-9f51-42f7-a037-5ed3340e099b tempest-ProjectReaderTests-6117886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a967cd37-d8b4-4100-97e6-426072dc355a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39927993-8ec8-4f71-a530-539b0feadbce', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:20 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-37e730c9-9f51-42f7-a037-5ed3340e099b tempest-ProjectReaderTests-6117886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26ac6be4-0850-4658-9f19-1b7e4bb1581d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:20 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-fad88c83-9252-4ab6-933d-d7e2e918eabf tempest-ProjectReaderTests-1007845069 None] Creating offline snapshot ceaf83cf-70f2-43e0-8d1d-05cb97795f67 of volume d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b {{(pid=86081) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:50:20 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-37e730c9-9f51-42f7-a037-5ed3340e099b tempest-ProjectReaderTests-6117886 None] Volume volume-39927993-8ec8-4f71-a530-539b0feadbce (39927993-8ec8-4f71-a530-539b0feadbce): created successfully Aug 28 09:50:20 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-37e730c9-9f51-42f7-a037-5ed3340e099b tempest-ProjectReaderTests-6117886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26ac6be4-0850-4658-9f19-1b7e4bb1581d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:20 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-37e730c9-9f51-42f7-a037-5ed3340e099b tempest-ProjectReaderTests-6117886 None] Flow 'volume_create_manager' (ad8adf7e-02f5-400b-85e8-fa87e28052d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:50:20 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8fdbaf5-7bcc-4fce-909c-8b1f55faa16c]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:50:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fad88c83-9252-4ab6-933d-d7e2e918eabf tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:20 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-37e730c9-9f51-42f7-a037-5ed3340e099b tempest-ProjectReaderTests-6117886 None] Created volume successfully. Aug 28 09:50:20 devstack sudo[105124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b Aug 28 09:50:20 devstack sudo[105124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:20 devstack sudo[105124]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fad88c83-9252-4ab6-933d-d7e2e918eabf tempest-ProjectReaderTests-1007845069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b" returned: 0 in 0.418s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fad88c83-9252-4ab6-933d-d7e2e918eabf tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b.ceaf83cf-70f2-43e0-8d1d-05cb97795f67 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:20 devstack sudo[105129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b.ceaf83cf-70f2-43e0-8d1d-05cb97795f67 1G Aug 28 09:50:20 devstack sudo[105129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:21 devstack sudo[105129]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fad88c83-9252-4ab6-933d-d7e2e918eabf tempest-ProjectReaderTests-1007845069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b.ceaf83cf-70f2-43e0-8d1d-05cb97795f67 1G" returned: 0 in 0.483s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fad88c83-9252-4ab6-933d-d7e2e918eabf tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b.ceaf83cf-70f2-43e0-8d1d-05cb97795f67 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:21 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b.ceaf83cf-70f2-43e0-8d1d-05cb97795f67 Aug 28 09:50:21 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:21 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-3fd5d72f-955f-4291-99c6-9f0f1449e4fe tempest-ProjectReaderTests-6117886 None] Acquiring lock "cinder-39927993-8ec8-4f71-a530-539b0feadbce-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:21 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-3fd5d72f-955f-4291-99c6-9f0f1449e4fe tempest-ProjectReaderTests-6117886 None] Lock "cinder-39927993-8ec8-4f71-a530-539b0feadbce-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:21 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-3fd5d72f-955f-4291-99c6-9f0f1449e4fe tempest-ProjectReaderTests-6117886 None] Acquiring lock "cinder-quobyte-39927993-8ec8-4f71-a530-539b0feadbce" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:21 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-3fd5d72f-955f-4291-99c6-9f0f1449e4fe tempest-ProjectReaderTests-6117886 None] Lock "cinder-quobyte-39927993-8ec8-4f71-a530-539b0feadbce" acquired by "delete_volume" :: waited 0.024s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:21 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d22a0c-7984-4bdc-b215-c06a4cf705c1]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:50:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3fd5d72f-955f-4291-99c6-9f0f1449e4fe tempest-ProjectReaderTests-6117886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-39927993-8ec8-4f71-a530-539b0feadbce {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:21 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fad88c83-9252-4ab6-933d-d7e2e918eabf tempest-ProjectReaderTests-1007845069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b.ceaf83cf-70f2-43e0-8d1d-05cb97795f67" returned: 0 in 0.372s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:21 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-fad88c83-9252-4ab6-933d-d7e2e918eabf tempest-ProjectReaderTests-1007845069 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b.ceaf83cf-70f2-43e0-8d1d-05cb97795f67 is being set with open permissions: ugo+rw Aug 28 09:50:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fad88c83-9252-4ab6-933d-d7e2e918eabf tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b.ceaf83cf-70f2-43e0-8d1d-05cb97795f67 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:21 devstack sudo[105141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b.ceaf83cf-70f2-43e0-8d1d-05cb97795f67 Aug 28 09:50:21 devstack sudo[105141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:21 devstack sudo[105140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-39927993-8ec8-4f71-a530-539b0feadbce Aug 28 09:50:21 devstack sudo[105140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:21 devstack sudo[105141]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fad88c83-9252-4ab6-933d-d7e2e918eabf tempest-ProjectReaderTests-1007845069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b.ceaf83cf-70f2-43e0-8d1d-05cb97795f67" returned: 0 in 0.304s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fad88c83-9252-4ab6-933d-d7e2e918eabf tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:21 devstack sudo[105149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b.info Aug 28 09:50:21 devstack sudo[105149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:21 devstack sudo[105140]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3fd5d72f-955f-4291-99c6-9f0f1449e4fe tempest-ProjectReaderTests-6117886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-39927993-8ec8-4f71-a530-539b0feadbce" returned: 0 in 0.475s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3fd5d72f-955f-4291-99c6-9f0f1449e4fe tempest-ProjectReaderTests-6117886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-39927993-8ec8-4f71-a530-539b0feadbce {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:22 devstack sudo[105151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-39927993-8ec8-4f71-a530-539b0feadbce Aug 28 09:50:22 devstack sudo[105151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:22 devstack sudo[105149]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fad88c83-9252-4ab6-933d-d7e2e918eabf tempest-ProjectReaderTests-1007845069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b.info" returned: 0 in 0.293s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:22 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-fad88c83-9252-4ab6-933d-d7e2e918eabf tempest-ProjectReaderTests-1007845069 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b.info is being set with open permissions: ugo+rw Aug 28 09:50:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fad88c83-9252-4ab6-933d-d7e2e918eabf tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:22 devstack sudo[105151]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3fd5d72f-955f-4291-99c6-9f0f1449e4fe tempest-ProjectReaderTests-6117886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-39927993-8ec8-4f71-a530-539b0feadbce" returned: 0 in 0.268s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:22 devstack sudo[105155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b.info Aug 28 09:50:22 devstack sudo[105155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:22 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-3fd5d72f-955f-4291-99c6-9f0f1449e4fe tempest-ProjectReaderTests-6117886 None] Lock "cinder-quobyte-39927993-8ec8-4f71-a530-539b0feadbce" released by "delete_volume" :: held 0.792s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:22 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-3fd5d72f-955f-4291-99c6-9f0f1449e4fe tempest-ProjectReaderTests-6117886 None] Created reservations ['7b37e179-9398-4b89-8ef7-70a80caf5f47', '9e5fde8d-9c74-40d2-9c3e-07b56378082e', 'fef4d2d6-80e1-49a7-9183-f04121d62b7d', 'c1e4609f-66ea-4d56-8b99-f0f18a7fabb9'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:50:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-3fd5d72f-955f-4291-99c6-9f0f1449e4fe tempest-ProjectReaderTests-6117886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:50:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-3fd5d72f-955f-4291-99c6-9f0f1449e4fe tempest-ProjectReaderTests-6117886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:22 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-3fd5d72f-955f-4291-99c6-9f0f1449e4fe tempest-ProjectReaderTests-6117886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:50:22 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-3fd5d72f-955f-4291-99c6-9f0f1449e4fe tempest-ProjectReaderTests-6117886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:50:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-3fd5d72f-955f-4291-99c6-9f0f1449e4fe tempest-ProjectReaderTests-6117886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3fd5d72f-955f-4291-99c6-9f0f1449e4fe tempest-ProjectReaderTests-6117886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:22 devstack sudo[105157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:50:22 devstack sudo[105157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:22 devstack sudo[105155]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fad88c83-9252-4ab6-933d-d7e2e918eabf tempest-ProjectReaderTests-1007845069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b.info" returned: 0 in 0.363s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-fad88c83-9252-4ab6-933d-d7e2e918eabf tempest-ProjectReaderTests-1007845069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.368s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:22 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-fad88c83-9252-4ab6-933d-d7e2e918eabf tempest-ProjectReaderTests-1007845069 None] Create snapshot completed successfully Aug 28 09:50:22 devstack sudo[105157]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:22 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3fd5d72f-955f-4291-99c6-9f0f1449e4fe tempest-ProjectReaderTests-6117886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.313s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:22 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-3fd5d72f-955f-4291-99c6-9f0f1449e4fe tempest-ProjectReaderTests-6117886 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:50:22 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-3fd5d72f-955f-4291-99c6-9f0f1449e4fe tempest-ProjectReaderTests-6117886 None] Deleted volume successfully. Aug 28 09:50:22 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-3fd5d72f-955f-4291-99c6-9f0f1449e4fe tempest-ProjectReaderTests-6117886 None] Lock "cinder-39927993-8ec8-4f71-a530-539b0feadbce-delete_volume" released by "delete_volume" :: held 1.400s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:23 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-57783989-900a-4a3a-a0a5-7071ac515e7a tempest-ProjectReaderTests-1007845069 None] Acquiring lock "cinder-ceaf83cf-70f2-43e0-8d1d-05cb97795f67-delete_snapshot" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:23 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-57783989-900a-4a3a-a0a5-7071ac515e7a tempest-ProjectReaderTests-1007845069 None] Lock "cinder-ceaf83cf-70f2-43e0-8d1d-05cb97795f67-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:23 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-57783989-900a-4a3a-a0a5-7071ac515e7a tempest-ProjectReaderTests-1007845069 None] Acquiring lock "cinder-quobyte-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:23 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-57783989-900a-4a3a-a0a5-7071ac515e7a tempest-ProjectReaderTests-1007845069 None] Lock "cinder-quobyte-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:23 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-57783989-900a-4a3a-a0a5-7071ac515e7a tempest-ProjectReaderTests-1007845069 None] Acquiring lock "cinder-quobyte-ceaf83cf-70f2-43e0-8d1d-05cb97795f67" by "_delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:23 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-57783989-900a-4a3a-a0a5-7071ac515e7a tempest-ProjectReaderTests-1007845069 None] Lock "cinder-quobyte-ceaf83cf-70f2-43e0-8d1d-05cb97795f67" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:23 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-57783989-900a-4a3a-a0a5-7071ac515e7a tempest-ProjectReaderTests-1007845069 None] Deleting offline snapshot ceaf83cf-70f2-43e0-8d1d-05cb97795f67 of volume d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:50:23 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-57783989-900a-4a3a-a0a5-7071ac515e7a tempest-ProjectReaderTests-1007845069 None] snapshot_file for this snap is: volume-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b.ceaf83cf-70f2-43e0-8d1d-05cb97795f67 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:50:23 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[f749126f-6539-4f1d-b19b-b7448297a3af]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:50:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-57783989-900a-4a3a-a0a5-7071ac515e7a tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b.ceaf83cf-70f2-43e0-8d1d-05cb97795f67 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:23 devstack sudo[105161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b.ceaf83cf-70f2-43e0-8d1d-05cb97795f67 Aug 28 09:50:23 devstack sudo[105161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:23 devstack sudo[105161]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-57783989-900a-4a3a-a0a5-7071ac515e7a tempest-ProjectReaderTests-1007845069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b.ceaf83cf-70f2-43e0-8d1d-05cb97795f67" returned: 0 in 0.416s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:23 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-57783989-900a-4a3a-a0a5-7071ac515e7a tempest-ProjectReaderTests-1007845069 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:50:23 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb69e1e3-0a25-4114-b1cb-c3ce7304f62c]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:50:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-57783989-900a-4a3a-a0a5-7071ac515e7a tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:23 devstack sudo[105166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b Aug 28 09:50:23 devstack sudo[105166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:24 devstack sudo[105166]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-57783989-900a-4a3a-a0a5-7071ac515e7a tempest-ProjectReaderTests-1007845069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b" returned: 0 in 0.406s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-57783989-900a-4a3a-a0a5-7071ac515e7a tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b.ceaf83cf-70f2-43e0-8d1d-05cb97795f67 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:24 devstack sudo[105171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b.ceaf83cf-70f2-43e0-8d1d-05cb97795f67 Aug 28 09:50:24 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:24 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-57783989-900a-4a3a-a0a5-7071ac515e7a tempest-ProjectReaderTests-1007845069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b.ceaf83cf-70f2-43e0-8d1d-05cb97795f67" returned: 0 in 0.428s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-57783989-900a-4a3a-a0a5-7071ac515e7a tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b.ceaf83cf-70f2-43e0-8d1d-05cb97795f67 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:24 devstack sudo[105176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b.ceaf83cf-70f2-43e0-8d1d-05cb97795f67 Aug 28 09:50:24 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:24 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-57783989-900a-4a3a-a0a5-7071ac515e7a tempest-ProjectReaderTests-1007845069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b.ceaf83cf-70f2-43e0-8d1d-05cb97795f67" returned: 0 in 0.253s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:24 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-57783989-900a-4a3a-a0a5-7071ac515e7a tempest-ProjectReaderTests-1007845069 None] Lock "cinder-quobyte-ceaf83cf-70f2-43e0-8d1d-05cb97795f67" released by "_delete_snapshot" :: held 1.622s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:24 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-57783989-900a-4a3a-a0a5-7071ac515e7a tempest-ProjectReaderTests-1007845069 None] Lock "cinder-quobyte-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b" released by "delete_snapshot" :: held 1.646s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:24 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-57783989-900a-4a3a-a0a5-7071ac515e7a tempest-ProjectReaderTests-1007845069 None] Created reservations ['ce862dc0-2655-4636-9311-c4ae0e9e0af9', '70fa29e9-cae2-42b0-ac4f-2a956aaa275e', '7392bc71-a183-425f-b265-552158e9804a', '77762480-04a2-4e99-b5ab-8024bfff55b1'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:50:24 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-57783989-900a-4a3a-a0a5-7071ac515e7a tempest-ProjectReaderTests-1007845069 None] Delete snapshot completed successfully. Aug 28 09:50:24 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-57783989-900a-4a3a-a0a5-7071ac515e7a tempest-ProjectReaderTests-1007845069 None] Lock "cinder-ceaf83cf-70f2-43e0-8d1d-05cb97795f67-delete_snapshot" released by "delete_snapshot" :: held 1.801s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:25 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-1a6355dc-d3e0-44e8-8d5a-c59c6b76a136 tempest-ProjectReaderTests-1007845069 None] Acquiring lock "cinder-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:25 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-1a6355dc-d3e0-44e8-8d5a-c59c6b76a136 tempest-ProjectReaderTests-1007845069 None] Lock "cinder-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:25 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-1a6355dc-d3e0-44e8-8d5a-c59c6b76a136 tempest-ProjectReaderTests-1007845069 None] Acquiring lock "cinder-quobyte-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:25 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-1a6355dc-d3e0-44e8-8d5a-c59c6b76a136 tempest-ProjectReaderTests-1007845069 None] Lock "cinder-quobyte-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b" acquired by "delete_volume" :: waited 0.018s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:25 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a839ad-00b5-4eb3-851a-f7e78a167586]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:50:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1a6355dc-d3e0-44e8-8d5a-c59c6b76a136 tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:25 devstack sudo[105179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b Aug 28 09:50:25 devstack sudo[105179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:25 devstack sudo[105179]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1a6355dc-d3e0-44e8-8d5a-c59c6b76a136 tempest-ProjectReaderTests-1007845069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b" returned: 0 in 0.367s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1a6355dc-d3e0-44e8-8d5a-c59c6b76a136 tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:25 devstack sudo[105184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b Aug 28 09:50:25 devstack sudo[105184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:25 devstack sudo[105184]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1a6355dc-d3e0-44e8-8d5a-c59c6b76a136 tempest-ProjectReaderTests-1007845069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b" returned: 0 in 0.261s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:26 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-1a6355dc-d3e0-44e8-8d5a-c59c6b76a136 tempest-ProjectReaderTests-1007845069 None] Lock "cinder-quobyte-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b" released by "delete_volume" :: held 0.695s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:26 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-1a6355dc-d3e0-44e8-8d5a-c59c6b76a136 tempest-ProjectReaderTests-1007845069 None] Created reservations ['3f2b4f8f-437a-4b52-8469-50b3a841c0ce', '1f028f8f-a1e9-462a-a800-8bdf28c01db0', '2408bc4f-01d6-4be5-995b-2438f5556515', 'bab73cea-2317-4139-b723-f121871c1879'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:50:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-1a6355dc-d3e0-44e8-8d5a-c59c6b76a136 tempest-ProjectReaderTests-1007845069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:50:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-1a6355dc-d3e0-44e8-8d5a-c59c6b76a136 tempest-ProjectReaderTests-1007845069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:26 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-1a6355dc-d3e0-44e8-8d5a-c59c6b76a136 tempest-ProjectReaderTests-1007845069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:50:26 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-1a6355dc-d3e0-44e8-8d5a-c59c6b76a136 tempest-ProjectReaderTests-1007845069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:50:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-1a6355dc-d3e0-44e8-8d5a-c59c6b76a136 tempest-ProjectReaderTests-1007845069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1a6355dc-d3e0-44e8-8d5a-c59c6b76a136 tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:26 devstack sudo[105187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:50:26 devstack sudo[105187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:26 devstack sudo[105187]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1a6355dc-d3e0-44e8-8d5a-c59c6b76a136 tempest-ProjectReaderTests-1007845069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.274s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:26 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-1a6355dc-d3e0-44e8-8d5a-c59c6b76a136 tempest-ProjectReaderTests-1007845069 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:50:26 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-1a6355dc-d3e0-44e8-8d5a-c59c6b76a136 tempest-ProjectReaderTests-1007845069 None] Deleted volume successfully. Aug 28 09:50:26 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-1a6355dc-d3e0-44e8-8d5a-c59c6b76a136 tempest-ProjectReaderTests-1007845069 None] Lock "cinder-d4f67b92-e3d7-42e4-b0de-fcb9bedaec5b-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:26 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1b3162c-8143-4fd2-8078-e047f7dcabf5 tempest-ProjectReaderTests-1007845069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:50:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b1b3162c-8143-4fd2-8078-e047f7dcabf5 tempest-ProjectReaderTests-1007845069 None] Flow 'volume_create_manager' (27ea6c47-eb7a-4dc3-bcbb-82492159cca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:50:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b1b3162c-8143-4fd2-8078-e047f7dcabf5 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (942e0b4c-841e-44e4-8d8c-ae9aa89491de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b1b3162c-8143-4fd2-8078-e047f7dcabf5 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (942e0b4c-841e-44e4-8d8c-ae9aa89491de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:50:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-639690121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d22e88d5-6577-4798-98a4-3805acf2d703,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0a1ea6b99c7413e9fb54892d96af172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:50:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:50:27Z,use_quota=True,user_id='40fe0546d5a249bcb1fd3247e64d4590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b1b3162c-8143-4fd2-8078-e047f7dcabf5 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43eeeb4e-60b2-4beb-b3f1-91e84f87d9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b1b3162c-8143-4fd2-8078-e047f7dcabf5 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43eeeb4e-60b2-4beb-b3f1-91e84f87d9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b1b3162c-8143-4fd2-8078-e047f7dcabf5 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88faaa95-17f4-4f42-b035-90362bd3ca9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b1b3162c-8143-4fd2-8078-e047f7dcabf5 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88faaa95-17f4-4f42-b035-90362bd3ca9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd22e88d5-6577-4798-98a4-3805acf2d703', 'volume_name': 'volume-d22e88d5-6577-4798-98a4-3805acf2d703', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b1b3162c-8143-4fd2-8078-e047f7dcabf5 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4027391c-8352-4939-9219-78a50c1c8325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b1b3162c-8143-4fd2-8078-e047f7dcabf5 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4027391c-8352-4939-9219-78a50c1c8325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:26 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b1b3162c-8143-4fd2-8078-e047f7dcabf5 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8a05cf1-fe14-4c0a-87dd-b0cd828f0120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:26 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-b1b3162c-8143-4fd2-8078-e047f7dcabf5 tempest-ProjectReaderTests-1007845069 None] Volume d22e88d5-6577-4798-98a4-3805acf2d703: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d22e88d5-6577-4798-98a4-3805acf2d703', 'volume_size': 1} Aug 28 09:50:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b1b3162c-8143-4fd2-8078-e047f7dcabf5 tempest-ProjectReaderTests-1007845069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:50:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b1b3162c-8143-4fd2-8078-e047f7dcabf5 tempest-ProjectReaderTests-1007845069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:26 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-b1b3162c-8143-4fd2-8078-e047f7dcabf5 tempest-ProjectReaderTests-1007845069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:50:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-639690121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d22e88d5-6577-4798-98a4-3805acf2d703,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0a1ea6b99c7413e9fb54892d96af172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:50:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:50:27Z,use_quota=True,user_id='40fe0546d5a249bcb1fd3247e64d4590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:50:26 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-b1b3162c-8143-4fd2-8078-e047f7dcabf5 tempest-ProjectReaderTests-1007845069 None] Creating volume d22e88d5-6577-4798-98a4-3805acf2d703 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:50:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b1b3162c-8143-4fd2-8078-e047f7dcabf5 tempest-ProjectReaderTests-1007845069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:50:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b1b3162c-8143-4fd2-8078-e047f7dcabf5 tempest-ProjectReaderTests-1007845069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:26 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-b1b3162c-8143-4fd2-8078-e047f7dcabf5 tempest-ProjectReaderTests-1007845069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:50:26 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-b1b3162c-8143-4fd2-8078-e047f7dcabf5 tempest-ProjectReaderTests-1007845069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:50:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b1b3162c-8143-4fd2-8078-e047f7dcabf5 tempest-ProjectReaderTests-1007845069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:26 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-b1b3162c-8143-4fd2-8078-e047f7dcabf5 tempest-ProjectReaderTests-1007845069 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:50:26 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-b1b3162c-8143-4fd2-8078-e047f7dcabf5 tempest-ProjectReaderTests-1007845069 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:50:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b1b3162c-8143-4fd2-8078-e047f7dcabf5 tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d22e88d5-6577-4798-98a4-3805acf2d703 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:26 devstack sudo[105190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d22e88d5-6577-4798-98a4-3805acf2d703 1073741824 Aug 28 09:50:26 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:27 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fa20fc0-e135-497c-a4d2-5ff8f07778ff tempest-ProjectMemberTests-1488584303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:50:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5fa20fc0-e135-497c-a4d2-5ff8f07778ff tempest-ProjectMemberTests-1488584303 None] Flow 'volume_create_manager' (675fd97a-9c46-414b-bf8d-a2d95202dda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:50:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5fa20fc0-e135-497c-a4d2-5ff8f07778ff tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f11b48d-0b6e-48d2-863e-f2bbe005c576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5fa20fc0-e135-497c-a4d2-5ff8f07778ff tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f11b48d-0b6e-48d2-863e-f2bbe005c576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:50:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1155321838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d941f5f-a670-4c6d-b95a-d3cb81aafae2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b056b8e115744d6a55a8cf4e112ebe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:50:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:50:27Z,use_quota=True,user_id='7e7fc1a0e4d74db1a1b75434c7703666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5fa20fc0-e135-497c-a4d2-5ff8f07778ff tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c02c0eba-209a-4a1d-8a6b-9de6e00238d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5fa20fc0-e135-497c-a4d2-5ff8f07778ff tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c02c0eba-209a-4a1d-8a6b-9de6e00238d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5fa20fc0-e135-497c-a4d2-5ff8f07778ff tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d94019e0-19d4-4e09-80d1-fb1626fcad99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5fa20fc0-e135-497c-a4d2-5ff8f07778ff tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d94019e0-19d4-4e09-80d1-fb1626fcad99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d941f5f-a670-4c6d-b95a-d3cb81aafae2', 'volume_name': 'volume-9d941f5f-a670-4c6d-b95a-d3cb81aafae2', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5fa20fc0-e135-497c-a4d2-5ff8f07778ff tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66228288-2463-47b8-8523-615b5dcc1f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5fa20fc0-e135-497c-a4d2-5ff8f07778ff tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66228288-2463-47b8-8523-615b5dcc1f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5fa20fc0-e135-497c-a4d2-5ff8f07778ff tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78e3184e-5f3f-47a8-95a0-c7ff099272fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:27 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-5fa20fc0-e135-497c-a4d2-5ff8f07778ff tempest-ProjectMemberTests-1488584303 None] Volume 9d941f5f-a670-4c6d-b95a-d3cb81aafae2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d941f5f-a670-4c6d-b95a-d3cb81aafae2', 'volume_size': 1} Aug 28 09:50:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-5fa20fc0-e135-497c-a4d2-5ff8f07778ff tempest-ProjectMemberTests-1488584303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:50:27 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b1b3162c-8143-4fd2-8078-e047f7dcabf5 tempest-ProjectReaderTests-1007845069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d22e88d5-6577-4798-98a4-3805acf2d703 1073741824" returned: 0 in 0.448s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b1b3162c-8143-4fd2-8078-e047f7dcabf5 tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d22e88d5-6577-4798-98a4-3805acf2d703 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:27 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d22e88d5-6577-4798-98a4-3805acf2d703 Aug 28 09:50:27 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:27 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b1b3162c-8143-4fd2-8078-e047f7dcabf5 tempest-ProjectReaderTests-1007845069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d22e88d5-6577-4798-98a4-3805acf2d703" returned: 0 in 0.239s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:27 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-b1b3162c-8143-4fd2-8078-e047f7dcabf5 tempest-ProjectReaderTests-1007845069 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:50:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b1b3162c-8143-4fd2-8078-e047f7dcabf5 tempest-ProjectReaderTests-1007845069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-5fa20fc0-e135-497c-a4d2-5ff8f07778ff tempest-ProjectMemberTests-1488584303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.326s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:27 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-5fa20fc0-e135-497c-a4d2-5ff8f07778ff tempest-ProjectMemberTests-1488584303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:50:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1155321838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d941f5f-a670-4c6d-b95a-d3cb81aafae2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b056b8e115744d6a55a8cf4e112ebe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:50:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:50:27Z,use_quota=True,user_id='7e7fc1a0e4d74db1a1b75434c7703666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:50:27 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-5fa20fc0-e135-497c-a4d2-5ff8f07778ff tempest-ProjectMemberTests-1488584303 None] Creating volume 9d941f5f-a670-4c6d-b95a-d3cb81aafae2 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:50:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-5fa20fc0-e135-497c-a4d2-5ff8f07778ff tempest-ProjectMemberTests-1488584303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:50:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-5fa20fc0-e135-497c-a4d2-5ff8f07778ff tempest-ProjectMemberTests-1488584303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:27 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-5fa20fc0-e135-497c-a4d2-5ff8f07778ff tempest-ProjectMemberTests-1488584303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:50:27 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-5fa20fc0-e135-497c-a4d2-5ff8f07778ff tempest-ProjectMemberTests-1488584303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:50:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-5fa20fc0-e135-497c-a4d2-5ff8f07778ff tempest-ProjectMemberTests-1488584303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:27 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-5fa20fc0-e135-497c-a4d2-5ff8f07778ff tempest-ProjectMemberTests-1488584303 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:50:27 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-5fa20fc0-e135-497c-a4d2-5ff8f07778ff tempest-ProjectMemberTests-1488584303 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:50:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5fa20fc0-e135-497c-a4d2-5ff8f07778ff tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d941f5f-a670-4c6d-b95a-d3cb81aafae2 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b1b3162c-8143-4fd2-8078-e047f7dcabf5 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8a05cf1-fe14-4c0a-87dd-b0cd828f0120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d22e88d5-6577-4798-98a4-3805acf2d703', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:27 devstack sudo[105199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d941f5f-a670-4c6d-b95a-d3cb81aafae2 1073741824 Aug 28 09:50:27 devstack sudo[105199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b1b3162c-8143-4fd2-8078-e047f7dcabf5 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcf5e9e0-3073-4a46-a6a1-1b5644b47b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:27 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-b1b3162c-8143-4fd2-8078-e047f7dcabf5 tempest-ProjectReaderTests-1007845069 None] Volume volume-d22e88d5-6577-4798-98a4-3805acf2d703 (d22e88d5-6577-4798-98a4-3805acf2d703): created successfully Aug 28 09:50:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b1b3162c-8143-4fd2-8078-e047f7dcabf5 tempest-ProjectReaderTests-1007845069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcf5e9e0-3073-4a46-a6a1-1b5644b47b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:27 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-b1b3162c-8143-4fd2-8078-e047f7dcabf5 tempest-ProjectReaderTests-1007845069 None] Flow 'volume_create_manager' (27ea6c47-eb7a-4dc3-bcbb-82492159cca0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:50:27 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-b1b3162c-8143-4fd2-8078-e047f7dcabf5 tempest-ProjectReaderTests-1007845069 None] Created volume successfully. Aug 28 09:50:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-3f6a1fd3-2e14-4635-935e-55c6e7aaf27d tempest-ProjectReaderTests-1007845069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:50:28 devstack sudo[105199]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5fa20fc0-e135-497c-a4d2-5ff8f07778ff tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d941f5f-a670-4c6d-b95a-d3cb81aafae2 1073741824" returned: 0 in 0.450s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5fa20fc0-e135-497c-a4d2-5ff8f07778ff tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d941f5f-a670-4c6d-b95a-d3cb81aafae2 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:28 devstack sudo[105204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d941f5f-a670-4c6d-b95a-d3cb81aafae2 Aug 28 09:50:28 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:28 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5fa20fc0-e135-497c-a4d2-5ff8f07778ff tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d941f5f-a670-4c6d-b95a-d3cb81aafae2" returned: 0 in 0.256s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:28 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-5fa20fc0-e135-497c-a4d2-5ff8f07778ff tempest-ProjectMemberTests-1488584303 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:50:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-5fa20fc0-e135-497c-a4d2-5ff8f07778ff tempest-ProjectMemberTests-1488584303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-3f6a1fd3-2e14-4635-935e-55c6e7aaf27d tempest-ProjectReaderTests-1007845069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.365s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5fa20fc0-e135-497c-a4d2-5ff8f07778ff tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78e3184e-5f3f-47a8-95a0-c7ff099272fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d941f5f-a670-4c6d-b95a-d3cb81aafae2', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5fa20fc0-e135-497c-a4d2-5ff8f07778ff tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca1acee-2a06-4367-a618-d1271e76de6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:28 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-3f6a1fd3-2e14-4635-935e-55c6e7aaf27d tempest-ProjectReaderTests-1007845069 None] Creating offline snapshot b7a9afdf-b136-4e0c-a911-5fc9e8e3e5a9 of volume d22e88d5-6577-4798-98a4-3805acf2d703 {{(pid=86081) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:50:28 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-5fa20fc0-e135-497c-a4d2-5ff8f07778ff tempest-ProjectMemberTests-1488584303 None] Volume volume-9d941f5f-a670-4c6d-b95a-d3cb81aafae2 (9d941f5f-a670-4c6d-b95a-d3cb81aafae2): created successfully Aug 28 09:50:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5fa20fc0-e135-497c-a4d2-5ff8f07778ff tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca1acee-2a06-4367-a618-d1271e76de6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:28 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-5fa20fc0-e135-497c-a4d2-5ff8f07778ff tempest-ProjectMemberTests-1488584303 None] Flow 'volume_create_manager' (675fd97a-9c46-414b-bf8d-a2d95202dda2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:50:28 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3413b9-a78e-4f34-918b-6ab2ac981a79]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:50:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3f6a1fd3-2e14-4635-935e-55c6e7aaf27d tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d22e88d5-6577-4798-98a4-3805acf2d703 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:28 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-5fa20fc0-e135-497c-a4d2-5ff8f07778ff tempest-ProjectMemberTests-1488584303 None] Created volume successfully. Aug 28 09:50:28 devstack sudo[105207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d22e88d5-6577-4798-98a4-3805acf2d703 Aug 28 09:50:28 devstack sudo[105207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:28 devstack sudo[105207]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3f6a1fd3-2e14-4635-935e-55c6e7aaf27d tempest-ProjectReaderTests-1007845069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d22e88d5-6577-4798-98a4-3805acf2d703" returned: 0 in 0.344s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3f6a1fd3-2e14-4635-935e-55c6e7aaf27d tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d22e88d5-6577-4798-98a4-3805acf2d703,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d22e88d5-6577-4798-98a4-3805acf2d703.b7a9afdf-b136-4e0c-a911-5fc9e8e3e5a9 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:28 devstack sudo[105212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d22e88d5-6577-4798-98a4-3805acf2d703,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d22e88d5-6577-4798-98a4-3805acf2d703.b7a9afdf-b136-4e0c-a911-5fc9e8e3e5a9 1G Aug 28 09:50:28 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:29 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3f6a1fd3-2e14-4635-935e-55c6e7aaf27d tempest-ProjectReaderTests-1007845069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d22e88d5-6577-4798-98a4-3805acf2d703,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d22e88d5-6577-4798-98a4-3805acf2d703.b7a9afdf-b136-4e0c-a911-5fc9e8e3e5a9 1G" returned: 0 in 0.391s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3f6a1fd3-2e14-4635-935e-55c6e7aaf27d tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d22e88d5-6577-4798-98a4-3805acf2d703 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d22e88d5-6577-4798-98a4-3805acf2d703.b7a9afdf-b136-4e0c-a911-5fc9e8e3e5a9 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:29 devstack sudo[105218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d22e88d5-6577-4798-98a4-3805acf2d703 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d22e88d5-6577-4798-98a4-3805acf2d703.b7a9afdf-b136-4e0c-a911-5fc9e8e3e5a9 Aug 28 09:50:29 devstack sudo[105218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:29 devstack sudo[105218]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3f6a1fd3-2e14-4635-935e-55c6e7aaf27d tempest-ProjectReaderTests-1007845069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d22e88d5-6577-4798-98a4-3805acf2d703 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d22e88d5-6577-4798-98a4-3805acf2d703.b7a9afdf-b136-4e0c-a911-5fc9e8e3e5a9" returned: 0 in 0.302s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:29 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-3f6a1fd3-2e14-4635-935e-55c6e7aaf27d tempest-ProjectReaderTests-1007845069 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d22e88d5-6577-4798-98a4-3805acf2d703.b7a9afdf-b136-4e0c-a911-5fc9e8e3e5a9 is being set with open permissions: ugo+rw Aug 28 09:50:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3f6a1fd3-2e14-4635-935e-55c6e7aaf27d tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d22e88d5-6577-4798-98a4-3805acf2d703.b7a9afdf-b136-4e0c-a911-5fc9e8e3e5a9 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:29 devstack sudo[105224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d22e88d5-6577-4798-98a4-3805acf2d703.b7a9afdf-b136-4e0c-a911-5fc9e8e3e5a9 Aug 28 09:50:29 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:29 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3f6a1fd3-2e14-4635-935e-55c6e7aaf27d tempest-ProjectReaderTests-1007845069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d22e88d5-6577-4798-98a4-3805acf2d703.b7a9afdf-b136-4e0c-a911-5fc9e8e3e5a9" returned: 0 in 0.258s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3f6a1fd3-2e14-4635-935e-55c6e7aaf27d tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d22e88d5-6577-4798-98a4-3805acf2d703.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:29 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d22e88d5-6577-4798-98a4-3805acf2d703.info Aug 28 09:50:29 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-84ea80d9-ee53-4213-a138-427104ef716b tempest-ProjectMemberTests-1488584303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:50:30 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3f6a1fd3-2e14-4635-935e-55c6e7aaf27d tempest-ProjectReaderTests-1007845069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d22e88d5-6577-4798-98a4-3805acf2d703.info" returned: 0 in 0.250s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:30 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-3f6a1fd3-2e14-4635-935e-55c6e7aaf27d tempest-ProjectReaderTests-1007845069 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d22e88d5-6577-4798-98a4-3805acf2d703.info is being set with open permissions: ugo+rw Aug 28 09:50:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3f6a1fd3-2e14-4635-935e-55c6e7aaf27d tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d22e88d5-6577-4798-98a4-3805acf2d703.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:30 devstack sudo[105230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d22e88d5-6577-4798-98a4-3805acf2d703.info Aug 28 09:50:30 devstack sudo[105230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:30 devstack sudo[105230]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3f6a1fd3-2e14-4635-935e-55c6e7aaf27d tempest-ProjectReaderTests-1007845069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d22e88d5-6577-4798-98a4-3805acf2d703.info" returned: 0 in 0.241s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-3f6a1fd3-2e14-4635-935e-55c6e7aaf27d tempest-ProjectReaderTests-1007845069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.895s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-84ea80d9-ee53-4213-a138-427104ef716b tempest-ProjectMemberTests-1488584303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.473s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:30 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-84ea80d9-ee53-4213-a138-427104ef716b tempest-ProjectMemberTests-1488584303 None] Creating offline snapshot 67d83288-b7cc-4575-89e5-2f8c7f2abbc6 of volume 9d941f5f-a670-4c6d-b95a-d3cb81aafae2 {{(pid=86081) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:50:30 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-3f6a1fd3-2e14-4635-935e-55c6e7aaf27d tempest-ProjectReaderTests-1007845069 None] Create snapshot completed successfully Aug 28 09:50:30 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[06667a1d-34fb-44db-8ad8-4b4f976d6e7d]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:50:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-84ea80d9-ee53-4213-a138-427104ef716b tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d941f5f-a670-4c6d-b95a-d3cb81aafae2 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:30 devstack sudo[105233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d941f5f-a670-4c6d-b95a-d3cb81aafae2 Aug 28 09:50:30 devstack sudo[105233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:30 devstack sudo[105233]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-84ea80d9-ee53-4213-a138-427104ef716b tempest-ProjectMemberTests-1488584303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d941f5f-a670-4c6d-b95a-d3cb81aafae2" returned: 0 in 0.348s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-84ea80d9-ee53-4213-a138-427104ef716b tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d941f5f-a670-4c6d-b95a-d3cb81aafae2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d941f5f-a670-4c6d-b95a-d3cb81aafae2.67d83288-b7cc-4575-89e5-2f8c7f2abbc6 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:30 devstack sudo[105238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d941f5f-a670-4c6d-b95a-d3cb81aafae2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d941f5f-a670-4c6d-b95a-d3cb81aafae2.67d83288-b7cc-4575-89e5-2f8c7f2abbc6 1G Aug 28 09:50:30 devstack sudo[105238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:31 devstack sudo[105238]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-84ea80d9-ee53-4213-a138-427104ef716b tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d941f5f-a670-4c6d-b95a-d3cb81aafae2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d941f5f-a670-4c6d-b95a-d3cb81aafae2.67d83288-b7cc-4575-89e5-2f8c7f2abbc6 1G" returned: 0 in 0.385s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-84ea80d9-ee53-4213-a138-427104ef716b tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d941f5f-a670-4c6d-b95a-d3cb81aafae2 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d941f5f-a670-4c6d-b95a-d3cb81aafae2.67d83288-b7cc-4575-89e5-2f8c7f2abbc6 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:31 devstack sudo[105244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d941f5f-a670-4c6d-b95a-d3cb81aafae2 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d941f5f-a670-4c6d-b95a-d3cb81aafae2.67d83288-b7cc-4575-89e5-2f8c7f2abbc6 Aug 28 09:50:31 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:31 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c32001a1-518b-48a6-a7de-3f1a24a8f13b tempest-ProjectReaderTests-1007845069 None] Acquiring lock "cinder-b7a9afdf-b136-4e0c-a911-5fc9e8e3e5a9-delete_snapshot" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:31 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c32001a1-518b-48a6-a7de-3f1a24a8f13b tempest-ProjectReaderTests-1007845069 None] Lock "cinder-b7a9afdf-b136-4e0c-a911-5fc9e8e3e5a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:31 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c32001a1-518b-48a6-a7de-3f1a24a8f13b tempest-ProjectReaderTests-1007845069 None] Acquiring lock "cinder-quobyte-d22e88d5-6577-4798-98a4-3805acf2d703" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:31 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c32001a1-518b-48a6-a7de-3f1a24a8f13b tempest-ProjectReaderTests-1007845069 None] Lock "cinder-quobyte-d22e88d5-6577-4798-98a4-3805acf2d703" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:31 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c32001a1-518b-48a6-a7de-3f1a24a8f13b tempest-ProjectReaderTests-1007845069 None] Acquiring lock "cinder-quobyte-b7a9afdf-b136-4e0c-a911-5fc9e8e3e5a9" by "_delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:31 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c32001a1-518b-48a6-a7de-3f1a24a8f13b tempest-ProjectReaderTests-1007845069 None] Lock "cinder-quobyte-b7a9afdf-b136-4e0c-a911-5fc9e8e3e5a9" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:31 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-c32001a1-518b-48a6-a7de-3f1a24a8f13b tempest-ProjectReaderTests-1007845069 None] Deleting offline snapshot b7a9afdf-b136-4e0c-a911-5fc9e8e3e5a9 of volume d22e88d5-6577-4798-98a4-3805acf2d703 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:50:31 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-c32001a1-518b-48a6-a7de-3f1a24a8f13b tempest-ProjectReaderTests-1007845069 None] snapshot_file for this snap is: volume-d22e88d5-6577-4798-98a4-3805acf2d703.b7a9afdf-b136-4e0c-a911-5fc9e8e3e5a9 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:50:31 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d220a9-4dab-426f-a07d-bb40f505026d]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:50:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c32001a1-518b-48a6-a7de-3f1a24a8f13b tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d22e88d5-6577-4798-98a4-3805acf2d703.b7a9afdf-b136-4e0c-a911-5fc9e8e3e5a9 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:31 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-84ea80d9-ee53-4213-a138-427104ef716b tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d941f5f-a670-4c6d-b95a-d3cb81aafae2 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d941f5f-a670-4c6d-b95a-d3cb81aafae2.67d83288-b7cc-4575-89e5-2f8c7f2abbc6" returned: 0 in 0.309s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:31 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-84ea80d9-ee53-4213-a138-427104ef716b tempest-ProjectMemberTests-1488584303 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d941f5f-a670-4c6d-b95a-d3cb81aafae2.67d83288-b7cc-4575-89e5-2f8c7f2abbc6 is being set with open permissions: ugo+rw Aug 28 09:50:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-84ea80d9-ee53-4213-a138-427104ef716b tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d941f5f-a670-4c6d-b95a-d3cb81aafae2.67d83288-b7cc-4575-89e5-2f8c7f2abbc6 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:31 devstack sudo[105250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d941f5f-a670-4c6d-b95a-d3cb81aafae2.67d83288-b7cc-4575-89e5-2f8c7f2abbc6 Aug 28 09:50:31 devstack sudo[105250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:31 devstack sudo[105248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d22e88d5-6577-4798-98a4-3805acf2d703.b7a9afdf-b136-4e0c-a911-5fc9e8e3e5a9 Aug 28 09:50:31 devstack sudo[105248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:31 devstack sudo[105250]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-84ea80d9-ee53-4213-a138-427104ef716b tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d941f5f-a670-4c6d-b95a-d3cb81aafae2.67d83288-b7cc-4575-89e5-2f8c7f2abbc6" returned: 0 in 0.245s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-84ea80d9-ee53-4213-a138-427104ef716b tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d941f5f-a670-4c6d-b95a-d3cb81aafae2.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:31 devstack sudo[105248]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c32001a1-518b-48a6-a7de-3f1a24a8f13b tempest-ProjectReaderTests-1007845069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d22e88d5-6577-4798-98a4-3805acf2d703.b7a9afdf-b136-4e0c-a911-5fc9e8e3e5a9" returned: 0 in 0.380s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:31 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-c32001a1-518b-48a6-a7de-3f1a24a8f13b tempest-ProjectReaderTests-1007845069 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d22e88d5-6577-4798-98a4-3805acf2d703(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:50:31 devstack sudo[105258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d941f5f-a670-4c6d-b95a-d3cb81aafae2.info Aug 28 09:50:31 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:31 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[0976ae09-b099-49d0-96d3-bae74fe5fce6]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:50:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c32001a1-518b-48a6-a7de-3f1a24a8f13b tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d22e88d5-6577-4798-98a4-3805acf2d703 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:31 devstack sudo[105260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d22e88d5-6577-4798-98a4-3805acf2d703 Aug 28 09:50:31 devstack sudo[105260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:31 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-84ea80d9-ee53-4213-a138-427104ef716b tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d941f5f-a670-4c6d-b95a-d3cb81aafae2.info" returned: 0 in 0.253s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:31 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-84ea80d9-ee53-4213-a138-427104ef716b tempest-ProjectMemberTests-1488584303 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d941f5f-a670-4c6d-b95a-d3cb81aafae2.info is being set with open permissions: ugo+rw Aug 28 09:50:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-84ea80d9-ee53-4213-a138-427104ef716b tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d941f5f-a670-4c6d-b95a-d3cb81aafae2.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:31 devstack sudo[105263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d941f5f-a670-4c6d-b95a-d3cb81aafae2.info Aug 28 09:50:31 devstack sudo[105263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:32 devstack sudo[105260]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c32001a1-518b-48a6-a7de-3f1a24a8f13b tempest-ProjectReaderTests-1007845069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d22e88d5-6577-4798-98a4-3805acf2d703" returned: 0 in 0.368s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c32001a1-518b-48a6-a7de-3f1a24a8f13b tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d22e88d5-6577-4798-98a4-3805acf2d703.b7a9afdf-b136-4e0c-a911-5fc9e8e3e5a9 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:32 devstack sudo[105268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d22e88d5-6577-4798-98a4-3805acf2d703.b7a9afdf-b136-4e0c-a911-5fc9e8e3e5a9 Aug 28 09:50:32 devstack sudo[105268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:32 devstack sudo[105263]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-84ea80d9-ee53-4213-a138-427104ef716b tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d941f5f-a670-4c6d-b95a-d3cb81aafae2.info" returned: 0 in 0.248s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-84ea80d9-ee53-4213-a138-427104ef716b tempest-ProjectMemberTests-1488584303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.895s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:32 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-84ea80d9-ee53-4213-a138-427104ef716b tempest-ProjectMemberTests-1488584303 None] Create snapshot completed successfully Aug 28 09:50:32 devstack sudo[105268]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c32001a1-518b-48a6-a7de-3f1a24a8f13b tempest-ProjectReaderTests-1007845069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d22e88d5-6577-4798-98a4-3805acf2d703.b7a9afdf-b136-4e0c-a911-5fc9e8e3e5a9" returned: 0 in 0.354s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c32001a1-518b-48a6-a7de-3f1a24a8f13b tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d22e88d5-6577-4798-98a4-3805acf2d703.b7a9afdf-b136-4e0c-a911-5fc9e8e3e5a9 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:32 devstack sudo[105274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d22e88d5-6577-4798-98a4-3805acf2d703.b7a9afdf-b136-4e0c-a911-5fc9e8e3e5a9 Aug 28 09:50:32 devstack sudo[105274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:32 devstack sudo[105274]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c32001a1-518b-48a6-a7de-3f1a24a8f13b tempest-ProjectReaderTests-1007845069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d22e88d5-6577-4798-98a4-3805acf2d703.b7a9afdf-b136-4e0c-a911-5fc9e8e3e5a9" returned: 0 in 0.237s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:32 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c32001a1-518b-48a6-a7de-3f1a24a8f13b tempest-ProjectReaderTests-1007845069 None] Lock "cinder-quobyte-b7a9afdf-b136-4e0c-a911-5fc9e8e3e5a9" released by "_delete_snapshot" :: held 1.430s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:32 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c32001a1-518b-48a6-a7de-3f1a24a8f13b tempest-ProjectReaderTests-1007845069 None] Lock "cinder-quobyte-d22e88d5-6577-4798-98a4-3805acf2d703" released by "delete_snapshot" :: held 1.452s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:32 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-c32001a1-518b-48a6-a7de-3f1a24a8f13b tempest-ProjectReaderTests-1007845069 None] Created reservations ['5d549405-fb8b-4ea0-b32a-db6f5f793c2e', '363ca9fb-225e-421f-9ca8-7fc2eb49cbf6', 'f0284f1d-eae6-4e69-8df5-8da4025aad7c', '37dd789b-8558-4696-bfe1-62066fe04e6e'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:50:32 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-c32001a1-518b-48a6-a7de-3f1a24a8f13b tempest-ProjectReaderTests-1007845069 None] Delete snapshot completed successfully. Aug 28 09:50:32 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c32001a1-518b-48a6-a7de-3f1a24a8f13b tempest-ProjectReaderTests-1007845069 None] Lock "cinder-b7a9afdf-b136-4e0c-a911-5fc9e8e3e5a9-delete_snapshot" released by "delete_snapshot" :: held 1.581s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:32 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c8f3fb20-71fb-46a3-9247-b83c93103e36 tempest-ProjectMemberTests-1488584303 None] Acquiring lock "cinder-67d83288-b7cc-4575-89e5-2f8c7f2abbc6-delete_snapshot" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:33 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c8f3fb20-71fb-46a3-9247-b83c93103e36 tempest-ProjectMemberTests-1488584303 None] Lock "cinder-67d83288-b7cc-4575-89e5-2f8c7f2abbc6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:33 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c8f3fb20-71fb-46a3-9247-b83c93103e36 tempest-ProjectMemberTests-1488584303 None] Acquiring lock "cinder-quobyte-9d941f5f-a670-4c6d-b95a-d3cb81aafae2" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:33 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c8f3fb20-71fb-46a3-9247-b83c93103e36 tempest-ProjectMemberTests-1488584303 None] Lock "cinder-quobyte-9d941f5f-a670-4c6d-b95a-d3cb81aafae2" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:33 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c8f3fb20-71fb-46a3-9247-b83c93103e36 tempest-ProjectMemberTests-1488584303 None] Acquiring lock "cinder-quobyte-67d83288-b7cc-4575-89e5-2f8c7f2abbc6" by "_delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:33 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c8f3fb20-71fb-46a3-9247-b83c93103e36 tempest-ProjectMemberTests-1488584303 None] Lock "cinder-quobyte-67d83288-b7cc-4575-89e5-2f8c7f2abbc6" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:33 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-c8f3fb20-71fb-46a3-9247-b83c93103e36 tempest-ProjectMemberTests-1488584303 None] Deleting offline snapshot 67d83288-b7cc-4575-89e5-2f8c7f2abbc6 of volume 9d941f5f-a670-4c6d-b95a-d3cb81aafae2 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:50:33 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-c8f3fb20-71fb-46a3-9247-b83c93103e36 tempest-ProjectMemberTests-1488584303 None] snapshot_file for this snap is: volume-9d941f5f-a670-4c6d-b95a-d3cb81aafae2.67d83288-b7cc-4575-89e5-2f8c7f2abbc6 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:50:33 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9bb35b-41d3-4077-bd61-84d645efb159]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:50:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c8f3fb20-71fb-46a3-9247-b83c93103e36 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d941f5f-a670-4c6d-b95a-d3cb81aafae2.67d83288-b7cc-4575-89e5-2f8c7f2abbc6 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:33 devstack sudo[105277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d941f5f-a670-4c6d-b95a-d3cb81aafae2.67d83288-b7cc-4575-89e5-2f8c7f2abbc6 Aug 28 09:50:33 devstack sudo[105277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:33 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-3d1d98da-4a28-46cf-8472-a3676128e592 tempest-ProjectReaderTests-1007845069 None] Acquiring lock "cinder-d22e88d5-6577-4798-98a4-3805acf2d703-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:33 devstack sudo[105277]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c8f3fb20-71fb-46a3-9247-b83c93103e36 tempest-ProjectMemberTests-1488584303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d941f5f-a670-4c6d-b95a-d3cb81aafae2.67d83288-b7cc-4575-89e5-2f8c7f2abbc6" returned: 0 in 0.367s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:33 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-c8f3fb20-71fb-46a3-9247-b83c93103e36 tempest-ProjectMemberTests-1488584303 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d941f5f-a670-4c6d-b95a-d3cb81aafae2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:50:33 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-3d1d98da-4a28-46cf-8472-a3676128e592 tempest-ProjectReaderTests-1007845069 None] Lock "cinder-d22e88d5-6577-4798-98a4-3805acf2d703-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:33 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[99884963-916d-4181-a52c-b03935120562]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:50:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c8f3fb20-71fb-46a3-9247-b83c93103e36 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d941f5f-a670-4c6d-b95a-d3cb81aafae2 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:33 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-3d1d98da-4a28-46cf-8472-a3676128e592 tempest-ProjectReaderTests-1007845069 None] Acquiring lock "cinder-quobyte-d22e88d5-6577-4798-98a4-3805acf2d703" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:33 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-3d1d98da-4a28-46cf-8472-a3676128e592 tempest-ProjectReaderTests-1007845069 None] Lock "cinder-quobyte-d22e88d5-6577-4798-98a4-3805acf2d703" acquired by "delete_volume" :: waited 0.016s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:33 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a211bad-4893-4810-83d3-1fd2f07a226c]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:50:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3d1d98da-4a28-46cf-8472-a3676128e592 tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d22e88d5-6577-4798-98a4-3805acf2d703 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:33 devstack sudo[105283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d941f5f-a670-4c6d-b95a-d3cb81aafae2 Aug 28 09:50:33 devstack sudo[105283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:33 devstack sudo[105284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d22e88d5-6577-4798-98a4-3805acf2d703 Aug 28 09:50:33 devstack sudo[105284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:33 devstack sudo[105283]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c8f3fb20-71fb-46a3-9247-b83c93103e36 tempest-ProjectMemberTests-1488584303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d941f5f-a670-4c6d-b95a-d3cb81aafae2" returned: 0 in 0.353s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c8f3fb20-71fb-46a3-9247-b83c93103e36 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d941f5f-a670-4c6d-b95a-d3cb81aafae2.67d83288-b7cc-4575-89e5-2f8c7f2abbc6 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:33 devstack sudo[105290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d941f5f-a670-4c6d-b95a-d3cb81aafae2.67d83288-b7cc-4575-89e5-2f8c7f2abbc6 Aug 28 09:50:33 devstack sudo[105290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:33 devstack sudo[105284]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3d1d98da-4a28-46cf-8472-a3676128e592 tempest-ProjectReaderTests-1007845069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d22e88d5-6577-4798-98a4-3805acf2d703" returned: 0 in 0.385s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3d1d98da-4a28-46cf-8472-a3676128e592 tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d22e88d5-6577-4798-98a4-3805acf2d703 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:33 devstack sudo[105295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d22e88d5-6577-4798-98a4-3805acf2d703 Aug 28 09:50:33 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:34 devstack sudo[105290]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c8f3fb20-71fb-46a3-9247-b83c93103e36 tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d941f5f-a670-4c6d-b95a-d3cb81aafae2.67d83288-b7cc-4575-89e5-2f8c7f2abbc6" returned: 0 in 0.339s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c8f3fb20-71fb-46a3-9247-b83c93103e36 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d941f5f-a670-4c6d-b95a-d3cb81aafae2.67d83288-b7cc-4575-89e5-2f8c7f2abbc6 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:34 devstack sudo[105300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d941f5f-a670-4c6d-b95a-d3cb81aafae2.67d83288-b7cc-4575-89e5-2f8c7f2abbc6 Aug 28 09:50:34 devstack sudo[105300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:34 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3d1d98da-4a28-46cf-8472-a3676128e592 tempest-ProjectReaderTests-1007845069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-d22e88d5-6577-4798-98a4-3805acf2d703" returned: 0 in 0.275s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:34 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-3d1d98da-4a28-46cf-8472-a3676128e592 tempest-ProjectReaderTests-1007845069 None] Lock "cinder-quobyte-d22e88d5-6577-4798-98a4-3805acf2d703" released by "delete_volume" :: held 0.727s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:34 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-3d1d98da-4a28-46cf-8472-a3676128e592 tempest-ProjectReaderTests-1007845069 None] Created reservations ['875b6058-c395-4849-a65e-d9aa4646d6f1', '4e119da6-9d6a-4377-a0b8-c864ee4b0cd4', '1310a345-5275-43b3-b6fe-ccb59cadf9ba', 'c760cfa4-224b-4140-875d-e7c269fd0be1'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:50:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-3d1d98da-4a28-46cf-8472-a3676128e592 tempest-ProjectReaderTests-1007845069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:50:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-3d1d98da-4a28-46cf-8472-a3676128e592 tempest-ProjectReaderTests-1007845069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:34 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-3d1d98da-4a28-46cf-8472-a3676128e592 tempest-ProjectReaderTests-1007845069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:50:34 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-3d1d98da-4a28-46cf-8472-a3676128e592 tempest-ProjectReaderTests-1007845069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:50:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-3d1d98da-4a28-46cf-8472-a3676128e592 tempest-ProjectReaderTests-1007845069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3d1d98da-4a28-46cf-8472-a3676128e592 tempest-ProjectReaderTests-1007845069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:34 devstack sudo[105303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:50:34 devstack sudo[105303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:34 devstack sudo[105300]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-c8f3fb20-71fb-46a3-9247-b83c93103e36 tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d941f5f-a670-4c6d-b95a-d3cb81aafae2.67d83288-b7cc-4575-89e5-2f8c7f2abbc6" returned: 0 in 0.273s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:34 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c8f3fb20-71fb-46a3-9247-b83c93103e36 tempest-ProjectMemberTests-1488584303 None] Lock "cinder-quobyte-67d83288-b7cc-4575-89e5-2f8c7f2abbc6" released by "_delete_snapshot" :: held 1.450s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:34 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c8f3fb20-71fb-46a3-9247-b83c93103e36 tempest-ProjectMemberTests-1488584303 None] Lock "cinder-quobyte-9d941f5f-a670-4c6d-b95a-d3cb81aafae2" released by "delete_snapshot" :: held 1.482s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:34 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-c8f3fb20-71fb-46a3-9247-b83c93103e36 tempest-ProjectMemberTests-1488584303 None] Created reservations ['b52059e5-4222-40d9-a17d-8d6eb9a05662', '5433f790-b43a-4a8a-afc8-e1b316f73d8c', '4d2835e5-1886-482a-ac66-3636ae5c0305', 'e9d2e11c-357b-414c-b1a5-79205d47037c'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:50:34 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-c8f3fb20-71fb-46a3-9247-b83c93103e36 tempest-ProjectMemberTests-1488584303 None] Delete snapshot completed successfully. Aug 28 09:50:34 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-c8f3fb20-71fb-46a3-9247-b83c93103e36 tempest-ProjectMemberTests-1488584303 None] Lock "cinder-67d83288-b7cc-4575-89e5-2f8c7f2abbc6-delete_snapshot" released by "delete_snapshot" :: held 1.614s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:34 devstack sudo[105303]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3d1d98da-4a28-46cf-8472-a3676128e592 tempest-ProjectReaderTests-1007845069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.285s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:34 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-3d1d98da-4a28-46cf-8472-a3676128e592 tempest-ProjectReaderTests-1007845069 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:50:34 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-3d1d98da-4a28-46cf-8472-a3676128e592 tempest-ProjectReaderTests-1007845069 None] Deleted volume successfully. Aug 28 09:50:34 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-3d1d98da-4a28-46cf-8472-a3676128e592 tempest-ProjectReaderTests-1007845069 None] Lock "cinder-d22e88d5-6577-4798-98a4-3805acf2d703-delete_volume" released by "delete_volume" :: held 1.217s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:35 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-88fab017-76ef-410f-992d-d09f0c24deb4 tempest-ProjectMemberTests-1488584303 None] Acquiring lock "cinder-9d941f5f-a670-4c6d-b95a-d3cb81aafae2-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:35 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-88fab017-76ef-410f-992d-d09f0c24deb4 tempest-ProjectMemberTests-1488584303 None] Lock "cinder-9d941f5f-a670-4c6d-b95a-d3cb81aafae2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:35 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-88fab017-76ef-410f-992d-d09f0c24deb4 tempest-ProjectMemberTests-1488584303 None] Acquiring lock "cinder-quobyte-9d941f5f-a670-4c6d-b95a-d3cb81aafae2" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:35 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-88fab017-76ef-410f-992d-d09f0c24deb4 tempest-ProjectMemberTests-1488584303 None] Lock "cinder-quobyte-9d941f5f-a670-4c6d-b95a-d3cb81aafae2" acquired by "delete_volume" :: waited 0.021s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:35 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b4a3ef-df34-4e3b-8deb-434bdfb1c1ff]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:50:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-88fab017-76ef-410f-992d-d09f0c24deb4 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d941f5f-a670-4c6d-b95a-d3cb81aafae2 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:35 devstack sudo[105307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d941f5f-a670-4c6d-b95a-d3cb81aafae2 Aug 28 09:50:35 devstack sudo[105307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:35 devstack sudo[105307]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-88fab017-76ef-410f-992d-d09f0c24deb4 tempest-ProjectMemberTests-1488584303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d941f5f-a670-4c6d-b95a-d3cb81aafae2" returned: 0 in 0.410s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-88fab017-76ef-410f-992d-d09f0c24deb4 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d941f5f-a670-4c6d-b95a-d3cb81aafae2 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:35 devstack sudo[105312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d941f5f-a670-4c6d-b95a-d3cb81aafae2 Aug 28 09:50:35 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:35 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-88fab017-76ef-410f-992d-d09f0c24deb4 tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-9d941f5f-a670-4c6d-b95a-d3cb81aafae2" returned: 0 in 0.264s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:35 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-88fab017-76ef-410f-992d-d09f0c24deb4 tempest-ProjectMemberTests-1488584303 None] Lock "cinder-quobyte-9d941f5f-a670-4c6d-b95a-d3cb81aafae2" released by "delete_volume" :: held 0.740s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:36 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-88fab017-76ef-410f-992d-d09f0c24deb4 tempest-ProjectMemberTests-1488584303 None] Created reservations ['3e0e9e9a-c533-49c5-882a-9c033c07ea10', '5744587d-cce3-4aa0-804b-3d0e40cd941c', '187d7900-682c-4bac-96fc-9afe4202d71c', '3f90a765-709c-46e8-b506-c78781742eb3'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:50:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-88fab017-76ef-410f-992d-d09f0c24deb4 tempest-ProjectMemberTests-1488584303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:50:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-88fab017-76ef-410f-992d-d09f0c24deb4 tempest-ProjectMemberTests-1488584303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:36 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-88fab017-76ef-410f-992d-d09f0c24deb4 tempest-ProjectMemberTests-1488584303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:50:36 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-88fab017-76ef-410f-992d-d09f0c24deb4 tempest-ProjectMemberTests-1488584303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:50:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-88fab017-76ef-410f-992d-d09f0c24deb4 tempest-ProjectMemberTests-1488584303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-88fab017-76ef-410f-992d-d09f0c24deb4 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:36 devstack sudo[105315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:50:36 devstack sudo[105315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:36 devstack sudo[105315]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-88fab017-76ef-410f-992d-d09f0c24deb4 tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.286s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:36 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-88fab017-76ef-410f-992d-d09f0c24deb4 tempest-ProjectMemberTests-1488584303 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:50:36 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-88fab017-76ef-410f-992d-d09f0c24deb4 tempest-ProjectMemberTests-1488584303 None] Deleted volume successfully. Aug 28 09:50:36 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-88fab017-76ef-410f-992d-d09f0c24deb4 tempest-ProjectMemberTests-1488584303 None] Lock "cinder-9d941f5f-a670-4c6d-b95a-d3cb81aafae2-delete_volume" released by "delete_volume" :: held 1.258s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:36 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec80671c-ac01-4e1f-bf37-7db128f001da tempest-ProjectMemberTests-1488584303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:50:36 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ec80671c-ac01-4e1f-bf37-7db128f001da tempest-ProjectMemberTests-1488584303 None] Flow 'volume_create_manager' (22195fb2-9e13-435d-ac04-602c19ed104a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:50:36 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ec80671c-ac01-4e1f-bf37-7db128f001da tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f2fbdb5-a6d9-45bf-b3c3-9516ed292236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:36 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ec80671c-ac01-4e1f-bf37-7db128f001da tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f2fbdb5-a6d9-45bf-b3c3-9516ed292236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-84240361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=866adec0-13db-4020-badb-2d09d26d2faa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b056b8e115744d6a55a8cf4e112ebe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:50:37Z,use_quota=True,user_id='7e7fc1a0e4d74db1a1b75434c7703666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:36 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ec80671c-ac01-4e1f-bf37-7db128f001da tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (702791d4-9ed7-472a-ba52-71afeda37bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:36 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ec80671c-ac01-4e1f-bf37-7db128f001da tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (702791d4-9ed7-472a-ba52-71afeda37bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:36 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ec80671c-ac01-4e1f-bf37-7db128f001da tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa8e9218-b19c-483e-988e-5c308224674f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:36 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ec80671c-ac01-4e1f-bf37-7db128f001da tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa8e9218-b19c-483e-988e-5c308224674f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '866adec0-13db-4020-badb-2d09d26d2faa', 'volume_name': 'volume-866adec0-13db-4020-badb-2d09d26d2faa', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:36 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ec80671c-ac01-4e1f-bf37-7db128f001da tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf961c3c-4c9b-478c-9bbb-9c744c3f4844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:36 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ec80671c-ac01-4e1f-bf37-7db128f001da tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf961c3c-4c9b-478c-9bbb-9c744c3f4844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:36 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ec80671c-ac01-4e1f-bf37-7db128f001da tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (918cb663-fe67-4823-a7dd-a23aef1c0ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:36 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-ec80671c-ac01-4e1f-bf37-7db128f001da tempest-ProjectMemberTests-1488584303 None] Volume 866adec0-13db-4020-badb-2d09d26d2faa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-866adec0-13db-4020-badb-2d09d26d2faa', 'volume_size': 1} Aug 28 09:50:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ec80671c-ac01-4e1f-bf37-7db128f001da tempest-ProjectMemberTests-1488584303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:50:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ec80671c-ac01-4e1f-bf37-7db128f001da tempest-ProjectMemberTests-1488584303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:36 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ec80671c-ac01-4e1f-bf37-7db128f001da tempest-ProjectMemberTests-1488584303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-84240361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=866adec0-13db-4020-badb-2d09d26d2faa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b056b8e115744d6a55a8cf4e112ebe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:50:37Z,use_quota=True,user_id='7e7fc1a0e4d74db1a1b75434c7703666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:50:36 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-ec80671c-ac01-4e1f-bf37-7db128f001da tempest-ProjectMemberTests-1488584303 None] Creating volume 866adec0-13db-4020-badb-2d09d26d2faa {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:50:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ec80671c-ac01-4e1f-bf37-7db128f001da tempest-ProjectMemberTests-1488584303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:50:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ec80671c-ac01-4e1f-bf37-7db128f001da tempest-ProjectMemberTests-1488584303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:36 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ec80671c-ac01-4e1f-bf37-7db128f001da tempest-ProjectMemberTests-1488584303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:50:36 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ec80671c-ac01-4e1f-bf37-7db128f001da tempest-ProjectMemberTests-1488584303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:50:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ec80671c-ac01-4e1f-bf37-7db128f001da tempest-ProjectMemberTests-1488584303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:36 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ec80671c-ac01-4e1f-bf37-7db128f001da tempest-ProjectMemberTests-1488584303 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:50:36 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-ec80671c-ac01-4e1f-bf37-7db128f001da tempest-ProjectMemberTests-1488584303 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:50:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ec80671c-ac01-4e1f-bf37-7db128f001da tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-866adec0-13db-4020-badb-2d09d26d2faa 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:36 devstack sudo[105318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-866adec0-13db-4020-badb-2d09d26d2faa 1073741824 Aug 28 09:50:36 devstack sudo[105318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:37 devstack sudo[105318]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ec80671c-ac01-4e1f-bf37-7db128f001da tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-866adec0-13db-4020-badb-2d09d26d2faa 1073741824" returned: 0 in 0.446s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ec80671c-ac01-4e1f-bf37-7db128f001da tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-866adec0-13db-4020-badb-2d09d26d2faa {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:37 devstack sudo[105324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-866adec0-13db-4020-badb-2d09d26d2faa Aug 28 09:50:37 devstack sudo[105324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:37 devstack sudo[105324]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-ec80671c-ac01-4e1f-bf37-7db128f001da tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-866adec0-13db-4020-badb-2d09d26d2faa" returned: 0 in 0.253s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:37 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-ec80671c-ac01-4e1f-bf37-7db128f001da tempest-ProjectMemberTests-1488584303 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:50:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-ec80671c-ac01-4e1f-bf37-7db128f001da tempest-ProjectMemberTests-1488584303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:37 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ec80671c-ac01-4e1f-bf37-7db128f001da tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (918cb663-fe67-4823-a7dd-a23aef1c0ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-866adec0-13db-4020-badb-2d09d26d2faa', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:37 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ec80671c-ac01-4e1f-bf37-7db128f001da tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ff4400b-51bd-4b17-a133-f1d33d4a6f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:37 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-ec80671c-ac01-4e1f-bf37-7db128f001da tempest-ProjectMemberTests-1488584303 None] Volume volume-866adec0-13db-4020-badb-2d09d26d2faa (866adec0-13db-4020-badb-2d09d26d2faa): created successfully Aug 28 09:50:37 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ec80671c-ac01-4e1f-bf37-7db128f001da tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ff4400b-51bd-4b17-a133-f1d33d4a6f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:37 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-ec80671c-ac01-4e1f-bf37-7db128f001da tempest-ProjectMemberTests-1488584303 None] Flow 'volume_create_manager' (22195fb2-9e13-435d-ac04-602c19ed104a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:50:37 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-ec80671c-ac01-4e1f-bf37-7db128f001da tempest-ProjectMemberTests-1488584303 None] Created volume successfully. Aug 28 09:50:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-2f77b95c-8d33-4803-941d-542b442899ff tempest-ProjectMemberTests-1488584303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:50:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-2f77b95c-8d33-4803-941d-542b442899ff tempest-ProjectMemberTests-1488584303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:38 devstack cinder-volume[86081]: DEBUG oslo_service.periodic_task [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86081) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:50:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:50:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:50:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:50:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-2f77b95c-8d33-4803-941d-542b442899ff tempest-ProjectMemberTests-1488584303 None] Creating offline snapshot a48933c7-70cc-4d0a-a913-ba9b4b759fba of volume 866adec0-13db-4020-badb-2d09d26d2faa {{(pid=86081) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:50:38 devstack sudo[105327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:50:38 devstack sudo[105327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:38 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[870c19a3-ba9c-422a-afcf-f1c41e4b094d]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:50:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2f77b95c-8d33-4803-941d-542b442899ff tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-866adec0-13db-4020-badb-2d09d26d2faa {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:38 devstack sudo[105329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-866adec0-13db-4020-badb-2d09d26d2faa Aug 28 09:50:38 devstack sudo[105329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:38 devstack sudo[105327]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.243s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:38 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:50:38 devstack cinder-volume[86081]: DEBUG oslo_service.periodic_task [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running periodic task VolumeManager._thread_info {{(pid=86081) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:50:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] thread count: 28 {{(pid=86081) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 09:50:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] thread info: [<_MainThread(MainThread, started 129914189705344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86081) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 09:50:38 devstack sudo[105329]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2f77b95c-8d33-4803-941d-542b442899ff tempest-ProjectMemberTests-1488584303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-866adec0-13db-4020-badb-2d09d26d2faa" returned: 0 in 0.375s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2f77b95c-8d33-4803-941d-542b442899ff tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-866adec0-13db-4020-badb-2d09d26d2faa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-866adec0-13db-4020-badb-2d09d26d2faa.a48933c7-70cc-4d0a-a913-ba9b4b759fba 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:38 devstack sudo[105335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-866adec0-13db-4020-badb-2d09d26d2faa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-866adec0-13db-4020-badb-2d09d26d2faa.a48933c7-70cc-4d0a-a913-ba9b4b759fba 1G Aug 28 09:50:38 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:38 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2f77b95c-8d33-4803-941d-542b442899ff tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-866adec0-13db-4020-badb-2d09d26d2faa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-866adec0-13db-4020-badb-2d09d26d2faa.a48933c7-70cc-4d0a-a913-ba9b4b759fba 1G" returned: 0 in 0.385s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2f77b95c-8d33-4803-941d-542b442899ff tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-866adec0-13db-4020-badb-2d09d26d2faa -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-866adec0-13db-4020-badb-2d09d26d2faa.a48933c7-70cc-4d0a-a913-ba9b4b759fba {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:38 devstack sudo[105340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-866adec0-13db-4020-badb-2d09d26d2faa -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-866adec0-13db-4020-badb-2d09d26d2faa.a48933c7-70cc-4d0a-a913-ba9b4b759fba Aug 28 09:50:38 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:39 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2f77b95c-8d33-4803-941d-542b442899ff tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-866adec0-13db-4020-badb-2d09d26d2faa -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-866adec0-13db-4020-badb-2d09d26d2faa.a48933c7-70cc-4d0a-a913-ba9b4b759fba" returned: 0 in 0.299s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:39 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-2f77b95c-8d33-4803-941d-542b442899ff tempest-ProjectMemberTests-1488584303 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-866adec0-13db-4020-badb-2d09d26d2faa.a48933c7-70cc-4d0a-a913-ba9b4b759fba is being set with open permissions: ugo+rw Aug 28 09:50:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2f77b95c-8d33-4803-941d-542b442899ff tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-866adec0-13db-4020-badb-2d09d26d2faa.a48933c7-70cc-4d0a-a913-ba9b4b759fba {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:39 devstack sudo[105345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-866adec0-13db-4020-badb-2d09d26d2faa.a48933c7-70cc-4d0a-a913-ba9b4b759fba Aug 28 09:50:39 devstack sudo[105345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:39 devstack sudo[105345]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2f77b95c-8d33-4803-941d-542b442899ff tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-866adec0-13db-4020-badb-2d09d26d2faa.a48933c7-70cc-4d0a-a913-ba9b4b759fba" returned: 0 in 0.262s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2f77b95c-8d33-4803-941d-542b442899ff tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-866adec0-13db-4020-badb-2d09d26d2faa.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:39 devstack sudo[105349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-866adec0-13db-4020-badb-2d09d26d2faa.info Aug 28 09:50:39 devstack sudo[105349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:39 devstack sudo[105349]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2f77b95c-8d33-4803-941d-542b442899ff tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-866adec0-13db-4020-badb-2d09d26d2faa.info" returned: 0 in 0.274s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:39 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-2f77b95c-8d33-4803-941d-542b442899ff tempest-ProjectMemberTests-1488584303 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-866adec0-13db-4020-badb-2d09d26d2faa.info is being set with open permissions: ugo+rw Aug 28 09:50:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2f77b95c-8d33-4803-941d-542b442899ff tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-866adec0-13db-4020-badb-2d09d26d2faa.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:39 devstack sudo[105352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-866adec0-13db-4020-badb-2d09d26d2faa.info Aug 28 09:50:39 devstack sudo[105352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:39 devstack sudo[105352]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2f77b95c-8d33-4803-941d-542b442899ff tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-866adec0-13db-4020-badb-2d09d26d2faa.info" returned: 0 in 0.250s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:40 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-2f77b95c-8d33-4803-941d-542b442899ff tempest-ProjectMemberTests-1488584303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.949s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:40 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-2f77b95c-8d33-4803-941d-542b442899ff tempest-ProjectMemberTests-1488584303 None] Create snapshot completed successfully Aug 28 09:50:41 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8845679e-0578-42fe-9636-24386f224f56 tempest-ProjectMemberTests-1488584303 None] Acquiring lock "cinder-a48933c7-70cc-4d0a-a913-ba9b4b759fba-delete_snapshot" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:41 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8845679e-0578-42fe-9636-24386f224f56 tempest-ProjectMemberTests-1488584303 None] Lock "cinder-a48933c7-70cc-4d0a-a913-ba9b4b759fba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:41 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8845679e-0578-42fe-9636-24386f224f56 tempest-ProjectMemberTests-1488584303 None] Acquiring lock "cinder-quobyte-866adec0-13db-4020-badb-2d09d26d2faa" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:41 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8845679e-0578-42fe-9636-24386f224f56 tempest-ProjectMemberTests-1488584303 None] Lock "cinder-quobyte-866adec0-13db-4020-badb-2d09d26d2faa" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:41 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8845679e-0578-42fe-9636-24386f224f56 tempest-ProjectMemberTests-1488584303 None] Acquiring lock "cinder-quobyte-a48933c7-70cc-4d0a-a913-ba9b4b759fba" by "_delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:41 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8845679e-0578-42fe-9636-24386f224f56 tempest-ProjectMemberTests-1488584303 None] Lock "cinder-quobyte-a48933c7-70cc-4d0a-a913-ba9b4b759fba" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:41 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-8845679e-0578-42fe-9636-24386f224f56 tempest-ProjectMemberTests-1488584303 None] Deleting offline snapshot a48933c7-70cc-4d0a-a913-ba9b4b759fba of volume 866adec0-13db-4020-badb-2d09d26d2faa {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:50:41 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-8845679e-0578-42fe-9636-24386f224f56 tempest-ProjectMemberTests-1488584303 None] snapshot_file for this snap is: volume-866adec0-13db-4020-badb-2d09d26d2faa.a48933c7-70cc-4d0a-a913-ba9b4b759fba {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:50:41 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb1426e-8d07-47d7-b0fc-5d6d681ecac3]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:50:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8845679e-0578-42fe-9636-24386f224f56 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-866adec0-13db-4020-badb-2d09d26d2faa.a48933c7-70cc-4d0a-a913-ba9b4b759fba {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:41 devstack sudo[105356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-866adec0-13db-4020-badb-2d09d26d2faa.a48933c7-70cc-4d0a-a913-ba9b4b759fba Aug 28 09:50:41 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:41 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8845679e-0578-42fe-9636-24386f224f56 tempest-ProjectMemberTests-1488584303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-866adec0-13db-4020-badb-2d09d26d2faa.a48933c7-70cc-4d0a-a913-ba9b4b759fba" returned: 0 in 0.383s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:41 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-8845679e-0578-42fe-9636-24386f224f56 tempest-ProjectMemberTests-1488584303 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-866adec0-13db-4020-badb-2d09d26d2faa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:50:41 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dcd6038-77df-4234-b258-d68908b46aa3]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:50:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8845679e-0578-42fe-9636-24386f224f56 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-866adec0-13db-4020-badb-2d09d26d2faa {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:41 devstack sudo[105361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-866adec0-13db-4020-badb-2d09d26d2faa Aug 28 09:50:41 devstack sudo[105361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:42 devstack sudo[105361]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:42 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8845679e-0578-42fe-9636-24386f224f56 tempest-ProjectMemberTests-1488584303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-866adec0-13db-4020-badb-2d09d26d2faa" returned: 0 in 0.352s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:42 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8845679e-0578-42fe-9636-24386f224f56 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-866adec0-13db-4020-badb-2d09d26d2faa.a48933c7-70cc-4d0a-a913-ba9b4b759fba {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:42 devstack sudo[105366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-866adec0-13db-4020-badb-2d09d26d2faa.a48933c7-70cc-4d0a-a913-ba9b4b759fba Aug 28 09:50:42 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:42 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:42 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8845679e-0578-42fe-9636-24386f224f56 tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-866adec0-13db-4020-badb-2d09d26d2faa.a48933c7-70cc-4d0a-a913-ba9b4b759fba" returned: 0 in 0.323s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:42 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8845679e-0578-42fe-9636-24386f224f56 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-866adec0-13db-4020-badb-2d09d26d2faa.a48933c7-70cc-4d0a-a913-ba9b4b759fba {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:42 devstack sudo[105372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-866adec0-13db-4020-badb-2d09d26d2faa.a48933c7-70cc-4d0a-a913-ba9b4b759fba Aug 28 09:50:42 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:42 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:42 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8845679e-0578-42fe-9636-24386f224f56 tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-866adec0-13db-4020-badb-2d09d26d2faa.a48933c7-70cc-4d0a-a913-ba9b4b759fba" returned: 0 in 0.242s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:42 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8845679e-0578-42fe-9636-24386f224f56 tempest-ProjectMemberTests-1488584303 None] Lock "cinder-quobyte-a48933c7-70cc-4d0a-a913-ba9b4b759fba" released by "_delete_snapshot" :: held 1.413s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:42 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8845679e-0578-42fe-9636-24386f224f56 tempest-ProjectMemberTests-1488584303 None] Lock "cinder-quobyte-866adec0-13db-4020-badb-2d09d26d2faa" released by "delete_snapshot" :: held 1.440s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:42 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-8845679e-0578-42fe-9636-24386f224f56 tempest-ProjectMemberTests-1488584303 None] Created reservations ['621a8376-6a5f-4e38-a7aa-4dfd4e90b0a2', '942215b3-7ebd-4af4-960d-c656e43ea7fd', 'f55d4fb4-fa52-4bf5-bfe3-589c7f880510', '6ef23478-c1ac-4e8c-877c-0a4dd9cea16a'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:50:42 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-8845679e-0578-42fe-9636-24386f224f56 tempest-ProjectMemberTests-1488584303 None] Delete snapshot completed successfully. Aug 28 09:50:42 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8845679e-0578-42fe-9636-24386f224f56 tempest-ProjectMemberTests-1488584303 None] Lock "cinder-a48933c7-70cc-4d0a-a913-ba9b4b759fba-delete_snapshot" released by "delete_snapshot" :: held 1.586s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:43 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-74dbae28-b128-4f27-8455-cab9c899cb40 tempest-ProjectMemberTests-1488584303 None] Acquiring lock "cinder-866adec0-13db-4020-badb-2d09d26d2faa-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:43 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-74dbae28-b128-4f27-8455-cab9c899cb40 tempest-ProjectMemberTests-1488584303 None] Lock "cinder-866adec0-13db-4020-badb-2d09d26d2faa-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:43 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-74dbae28-b128-4f27-8455-cab9c899cb40 tempest-ProjectMemberTests-1488584303 None] Acquiring lock "cinder-quobyte-866adec0-13db-4020-badb-2d09d26d2faa" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:43 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-74dbae28-b128-4f27-8455-cab9c899cb40 tempest-ProjectMemberTests-1488584303 None] Lock "cinder-quobyte-866adec0-13db-4020-badb-2d09d26d2faa" acquired by "delete_volume" :: waited 0.018s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:43 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[315526a5-5369-485a-9f32-0b45937d6f30]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:50:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-74dbae28-b128-4f27-8455-cab9c899cb40 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-866adec0-13db-4020-badb-2d09d26d2faa {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:43 devstack sudo[105375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-866adec0-13db-4020-badb-2d09d26d2faa Aug 28 09:50:43 devstack sudo[105375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:43 devstack sudo[105375]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-74dbae28-b128-4f27-8455-cab9c899cb40 tempest-ProjectMemberTests-1488584303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-866adec0-13db-4020-badb-2d09d26d2faa" returned: 0 in 0.387s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-74dbae28-b128-4f27-8455-cab9c899cb40 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-866adec0-13db-4020-badb-2d09d26d2faa {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:43 devstack sudo[105380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-866adec0-13db-4020-badb-2d09d26d2faa Aug 28 09:50:43 devstack sudo[105380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:44 devstack sudo[105380]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-74dbae28-b128-4f27-8455-cab9c899cb40 tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-866adec0-13db-4020-badb-2d09d26d2faa" returned: 0 in 0.264s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:44 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-74dbae28-b128-4f27-8455-cab9c899cb40 tempest-ProjectMemberTests-1488584303 None] Lock "cinder-quobyte-866adec0-13db-4020-badb-2d09d26d2faa" released by "delete_volume" :: held 0.727s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:44 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-74dbae28-b128-4f27-8455-cab9c899cb40 tempest-ProjectMemberTests-1488584303 None] Created reservations ['840d3a3f-7bae-4cca-9b44-8e48e3c298d0', '435cb260-e6f8-4916-b9d0-78d36c1129b3', '2a6100f6-1d03-46e6-931f-81b0f1460967', 'dc2de22e-03e6-4141-9d45-32985c8848e8'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:50:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-74dbae28-b128-4f27-8455-cab9c899cb40 tempest-ProjectMemberTests-1488584303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:50:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-74dbae28-b128-4f27-8455-cab9c899cb40 tempest-ProjectMemberTests-1488584303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:44 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-74dbae28-b128-4f27-8455-cab9c899cb40 tempest-ProjectMemberTests-1488584303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:50:44 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-74dbae28-b128-4f27-8455-cab9c899cb40 tempest-ProjectMemberTests-1488584303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:50:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-74dbae28-b128-4f27-8455-cab9c899cb40 tempest-ProjectMemberTests-1488584303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-74dbae28-b128-4f27-8455-cab9c899cb40 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:44 devstack sudo[105383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:50:44 devstack sudo[105383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:44 devstack sudo[105383]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-74dbae28-b128-4f27-8455-cab9c899cb40 tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.259s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:44 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-74dbae28-b128-4f27-8455-cab9c899cb40 tempest-ProjectMemberTests-1488584303 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:50:44 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-74dbae28-b128-4f27-8455-cab9c899cb40 tempest-ProjectMemberTests-1488584303 None] Deleted volume successfully. Aug 28 09:50:44 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-74dbae28-b128-4f27-8455-cab9c899cb40 tempest-ProjectMemberTests-1488584303 None] Lock "cinder-866adec0-13db-4020-badb-2d09d26d2faa-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:44 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-99a854fc-ef62-40cd-9922-1598d353f6af tempest-ProjectMemberTests-1488584303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:50:45 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-99a854fc-ef62-40cd-9922-1598d353f6af tempest-ProjectMemberTests-1488584303 None] Flow 'volume_create_manager' (2e1d7730-f110-45a4-a2cd-f8b5c9738946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:50:45 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-99a854fc-ef62-40cd-9922-1598d353f6af tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (046cf9de-6af9-48da-a4d8-df355300e705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:45 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-99a854fc-ef62-40cd-9922-1598d353f6af tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (046cf9de-6af9-48da-a4d8-df355300e705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:50:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1910222368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caac1667-d24c-42b0-9839-d43e7c0e7551,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b056b8e115744d6a55a8cf4e112ebe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:50:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:50:45Z,use_quota=True,user_id='7e7fc1a0e4d74db1a1b75434c7703666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:45 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-99a854fc-ef62-40cd-9922-1598d353f6af tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea73b8cb-1a45-4e54-9a17-32c5052774c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:45 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-99a854fc-ef62-40cd-9922-1598d353f6af tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea73b8cb-1a45-4e54-9a17-32c5052774c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:45 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-99a854fc-ef62-40cd-9922-1598d353f6af tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ef1ddfa-c6d9-4190-b920-c531efc6c1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:45 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-99a854fc-ef62-40cd-9922-1598d353f6af tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ef1ddfa-c6d9-4190-b920-c531efc6c1d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'caac1667-d24c-42b0-9839-d43e7c0e7551', 'volume_name': 'volume-caac1667-d24c-42b0-9839-d43e7c0e7551', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:45 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-99a854fc-ef62-40cd-9922-1598d353f6af tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a374acdb-8d48-470e-bc1c-ddc431edbc23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:45 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-99a854fc-ef62-40cd-9922-1598d353f6af tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a374acdb-8d48-470e-bc1c-ddc431edbc23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:45 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-99a854fc-ef62-40cd-9922-1598d353f6af tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d75bb01b-0c16-4365-9609-161f92267bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:45 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-99a854fc-ef62-40cd-9922-1598d353f6af tempest-ProjectMemberTests-1488584303 None] Volume caac1667-d24c-42b0-9839-d43e7c0e7551: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-caac1667-d24c-42b0-9839-d43e7c0e7551', 'volume_size': 1} Aug 28 09:50:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-99a854fc-ef62-40cd-9922-1598d353f6af tempest-ProjectMemberTests-1488584303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:50:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-99a854fc-ef62-40cd-9922-1598d353f6af tempest-ProjectMemberTests-1488584303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:45 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-99a854fc-ef62-40cd-9922-1598d353f6af tempest-ProjectMemberTests-1488584303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:50:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1910222368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caac1667-d24c-42b0-9839-d43e7c0e7551,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b056b8e115744d6a55a8cf4e112ebe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:50:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:50:45Z,use_quota=True,user_id='7e7fc1a0e4d74db1a1b75434c7703666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:50:45 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-99a854fc-ef62-40cd-9922-1598d353f6af tempest-ProjectMemberTests-1488584303 None] Creating volume caac1667-d24c-42b0-9839-d43e7c0e7551 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:50:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-99a854fc-ef62-40cd-9922-1598d353f6af tempest-ProjectMemberTests-1488584303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:50:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-99a854fc-ef62-40cd-9922-1598d353f6af tempest-ProjectMemberTests-1488584303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:45 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-99a854fc-ef62-40cd-9922-1598d353f6af tempest-ProjectMemberTests-1488584303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:50:45 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-99a854fc-ef62-40cd-9922-1598d353f6af tempest-ProjectMemberTests-1488584303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:50:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-99a854fc-ef62-40cd-9922-1598d353f6af tempest-ProjectMemberTests-1488584303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:45 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-99a854fc-ef62-40cd-9922-1598d353f6af tempest-ProjectMemberTests-1488584303 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:50:45 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-99a854fc-ef62-40cd-9922-1598d353f6af tempest-ProjectMemberTests-1488584303 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:50:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-99a854fc-ef62-40cd-9922-1598d353f6af tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-caac1667-d24c-42b0-9839-d43e7c0e7551 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:45 devstack sudo[105386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-caac1667-d24c-42b0-9839-d43e7c0e7551 1073741824 Aug 28 09:50:45 devstack sudo[105386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:45 devstack sudo[105386]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-99a854fc-ef62-40cd-9922-1598d353f6af tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-caac1667-d24c-42b0-9839-d43e7c0e7551 1073741824" returned: 0 in 0.449s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-99a854fc-ef62-40cd-9922-1598d353f6af tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-caac1667-d24c-42b0-9839-d43e7c0e7551 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:45 devstack sudo[105391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-caac1667-d24c-42b0-9839-d43e7c0e7551 Aug 28 09:50:45 devstack sudo[105391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:45 devstack sudo[105391]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-99a854fc-ef62-40cd-9922-1598d353f6af tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-caac1667-d24c-42b0-9839-d43e7c0e7551" returned: 0 in 0.265s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:45 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-99a854fc-ef62-40cd-9922-1598d353f6af tempest-ProjectMemberTests-1488584303 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:50:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-99a854fc-ef62-40cd-9922-1598d353f6af tempest-ProjectMemberTests-1488584303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:45 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-99a854fc-ef62-40cd-9922-1598d353f6af tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d75bb01b-0c16-4365-9609-161f92267bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-caac1667-d24c-42b0-9839-d43e7c0e7551', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:45 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-99a854fc-ef62-40cd-9922-1598d353f6af tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (057597aa-9233-47a9-b503-3fb2e3af8ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:45 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-99a854fc-ef62-40cd-9922-1598d353f6af tempest-ProjectMemberTests-1488584303 None] Volume volume-caac1667-d24c-42b0-9839-d43e7c0e7551 (caac1667-d24c-42b0-9839-d43e7c0e7551): created successfully Aug 28 09:50:45 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-99a854fc-ef62-40cd-9922-1598d353f6af tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (057597aa-9233-47a9-b503-3fb2e3af8ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:45 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-99a854fc-ef62-40cd-9922-1598d353f6af tempest-ProjectMemberTests-1488584303 None] Flow 'volume_create_manager' (2e1d7730-f110-45a4-a2cd-f8b5c9738946) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:50:45 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-99a854fc-ef62-40cd-9922-1598d353f6af tempest-ProjectMemberTests-1488584303 None] Created volume successfully. Aug 28 09:50:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8f4fb997-2333-4e5b-ac4c-0c08c90b7ab2 tempest-ProjectMemberTests-1488584303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:50:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8f4fb997-2333-4e5b-ac4c-0c08c90b7ab2 tempest-ProjectMemberTests-1488584303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:46 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-8f4fb997-2333-4e5b-ac4c-0c08c90b7ab2 tempest-ProjectMemberTests-1488584303 None] Creating offline snapshot 4c7ac0dc-7e36-4ea2-9bd8-539720572a24 of volume caac1667-d24c-42b0-9839-d43e7c0e7551 {{(pid=86081) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:50:46 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca49bb91-e3bd-41f5-8cbc-962ea6415ed0]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:50:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8f4fb997-2333-4e5b-ac4c-0c08c90b7ab2 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-caac1667-d24c-42b0-9839-d43e7c0e7551 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:46 devstack sudo[105394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-caac1667-d24c-42b0-9839-d43e7c0e7551 Aug 28 09:50:46 devstack sudo[105394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:46 devstack sudo[105394]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8f4fb997-2333-4e5b-ac4c-0c08c90b7ab2 tempest-ProjectMemberTests-1488584303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-caac1667-d24c-42b0-9839-d43e7c0e7551" returned: 0 in 0.397s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8f4fb997-2333-4e5b-ac4c-0c08c90b7ab2 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-caac1667-d24c-42b0-9839-d43e7c0e7551,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-caac1667-d24c-42b0-9839-d43e7c0e7551.4c7ac0dc-7e36-4ea2-9bd8-539720572a24 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:46 devstack sudo[105399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-caac1667-d24c-42b0-9839-d43e7c0e7551,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-caac1667-d24c-42b0-9839-d43e7c0e7551.4c7ac0dc-7e36-4ea2-9bd8-539720572a24 1G Aug 28 09:50:46 devstack sudo[105399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:47 devstack sudo[105399]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8f4fb997-2333-4e5b-ac4c-0c08c90b7ab2 tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-caac1667-d24c-42b0-9839-d43e7c0e7551,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-caac1667-d24c-42b0-9839-d43e7c0e7551.4c7ac0dc-7e36-4ea2-9bd8-539720572a24 1G" returned: 0 in 0.464s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8f4fb997-2333-4e5b-ac4c-0c08c90b7ab2 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-caac1667-d24c-42b0-9839-d43e7c0e7551 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-caac1667-d24c-42b0-9839-d43e7c0e7551.4c7ac0dc-7e36-4ea2-9bd8-539720572a24 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:47 devstack sudo[105405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-caac1667-d24c-42b0-9839-d43e7c0e7551 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-caac1667-d24c-42b0-9839-d43e7c0e7551.4c7ac0dc-7e36-4ea2-9bd8-539720572a24 Aug 28 09:50:47 devstack sudo[105405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:47 devstack sudo[105405]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8f4fb997-2333-4e5b-ac4c-0c08c90b7ab2 tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-caac1667-d24c-42b0-9839-d43e7c0e7551 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-caac1667-d24c-42b0-9839-d43e7c0e7551.4c7ac0dc-7e36-4ea2-9bd8-539720572a24" returned: 0 in 0.298s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:47 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-8f4fb997-2333-4e5b-ac4c-0c08c90b7ab2 tempest-ProjectMemberTests-1488584303 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-caac1667-d24c-42b0-9839-d43e7c0e7551.4c7ac0dc-7e36-4ea2-9bd8-539720572a24 is being set with open permissions: ugo+rw Aug 28 09:50:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8f4fb997-2333-4e5b-ac4c-0c08c90b7ab2 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-caac1667-d24c-42b0-9839-d43e7c0e7551.4c7ac0dc-7e36-4ea2-9bd8-539720572a24 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:47 devstack sudo[105410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-caac1667-d24c-42b0-9839-d43e7c0e7551.4c7ac0dc-7e36-4ea2-9bd8-539720572a24 Aug 28 09:50:47 devstack sudo[105410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:47 devstack sudo[105410]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8f4fb997-2333-4e5b-ac4c-0c08c90b7ab2 tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-caac1667-d24c-42b0-9839-d43e7c0e7551.4c7ac0dc-7e36-4ea2-9bd8-539720572a24" returned: 0 in 0.270s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8f4fb997-2333-4e5b-ac4c-0c08c90b7ab2 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-caac1667-d24c-42b0-9839-d43e7c0e7551.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:47 devstack sudo[105413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-caac1667-d24c-42b0-9839-d43e7c0e7551.info Aug 28 09:50:47 devstack sudo[105413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:47 devstack sudo[105413]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8f4fb997-2333-4e5b-ac4c-0c08c90b7ab2 tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-caac1667-d24c-42b0-9839-d43e7c0e7551.info" returned: 0 in 0.272s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:47 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-8f4fb997-2333-4e5b-ac4c-0c08c90b7ab2 tempest-ProjectMemberTests-1488584303 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-caac1667-d24c-42b0-9839-d43e7c0e7551.info is being set with open permissions: ugo+rw Aug 28 09:50:47 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8f4fb997-2333-4e5b-ac4c-0c08c90b7ab2 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-caac1667-d24c-42b0-9839-d43e7c0e7551.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:47 devstack sudo[105416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-caac1667-d24c-42b0-9839-d43e7c0e7551.info Aug 28 09:50:47 devstack sudo[105416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:48 devstack sudo[105416]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8f4fb997-2333-4e5b-ac4c-0c08c90b7ab2 tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-caac1667-d24c-42b0-9839-d43e7c0e7551.info" returned: 0 in 0.266s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:48 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8f4fb997-2333-4e5b-ac4c-0c08c90b7ab2 tempest-ProjectMemberTests-1488584303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.057s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:48 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-8f4fb997-2333-4e5b-ac4c-0c08c90b7ab2 tempest-ProjectMemberTests-1488584303 None] Create snapshot completed successfully Aug 28 09:50:49 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-57e20890-2851-4017-b5c8-669171d984ff tempest-ProjectMemberTests-1488584303 None] Acquiring lock "cinder-4c7ac0dc-7e36-4ea2-9bd8-539720572a24-delete_snapshot" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:49 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-57e20890-2851-4017-b5c8-669171d984ff tempest-ProjectMemberTests-1488584303 None] Lock "cinder-4c7ac0dc-7e36-4ea2-9bd8-539720572a24-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:49 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-57e20890-2851-4017-b5c8-669171d984ff tempest-ProjectMemberTests-1488584303 None] Acquiring lock "cinder-quobyte-caac1667-d24c-42b0-9839-d43e7c0e7551" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:49 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-57e20890-2851-4017-b5c8-669171d984ff tempest-ProjectMemberTests-1488584303 None] Lock "cinder-quobyte-caac1667-d24c-42b0-9839-d43e7c0e7551" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:49 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-57e20890-2851-4017-b5c8-669171d984ff tempest-ProjectMemberTests-1488584303 None] Acquiring lock "cinder-quobyte-4c7ac0dc-7e36-4ea2-9bd8-539720572a24" by "_delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:49 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-57e20890-2851-4017-b5c8-669171d984ff tempest-ProjectMemberTests-1488584303 None] Lock "cinder-quobyte-4c7ac0dc-7e36-4ea2-9bd8-539720572a24" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:49 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-57e20890-2851-4017-b5c8-669171d984ff tempest-ProjectMemberTests-1488584303 None] Deleting offline snapshot 4c7ac0dc-7e36-4ea2-9bd8-539720572a24 of volume caac1667-d24c-42b0-9839-d43e7c0e7551 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:50:49 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-57e20890-2851-4017-b5c8-669171d984ff tempest-ProjectMemberTests-1488584303 None] snapshot_file for this snap is: volume-caac1667-d24c-42b0-9839-d43e7c0e7551.4c7ac0dc-7e36-4ea2-9bd8-539720572a24 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:50:49 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c07d3b-93cc-4833-90e2-91b7eddb2c5b]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:50:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-57e20890-2851-4017-b5c8-669171d984ff tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-caac1667-d24c-42b0-9839-d43e7c0e7551.4c7ac0dc-7e36-4ea2-9bd8-539720572a24 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:49 devstack sudo[105421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-caac1667-d24c-42b0-9839-d43e7c0e7551.4c7ac0dc-7e36-4ea2-9bd8-539720572a24 Aug 28 09:50:49 devstack sudo[105421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:49 devstack sudo[105421]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-57e20890-2851-4017-b5c8-669171d984ff tempest-ProjectMemberTests-1488584303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-caac1667-d24c-42b0-9839-d43e7c0e7551.4c7ac0dc-7e36-4ea2-9bd8-539720572a24" returned: 0 in 0.380s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:49 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-57e20890-2851-4017-b5c8-669171d984ff tempest-ProjectMemberTests-1488584303 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-caac1667-d24c-42b0-9839-d43e7c0e7551(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:50:49 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85b7642-c6cf-470e-af2a-9ca051e320f5]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:50:49 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-57e20890-2851-4017-b5c8-669171d984ff tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-caac1667-d24c-42b0-9839-d43e7c0e7551 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:49 devstack sudo[105427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-caac1667-d24c-42b0-9839-d43e7c0e7551 Aug 28 09:50:49 devstack sudo[105427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:50 devstack sudo[105427]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-57e20890-2851-4017-b5c8-669171d984ff tempest-ProjectMemberTests-1488584303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-caac1667-d24c-42b0-9839-d43e7c0e7551" returned: 0 in 0.363s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-57e20890-2851-4017-b5c8-669171d984ff tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-caac1667-d24c-42b0-9839-d43e7c0e7551.4c7ac0dc-7e36-4ea2-9bd8-539720572a24 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:50 devstack sudo[105432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-caac1667-d24c-42b0-9839-d43e7c0e7551.4c7ac0dc-7e36-4ea2-9bd8-539720572a24 Aug 28 09:50:50 devstack sudo[105432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:50 devstack sudo[105432]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-57e20890-2851-4017-b5c8-669171d984ff tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-caac1667-d24c-42b0-9839-d43e7c0e7551.4c7ac0dc-7e36-4ea2-9bd8-539720572a24" returned: 0 in 0.406s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-57e20890-2851-4017-b5c8-669171d984ff tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-caac1667-d24c-42b0-9839-d43e7c0e7551.4c7ac0dc-7e36-4ea2-9bd8-539720572a24 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:50 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-caac1667-d24c-42b0-9839-d43e7c0e7551.4c7ac0dc-7e36-4ea2-9bd8-539720572a24 Aug 28 09:50:50 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:50 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:50 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-57e20890-2851-4017-b5c8-669171d984ff tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-caac1667-d24c-42b0-9839-d43e7c0e7551.4c7ac0dc-7e36-4ea2-9bd8-539720572a24" returned: 0 in 0.270s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:50 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-57e20890-2851-4017-b5c8-669171d984ff tempest-ProjectMemberTests-1488584303 None] Lock "cinder-quobyte-4c7ac0dc-7e36-4ea2-9bd8-539720572a24" released by "_delete_snapshot" :: held 1.522s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:50 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-57e20890-2851-4017-b5c8-669171d984ff tempest-ProjectMemberTests-1488584303 None] Lock "cinder-quobyte-caac1667-d24c-42b0-9839-d43e7c0e7551" released by "delete_snapshot" :: held 1.550s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:51 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-57e20890-2851-4017-b5c8-669171d984ff tempest-ProjectMemberTests-1488584303 None] Created reservations ['6e506bae-9610-481e-994a-4cc69b50e0dd', '2105c9ca-df6a-43bd-ae90-14900c6324a7', '4923d34d-3249-4fe2-9a81-f6fe85f49430', '7f681ed5-dcc1-46cf-ad8a-709b4170a8cb'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:50:51 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-57e20890-2851-4017-b5c8-669171d984ff tempest-ProjectMemberTests-1488584303 None] Delete snapshot completed successfully. Aug 28 09:50:51 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-57e20890-2851-4017-b5c8-669171d984ff tempest-ProjectMemberTests-1488584303 None] Lock "cinder-4c7ac0dc-7e36-4ea2-9bd8-539720572a24-delete_snapshot" released by "delete_snapshot" :: held 1.719s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:51 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e339e751-8b22-4670-92a2-3274d581fb7f tempest-ProjectMemberTests-1488584303 None] Acquiring lock "cinder-caac1667-d24c-42b0-9839-d43e7c0e7551-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:51 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e339e751-8b22-4670-92a2-3274d581fb7f tempest-ProjectMemberTests-1488584303 None] Lock "cinder-caac1667-d24c-42b0-9839-d43e7c0e7551-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:51 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e339e751-8b22-4670-92a2-3274d581fb7f tempest-ProjectMemberTests-1488584303 None] Acquiring lock "cinder-quobyte-caac1667-d24c-42b0-9839-d43e7c0e7551" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:51 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e339e751-8b22-4670-92a2-3274d581fb7f tempest-ProjectMemberTests-1488584303 None] Lock "cinder-quobyte-caac1667-d24c-42b0-9839-d43e7c0e7551" acquired by "delete_volume" :: waited 0.017s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:51 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[37afc920-0638-4d1d-911e-9d93aab6d782]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:50:51 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e339e751-8b22-4670-92a2-3274d581fb7f tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-caac1667-d24c-42b0-9839-d43e7c0e7551 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:51 devstack sudo[105440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-caac1667-d24c-42b0-9839-d43e7c0e7551 Aug 28 09:50:51 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:52 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e339e751-8b22-4670-92a2-3274d581fb7f tempest-ProjectMemberTests-1488584303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-caac1667-d24c-42b0-9839-d43e7c0e7551" returned: 0 in 0.383s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e339e751-8b22-4670-92a2-3274d581fb7f tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-caac1667-d24c-42b0-9839-d43e7c0e7551 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:52 devstack sudo[105445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-caac1667-d24c-42b0-9839-d43e7c0e7551 Aug 28 09:50:52 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:52 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e339e751-8b22-4670-92a2-3274d581fb7f tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-caac1667-d24c-42b0-9839-d43e7c0e7551" returned: 0 in 0.267s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:52 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e339e751-8b22-4670-92a2-3274d581fb7f tempest-ProjectMemberTests-1488584303 None] Lock "cinder-quobyte-caac1667-d24c-42b0-9839-d43e7c0e7551" released by "delete_volume" :: held 0.709s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:52 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-e339e751-8b22-4670-92a2-3274d581fb7f tempest-ProjectMemberTests-1488584303 None] Created reservations ['5545cbcb-8d27-4b47-8a14-02359edcc06a', '2ea92f76-e830-4473-af61-41fa169716ef', '13bd13b7-ec7c-4d2d-bb45-25dcaefa0f50', '0911d17a-7a8e-4868-8950-1e3380129589'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:50:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e339e751-8b22-4670-92a2-3274d581fb7f tempest-ProjectMemberTests-1488584303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:50:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e339e751-8b22-4670-92a2-3274d581fb7f tempest-ProjectMemberTests-1488584303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:52 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e339e751-8b22-4670-92a2-3274d581fb7f tempest-ProjectMemberTests-1488584303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:50:52 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e339e751-8b22-4670-92a2-3274d581fb7f tempest-ProjectMemberTests-1488584303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:50:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e339e751-8b22-4670-92a2-3274d581fb7f tempest-ProjectMemberTests-1488584303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e339e751-8b22-4670-92a2-3274d581fb7f tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:52 devstack sudo[105448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:50:52 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:52 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:52 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e339e751-8b22-4670-92a2-3274d581fb7f tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.278s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:52 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-e339e751-8b22-4670-92a2-3274d581fb7f tempest-ProjectMemberTests-1488584303 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:50:52 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-e339e751-8b22-4670-92a2-3274d581fb7f tempest-ProjectMemberTests-1488584303 None] Deleted volume successfully. Aug 28 09:50:52 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e339e751-8b22-4670-92a2-3274d581fb7f tempest-ProjectMemberTests-1488584303 None] Lock "cinder-caac1667-d24c-42b0-9839-d43e7c0e7551-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:53 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-febbc7e5-2e7d-4b8a-8c06-4bcad9bb876a tempest-ProjectMemberTests-1488584303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:50:53 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-febbc7e5-2e7d-4b8a-8c06-4bcad9bb876a tempest-ProjectMemberTests-1488584303 None] Flow 'volume_create_manager' (4fd7fdb4-75fb-474e-ad43-dd037d03b5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:50:53 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-febbc7e5-2e7d-4b8a-8c06-4bcad9bb876a tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3aabd9a-20dd-477b-a957-354d49aa7f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:53 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-febbc7e5-2e7d-4b8a-8c06-4bcad9bb876a tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3aabd9a-20dd-477b-a957-354d49aa7f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:50:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-824161087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf8745ec-f47e-4907-a795-e39f3e44f65d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b056b8e115744d6a55a8cf4e112ebe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:50:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:50:53Z,use_quota=True,user_id='7e7fc1a0e4d74db1a1b75434c7703666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:53 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-febbc7e5-2e7d-4b8a-8c06-4bcad9bb876a tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (198c60b7-25d3-4c6c-afe4-f6f0b1569161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:53 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-febbc7e5-2e7d-4b8a-8c06-4bcad9bb876a tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (198c60b7-25d3-4c6c-afe4-f6f0b1569161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:53 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-febbc7e5-2e7d-4b8a-8c06-4bcad9bb876a tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (620d7de3-a38b-4de3-918b-722913a15e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:53 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-febbc7e5-2e7d-4b8a-8c06-4bcad9bb876a tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (620d7de3-a38b-4de3-918b-722913a15e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf8745ec-f47e-4907-a795-e39f3e44f65d', 'volume_name': 'volume-cf8745ec-f47e-4907-a795-e39f3e44f65d', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:53 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-febbc7e5-2e7d-4b8a-8c06-4bcad9bb876a tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eef7f9d-0d9f-48fa-8cc0-d429fb28d133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:53 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-febbc7e5-2e7d-4b8a-8c06-4bcad9bb876a tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eef7f9d-0d9f-48fa-8cc0-d429fb28d133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:53 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-febbc7e5-2e7d-4b8a-8c06-4bcad9bb876a tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be81c892-2cf1-4b79-83b2-2d0e7fd63097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:53 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-febbc7e5-2e7d-4b8a-8c06-4bcad9bb876a tempest-ProjectMemberTests-1488584303 None] Volume cf8745ec-f47e-4907-a795-e39f3e44f65d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf8745ec-f47e-4907-a795-e39f3e44f65d', 'volume_size': 1} Aug 28 09:50:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-febbc7e5-2e7d-4b8a-8c06-4bcad9bb876a tempest-ProjectMemberTests-1488584303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:50:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-febbc7e5-2e7d-4b8a-8c06-4bcad9bb876a tempest-ProjectMemberTests-1488584303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:53 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-febbc7e5-2e7d-4b8a-8c06-4bcad9bb876a tempest-ProjectMemberTests-1488584303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:50:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-824161087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf8745ec-f47e-4907-a795-e39f3e44f65d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b056b8e115744d6a55a8cf4e112ebe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:50:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:50:53Z,use_quota=True,user_id='7e7fc1a0e4d74db1a1b75434c7703666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:50:53 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-febbc7e5-2e7d-4b8a-8c06-4bcad9bb876a tempest-ProjectMemberTests-1488584303 None] Creating volume cf8745ec-f47e-4907-a795-e39f3e44f65d {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:50:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-febbc7e5-2e7d-4b8a-8c06-4bcad9bb876a tempest-ProjectMemberTests-1488584303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:50:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-febbc7e5-2e7d-4b8a-8c06-4bcad9bb876a tempest-ProjectMemberTests-1488584303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:53 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-febbc7e5-2e7d-4b8a-8c06-4bcad9bb876a tempest-ProjectMemberTests-1488584303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:50:53 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-febbc7e5-2e7d-4b8a-8c06-4bcad9bb876a tempest-ProjectMemberTests-1488584303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:50:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-febbc7e5-2e7d-4b8a-8c06-4bcad9bb876a tempest-ProjectMemberTests-1488584303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:53 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-febbc7e5-2e7d-4b8a-8c06-4bcad9bb876a tempest-ProjectMemberTests-1488584303 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:50:53 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-febbc7e5-2e7d-4b8a-8c06-4bcad9bb876a tempest-ProjectMemberTests-1488584303 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:50:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-febbc7e5-2e7d-4b8a-8c06-4bcad9bb876a tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cf8745ec-f47e-4907-a795-e39f3e44f65d 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:53 devstack sudo[105451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cf8745ec-f47e-4907-a795-e39f3e44f65d 1073741824 Aug 28 09:50:53 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:53 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-febbc7e5-2e7d-4b8a-8c06-4bcad9bb876a tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cf8745ec-f47e-4907-a795-e39f3e44f65d 1073741824" returned: 0 in 0.461s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:53 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-febbc7e5-2e7d-4b8a-8c06-4bcad9bb876a tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cf8745ec-f47e-4907-a795-e39f3e44f65d {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:53 devstack sudo[105457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cf8745ec-f47e-4907-a795-e39f3e44f65d Aug 28 09:50:53 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:54 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-febbc7e5-2e7d-4b8a-8c06-4bcad9bb876a tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cf8745ec-f47e-4907-a795-e39f3e44f65d" returned: 0 in 0.244s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:54 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-febbc7e5-2e7d-4b8a-8c06-4bcad9bb876a tempest-ProjectMemberTests-1488584303 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:50:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-febbc7e5-2e7d-4b8a-8c06-4bcad9bb876a tempest-ProjectMemberTests-1488584303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:54 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-febbc7e5-2e7d-4b8a-8c06-4bcad9bb876a tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be81c892-2cf1-4b79-83b2-2d0e7fd63097) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf8745ec-f47e-4907-a795-e39f3e44f65d', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:54 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-febbc7e5-2e7d-4b8a-8c06-4bcad9bb876a tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67bb495a-ca18-40b2-b6fa-e1fa06c00456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:50:54 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-febbc7e5-2e7d-4b8a-8c06-4bcad9bb876a tempest-ProjectMemberTests-1488584303 None] Volume volume-cf8745ec-f47e-4907-a795-e39f3e44f65d (cf8745ec-f47e-4907-a795-e39f3e44f65d): created successfully Aug 28 09:50:54 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-febbc7e5-2e7d-4b8a-8c06-4bcad9bb876a tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67bb495a-ca18-40b2-b6fa-e1fa06c00456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:50:54 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-febbc7e5-2e7d-4b8a-8c06-4bcad9bb876a tempest-ProjectMemberTests-1488584303 None] Flow 'volume_create_manager' (4fd7fdb4-75fb-474e-ad43-dd037d03b5f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:50:54 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-febbc7e5-2e7d-4b8a-8c06-4bcad9bb876a tempest-ProjectMemberTests-1488584303 None] Created volume successfully. Aug 28 09:50:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-83acb87d-a2b7-4594-a2c0-baea40f95222 tempest-ProjectMemberTests-1488584303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:50:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-83acb87d-a2b7-4594-a2c0-baea40f95222 tempest-ProjectMemberTests-1488584303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:50:54 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-83acb87d-a2b7-4594-a2c0-baea40f95222 tempest-ProjectMemberTests-1488584303 None] Creating offline snapshot 16200e22-1dce-4c77-9717-8283e0d6ebbb of volume cf8745ec-f47e-4907-a795-e39f3e44f65d {{(pid=86081) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:50:54 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca0ceac-a837-4778-819c-5cb5a21c8750]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:50:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-83acb87d-a2b7-4594-a2c0-baea40f95222 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cf8745ec-f47e-4907-a795-e39f3e44f65d {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:54 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cf8745ec-f47e-4907-a795-e39f3e44f65d Aug 28 09:50:54 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:54 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-83acb87d-a2b7-4594-a2c0-baea40f95222 tempest-ProjectMemberTests-1488584303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cf8745ec-f47e-4907-a795-e39f3e44f65d" returned: 0 in 0.385s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:54 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-83acb87d-a2b7-4594-a2c0-baea40f95222 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cf8745ec-f47e-4907-a795-e39f3e44f65d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cf8745ec-f47e-4907-a795-e39f3e44f65d.16200e22-1dce-4c77-9717-8283e0d6ebbb 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:54 devstack sudo[105465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cf8745ec-f47e-4907-a795-e39f3e44f65d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cf8745ec-f47e-4907-a795-e39f3e44f65d.16200e22-1dce-4c77-9717-8283e0d6ebbb 1G Aug 28 09:50:54 devstack sudo[105465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:55 devstack sudo[105465]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-83acb87d-a2b7-4594-a2c0-baea40f95222 tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cf8745ec-f47e-4907-a795-e39f3e44f65d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cf8745ec-f47e-4907-a795-e39f3e44f65d.16200e22-1dce-4c77-9717-8283e0d6ebbb 1G" returned: 0 in 0.420s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-83acb87d-a2b7-4594-a2c0-baea40f95222 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf8745ec-f47e-4907-a795-e39f3e44f65d -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cf8745ec-f47e-4907-a795-e39f3e44f65d.16200e22-1dce-4c77-9717-8283e0d6ebbb {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:55 devstack sudo[105471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf8745ec-f47e-4907-a795-e39f3e44f65d -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cf8745ec-f47e-4907-a795-e39f3e44f65d.16200e22-1dce-4c77-9717-8283e0d6ebbb Aug 28 09:50:55 devstack sudo[105471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:55 devstack sudo[105471]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-83acb87d-a2b7-4594-a2c0-baea40f95222 tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf8745ec-f47e-4907-a795-e39f3e44f65d -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cf8745ec-f47e-4907-a795-e39f3e44f65d.16200e22-1dce-4c77-9717-8283e0d6ebbb" returned: 0 in 0.338s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:55 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-83acb87d-a2b7-4594-a2c0-baea40f95222 tempest-ProjectMemberTests-1488584303 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cf8745ec-f47e-4907-a795-e39f3e44f65d.16200e22-1dce-4c77-9717-8283e0d6ebbb is being set with open permissions: ugo+rw Aug 28 09:50:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-83acb87d-a2b7-4594-a2c0-baea40f95222 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cf8745ec-f47e-4907-a795-e39f3e44f65d.16200e22-1dce-4c77-9717-8283e0d6ebbb {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:55 devstack sudo[105477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cf8745ec-f47e-4907-a795-e39f3e44f65d.16200e22-1dce-4c77-9717-8283e0d6ebbb Aug 28 09:50:55 devstack sudo[105477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:55 devstack sudo[105477]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-83acb87d-a2b7-4594-a2c0-baea40f95222 tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cf8745ec-f47e-4907-a795-e39f3e44f65d.16200e22-1dce-4c77-9717-8283e0d6ebbb" returned: 0 in 0.252s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:55 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-83acb87d-a2b7-4594-a2c0-baea40f95222 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cf8745ec-f47e-4907-a795-e39f3e44f65d.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:55 devstack sudo[105480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cf8745ec-f47e-4907-a795-e39f3e44f65d.info Aug 28 09:50:55 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:56 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-83acb87d-a2b7-4594-a2c0-baea40f95222 tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cf8745ec-f47e-4907-a795-e39f3e44f65d.info" returned: 0 in 0.277s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:56 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-83acb87d-a2b7-4594-a2c0-baea40f95222 tempest-ProjectMemberTests-1488584303 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cf8745ec-f47e-4907-a795-e39f3e44f65d.info is being set with open permissions: ugo+rw Aug 28 09:50:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-83acb87d-a2b7-4594-a2c0-baea40f95222 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cf8745ec-f47e-4907-a795-e39f3e44f65d.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:56 devstack sudo[105483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cf8745ec-f47e-4907-a795-e39f3e44f65d.info Aug 28 09:50:56 devstack sudo[105483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:56 devstack sudo[105483]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-83acb87d-a2b7-4594-a2c0-baea40f95222 tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cf8745ec-f47e-4907-a795-e39f3e44f65d.info" returned: 0 in 0.254s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:56 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-83acb87d-a2b7-4594-a2c0-baea40f95222 tempest-ProjectMemberTests-1488584303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.015s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:50:56 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-83acb87d-a2b7-4594-a2c0-baea40f95222 tempest-ProjectMemberTests-1488584303 None] Create snapshot completed successfully Aug 28 09:50:57 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2bd30848-294c-4278-83a9-e5d50a4d741c tempest-ProjectMemberTests-1488584303 None] Acquiring lock "cinder-16200e22-1dce-4c77-9717-8283e0d6ebbb-delete_snapshot" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:57 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2bd30848-294c-4278-83a9-e5d50a4d741c tempest-ProjectMemberTests-1488584303 None] Lock "cinder-16200e22-1dce-4c77-9717-8283e0d6ebbb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:57 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2bd30848-294c-4278-83a9-e5d50a4d741c tempest-ProjectMemberTests-1488584303 None] Acquiring lock "cinder-quobyte-cf8745ec-f47e-4907-a795-e39f3e44f65d" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:57 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2bd30848-294c-4278-83a9-e5d50a4d741c tempest-ProjectMemberTests-1488584303 None] Lock "cinder-quobyte-cf8745ec-f47e-4907-a795-e39f3e44f65d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:57 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2bd30848-294c-4278-83a9-e5d50a4d741c tempest-ProjectMemberTests-1488584303 None] Acquiring lock "cinder-quobyte-16200e22-1dce-4c77-9717-8283e0d6ebbb" by "_delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:57 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2bd30848-294c-4278-83a9-e5d50a4d741c tempest-ProjectMemberTests-1488584303 None] Lock "cinder-quobyte-16200e22-1dce-4c77-9717-8283e0d6ebbb" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:57 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-2bd30848-294c-4278-83a9-e5d50a4d741c tempest-ProjectMemberTests-1488584303 None] Deleting offline snapshot 16200e22-1dce-4c77-9717-8283e0d6ebbb of volume cf8745ec-f47e-4907-a795-e39f3e44f65d {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:50:57 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-2bd30848-294c-4278-83a9-e5d50a4d741c tempest-ProjectMemberTests-1488584303 None] snapshot_file for this snap is: volume-cf8745ec-f47e-4907-a795-e39f3e44f65d.16200e22-1dce-4c77-9717-8283e0d6ebbb {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:50:57 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81c18f9-5571-4bf2-bd21-255a6dac8fd3]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:50:57 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2bd30848-294c-4278-83a9-e5d50a4d741c tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cf8745ec-f47e-4907-a795-e39f3e44f65d.16200e22-1dce-4c77-9717-8283e0d6ebbb {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:57 devstack sudo[105486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cf8745ec-f47e-4907-a795-e39f3e44f65d.16200e22-1dce-4c77-9717-8283e0d6ebbb Aug 28 09:50:57 devstack sudo[105486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:58 devstack sudo[105486]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2bd30848-294c-4278-83a9-e5d50a4d741c tempest-ProjectMemberTests-1488584303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cf8745ec-f47e-4907-a795-e39f3e44f65d.16200e22-1dce-4c77-9717-8283e0d6ebbb" returned: 0 in 0.385s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:58 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-2bd30848-294c-4278-83a9-e5d50a4d741c tempest-ProjectMemberTests-1488584303 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf8745ec-f47e-4907-a795-e39f3e44f65d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:50:58 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[d071ed29-8aef-4f66-9dd7-4f333948c1af]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:50:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2bd30848-294c-4278-83a9-e5d50a4d741c tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cf8745ec-f47e-4907-a795-e39f3e44f65d {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:58 devstack sudo[105491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cf8745ec-f47e-4907-a795-e39f3e44f65d Aug 28 09:50:58 devstack sudo[105491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:58 devstack sudo[105491]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2bd30848-294c-4278-83a9-e5d50a4d741c tempest-ProjectMemberTests-1488584303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cf8745ec-f47e-4907-a795-e39f3e44f65d" returned: 0 in 0.373s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2bd30848-294c-4278-83a9-e5d50a4d741c tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cf8745ec-f47e-4907-a795-e39f3e44f65d.16200e22-1dce-4c77-9717-8283e0d6ebbb {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:58 devstack sudo[105496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cf8745ec-f47e-4907-a795-e39f3e44f65d.16200e22-1dce-4c77-9717-8283e0d6ebbb Aug 28 09:50:58 devstack sudo[105496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:58 devstack sudo[105496]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2bd30848-294c-4278-83a9-e5d50a4d741c tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cf8745ec-f47e-4907-a795-e39f3e44f65d.16200e22-1dce-4c77-9717-8283e0d6ebbb" returned: 0 in 0.442s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:58 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2bd30848-294c-4278-83a9-e5d50a4d741c tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cf8745ec-f47e-4907-a795-e39f3e44f65d.16200e22-1dce-4c77-9717-8283e0d6ebbb {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:50:58 devstack sudo[105501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cf8745ec-f47e-4907-a795-e39f3e44f65d.16200e22-1dce-4c77-9717-8283e0d6ebbb Aug 28 09:50:58 devstack sudo[105501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:50:59 devstack sudo[105501]: pam_unix(sudo:session): session closed for user root Aug 28 09:50:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2bd30848-294c-4278-83a9-e5d50a4d741c tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cf8745ec-f47e-4907-a795-e39f3e44f65d.16200e22-1dce-4c77-9717-8283e0d6ebbb" returned: 0 in 0.260s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:50:59 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2bd30848-294c-4278-83a9-e5d50a4d741c tempest-ProjectMemberTests-1488584303 None] Lock "cinder-quobyte-16200e22-1dce-4c77-9717-8283e0d6ebbb" released by "_delete_snapshot" :: held 1.559s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:59 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2bd30848-294c-4278-83a9-e5d50a4d741c tempest-ProjectMemberTests-1488584303 None] Lock "cinder-quobyte-cf8745ec-f47e-4907-a795-e39f3e44f65d" released by "delete_snapshot" :: held 1.582s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:59 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-2bd30848-294c-4278-83a9-e5d50a4d741c tempest-ProjectMemberTests-1488584303 None] Created reservations ['afe0933f-8d5a-41e5-b6d7-43377f992554', '127a87c2-8889-4551-94da-2c86d3eb0b50', 'c769cb11-0041-41f8-9762-92c8be73d335', 'e0df0408-067c-4896-a5e1-997330e3f822'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:50:59 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-2bd30848-294c-4278-83a9-e5d50a4d741c tempest-ProjectMemberTests-1488584303 None] Delete snapshot completed successfully. Aug 28 09:50:59 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-2bd30848-294c-4278-83a9-e5d50a4d741c tempest-ProjectMemberTests-1488584303 None] Lock "cinder-16200e22-1dce-4c77-9717-8283e0d6ebbb-delete_snapshot" released by "delete_snapshot" :: held 1.744s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:50:59 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-5fa25495-52c2-48e8-b347-cdf2330d0182 tempest-ProjectMemberTests-1488584303 None] Acquiring lock "cinder-cf8745ec-f47e-4907-a795-e39f3e44f65d-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:59 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-5fa25495-52c2-48e8-b347-cdf2330d0182 tempest-ProjectMemberTests-1488584303 None] Lock "cinder-cf8745ec-f47e-4907-a795-e39f3e44f65d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:59 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-5fa25495-52c2-48e8-b347-cdf2330d0182 tempest-ProjectMemberTests-1488584303 None] Acquiring lock "cinder-quobyte-cf8745ec-f47e-4907-a795-e39f3e44f65d" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:50:59 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-5fa25495-52c2-48e8-b347-cdf2330d0182 tempest-ProjectMemberTests-1488584303 None] Lock "cinder-quobyte-cf8745ec-f47e-4907-a795-e39f3e44f65d" acquired by "delete_volume" :: waited 0.021s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:50:59 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[118a13be-ad9e-4ab5-974f-0fd0b09a8841]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:50:59 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5fa25495-52c2-48e8-b347-cdf2330d0182 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cf8745ec-f47e-4907-a795-e39f3e44f65d {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:00 devstack sudo[105505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cf8745ec-f47e-4907-a795-e39f3e44f65d Aug 28 09:51:00 devstack sudo[105505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:00 devstack sudo[105505]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:00 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5fa25495-52c2-48e8-b347-cdf2330d0182 tempest-ProjectMemberTests-1488584303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cf8745ec-f47e-4907-a795-e39f3e44f65d" returned: 0 in 0.407s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:00 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5fa25495-52c2-48e8-b347-cdf2330d0182 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cf8745ec-f47e-4907-a795-e39f3e44f65d {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:00 devstack sudo[105510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cf8745ec-f47e-4907-a795-e39f3e44f65d Aug 28 09:51:00 devstack sudo[105510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:00 devstack sudo[105510]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:00 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5fa25495-52c2-48e8-b347-cdf2330d0182 tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cf8745ec-f47e-4907-a795-e39f3e44f65d" returned: 0 in 0.334s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:00 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-5fa25495-52c2-48e8-b347-cdf2330d0182 tempest-ProjectMemberTests-1488584303 None] Lock "cinder-quobyte-cf8745ec-f47e-4907-a795-e39f3e44f65d" released by "delete_volume" :: held 0.810s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:51:00 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-5fa25495-52c2-48e8-b347-cdf2330d0182 tempest-ProjectMemberTests-1488584303 None] Created reservations ['88ff0453-bfac-4579-8da3-6c9a5bbb2957', '2a5a0cd3-0086-493d-b845-7744978bb6bd', '7e37b2c1-15f4-44d2-a691-e89aa0563f44', '3b4298ef-804d-4b44-902a-68a9171e2563'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:51:00 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-5fa25495-52c2-48e8-b347-cdf2330d0182 tempest-ProjectMemberTests-1488584303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:51:00 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-5fa25495-52c2-48e8-b347-cdf2330d0182 tempest-ProjectMemberTests-1488584303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:51:00 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-5fa25495-52c2-48e8-b347-cdf2330d0182 tempest-ProjectMemberTests-1488584303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:51:00 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-5fa25495-52c2-48e8-b347-cdf2330d0182 tempest-ProjectMemberTests-1488584303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:51:00 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-5fa25495-52c2-48e8-b347-cdf2330d0182 tempest-ProjectMemberTests-1488584303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:51:00 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5fa25495-52c2-48e8-b347-cdf2330d0182 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:00 devstack sudo[105513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:51:00 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:01 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-5fa25495-52c2-48e8-b347-cdf2330d0182 tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.308s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:01 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-5fa25495-52c2-48e8-b347-cdf2330d0182 tempest-ProjectMemberTests-1488584303 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:51:01 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-5fa25495-52c2-48e8-b347-cdf2330d0182 tempest-ProjectMemberTests-1488584303 None] Deleted volume successfully. Aug 28 09:51:01 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-5fa25495-52c2-48e8-b347-cdf2330d0182 tempest-ProjectMemberTests-1488584303 None] Lock "cinder-cf8745ec-f47e-4907-a795-e39f3e44f65d-delete_volume" released by "delete_volume" :: held 1.385s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:51:01 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-20054a10-d852-469d-8238-042ff0ec9f1c tempest-ProjectMemberTests-1488584303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:51:01 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-20054a10-d852-469d-8238-042ff0ec9f1c tempest-ProjectMemberTests-1488584303 None] Flow 'volume_create_manager' (ee3bd4fa-f9b3-4dfb-939c-fd63b41f88a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:51:01 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-20054a10-d852-469d-8238-042ff0ec9f1c tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (272911ce-598a-43b9-87f6-0c3bc4a1dd49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:51:01 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-20054a10-d852-469d-8238-042ff0ec9f1c tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (272911ce-598a-43b9-87f6-0c3bc4a1dd49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:51:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1840427843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ff19f64-60d4-4d84-87a0-5839b830bd0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b056b8e115744d6a55a8cf4e112ebe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:51:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:51:01Z,use_quota=True,user_id='7e7fc1a0e4d74db1a1b75434c7703666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:51:01 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-20054a10-d852-469d-8238-042ff0ec9f1c tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25815355-a978-442f-a738-4165e2cc14ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:51:01 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-20054a10-d852-469d-8238-042ff0ec9f1c tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25815355-a978-442f-a738-4165e2cc14ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:51:01 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-20054a10-d852-469d-8238-042ff0ec9f1c tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c1533d2-b8ae-40fa-867d-85f1959fb13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:51:01 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-20054a10-d852-469d-8238-042ff0ec9f1c tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c1533d2-b8ae-40fa-867d-85f1959fb13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ff19f64-60d4-4d84-87a0-5839b830bd0c', 'volume_name': 'volume-4ff19f64-60d4-4d84-87a0-5839b830bd0c', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:51:01 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-20054a10-d852-469d-8238-042ff0ec9f1c tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28c91e08-664f-4187-80de-c4d045f8133d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:51:01 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-20054a10-d852-469d-8238-042ff0ec9f1c tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28c91e08-664f-4187-80de-c4d045f8133d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:51:01 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-20054a10-d852-469d-8238-042ff0ec9f1c tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84ca2a76-98f2-45fe-b030-887ade5a57c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:51:01 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-20054a10-d852-469d-8238-042ff0ec9f1c tempest-ProjectMemberTests-1488584303 None] Volume 4ff19f64-60d4-4d84-87a0-5839b830bd0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ff19f64-60d4-4d84-87a0-5839b830bd0c', 'volume_size': 1} Aug 28 09:51:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-20054a10-d852-469d-8238-042ff0ec9f1c tempest-ProjectMemberTests-1488584303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:51:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-20054a10-d852-469d-8238-042ff0ec9f1c tempest-ProjectMemberTests-1488584303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:51:01 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-20054a10-d852-469d-8238-042ff0ec9f1c tempest-ProjectMemberTests-1488584303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:51:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1840427843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ff19f64-60d4-4d84-87a0-5839b830bd0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b056b8e115744d6a55a8cf4e112ebe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:51:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:51:01Z,use_quota=True,user_id='7e7fc1a0e4d74db1a1b75434c7703666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:51:01 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-20054a10-d852-469d-8238-042ff0ec9f1c tempest-ProjectMemberTests-1488584303 None] Creating volume 4ff19f64-60d4-4d84-87a0-5839b830bd0c {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:51:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-20054a10-d852-469d-8238-042ff0ec9f1c tempest-ProjectMemberTests-1488584303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:51:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-20054a10-d852-469d-8238-042ff0ec9f1c tempest-ProjectMemberTests-1488584303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:51:01 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-20054a10-d852-469d-8238-042ff0ec9f1c tempest-ProjectMemberTests-1488584303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:51:01 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-20054a10-d852-469d-8238-042ff0ec9f1c tempest-ProjectMemberTests-1488584303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:51:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-20054a10-d852-469d-8238-042ff0ec9f1c tempest-ProjectMemberTests-1488584303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:51:01 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-20054a10-d852-469d-8238-042ff0ec9f1c tempest-ProjectMemberTests-1488584303 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:51:01 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-20054a10-d852-469d-8238-042ff0ec9f1c tempest-ProjectMemberTests-1488584303 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:51:01 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-20054a10-d852-469d-8238-042ff0ec9f1c tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ff19f64-60d4-4d84-87a0-5839b830bd0c 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:01 devstack sudo[105516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ff19f64-60d4-4d84-87a0-5839b830bd0c 1073741824 Aug 28 09:51:01 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:02 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-20054a10-d852-469d-8238-042ff0ec9f1c tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ff19f64-60d4-4d84-87a0-5839b830bd0c 1073741824" returned: 0 in 0.454s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-20054a10-d852-469d-8238-042ff0ec9f1c tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ff19f64-60d4-4d84-87a0-5839b830bd0c {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:02 devstack sudo[105522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ff19f64-60d4-4d84-87a0-5839b830bd0c Aug 28 09:51:02 devstack sudo[105522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:02 devstack sudo[105522]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-20054a10-d852-469d-8238-042ff0ec9f1c tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ff19f64-60d4-4d84-87a0-5839b830bd0c" returned: 0 in 0.275s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:02 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-20054a10-d852-469d-8238-042ff0ec9f1c tempest-ProjectMemberTests-1488584303 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:51:02 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-20054a10-d852-469d-8238-042ff0ec9f1c tempest-ProjectMemberTests-1488584303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:51:02 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-20054a10-d852-469d-8238-042ff0ec9f1c tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84ca2a76-98f2-45fe-b030-887ade5a57c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ff19f64-60d4-4d84-87a0-5839b830bd0c', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:51:02 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-20054a10-d852-469d-8238-042ff0ec9f1c tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cd8e98a-a3f1-46d2-a668-2c0f68ffdb99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:51:02 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-20054a10-d852-469d-8238-042ff0ec9f1c tempest-ProjectMemberTests-1488584303 None] Volume volume-4ff19f64-60d4-4d84-87a0-5839b830bd0c (4ff19f64-60d4-4d84-87a0-5839b830bd0c): created successfully Aug 28 09:51:02 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-20054a10-d852-469d-8238-042ff0ec9f1c tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cd8e98a-a3f1-46d2-a668-2c0f68ffdb99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:51:02 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-20054a10-d852-469d-8238-042ff0ec9f1c tempest-ProjectMemberTests-1488584303 None] Flow 'volume_create_manager' (ee3bd4fa-f9b3-4dfb-939c-fd63b41f88a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:51:02 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-20054a10-d852-469d-8238-042ff0ec9f1c tempest-ProjectMemberTests-1488584303 None] Created volume successfully. Aug 28 09:51:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-905eca87-924d-42a9-9dc1-5ccae8b306da tempest-ProjectMemberTests-1488584303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:51:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-905eca87-924d-42a9-9dc1-5ccae8b306da tempest-ProjectMemberTests-1488584303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:51:03 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-905eca87-924d-42a9-9dc1-5ccae8b306da tempest-ProjectMemberTests-1488584303 None] Creating offline snapshot ffd4f6fa-1d16-4ac4-966b-37ad0152d0cf of volume 4ff19f64-60d4-4d84-87a0-5839b830bd0c {{(pid=86081) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:51:03 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1188a80-a7ce-44f6-9db0-a4630b1f725b]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:51:03 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-905eca87-924d-42a9-9dc1-5ccae8b306da tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ff19f64-60d4-4d84-87a0-5839b830bd0c {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:03 devstack sudo[105525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ff19f64-60d4-4d84-87a0-5839b830bd0c Aug 28 09:51:03 devstack sudo[105525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:04 devstack sudo[105525]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-905eca87-924d-42a9-9dc1-5ccae8b306da tempest-ProjectMemberTests-1488584303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ff19f64-60d4-4d84-87a0-5839b830bd0c" returned: 0 in 0.428s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-905eca87-924d-42a9-9dc1-5ccae8b306da tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ff19f64-60d4-4d84-87a0-5839b830bd0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ff19f64-60d4-4d84-87a0-5839b830bd0c.ffd4f6fa-1d16-4ac4-966b-37ad0152d0cf 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:04 devstack sudo[105530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ff19f64-60d4-4d84-87a0-5839b830bd0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ff19f64-60d4-4d84-87a0-5839b830bd0c.ffd4f6fa-1d16-4ac4-966b-37ad0152d0cf 1G Aug 28 09:51:04 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:04 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-905eca87-924d-42a9-9dc1-5ccae8b306da tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ff19f64-60d4-4d84-87a0-5839b830bd0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ff19f64-60d4-4d84-87a0-5839b830bd0c.ffd4f6fa-1d16-4ac4-966b-37ad0152d0cf 1G" returned: 0 in 0.443s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:04 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-905eca87-924d-42a9-9dc1-5ccae8b306da tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ff19f64-60d4-4d84-87a0-5839b830bd0c -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ff19f64-60d4-4d84-87a0-5839b830bd0c.ffd4f6fa-1d16-4ac4-966b-37ad0152d0cf {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:04 devstack sudo[105542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ff19f64-60d4-4d84-87a0-5839b830bd0c -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ff19f64-60d4-4d84-87a0-5839b830bd0c.ffd4f6fa-1d16-4ac4-966b-37ad0152d0cf Aug 28 09:51:04 devstack sudo[105542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:05 devstack sudo[105542]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-905eca87-924d-42a9-9dc1-5ccae8b306da tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ff19f64-60d4-4d84-87a0-5839b830bd0c -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ff19f64-60d4-4d84-87a0-5839b830bd0c.ffd4f6fa-1d16-4ac4-966b-37ad0152d0cf" returned: 0 in 0.330s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:05 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-905eca87-924d-42a9-9dc1-5ccae8b306da tempest-ProjectMemberTests-1488584303 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ff19f64-60d4-4d84-87a0-5839b830bd0c.ffd4f6fa-1d16-4ac4-966b-37ad0152d0cf is being set with open permissions: ugo+rw Aug 28 09:51:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-905eca87-924d-42a9-9dc1-5ccae8b306da tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ff19f64-60d4-4d84-87a0-5839b830bd0c.ffd4f6fa-1d16-4ac4-966b-37ad0152d0cf {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:05 devstack sudo[105547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ff19f64-60d4-4d84-87a0-5839b830bd0c.ffd4f6fa-1d16-4ac4-966b-37ad0152d0cf Aug 28 09:51:05 devstack sudo[105547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:05 devstack sudo[105547]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-905eca87-924d-42a9-9dc1-5ccae8b306da tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ff19f64-60d4-4d84-87a0-5839b830bd0c.ffd4f6fa-1d16-4ac4-966b-37ad0152d0cf" returned: 0 in 0.262s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-905eca87-924d-42a9-9dc1-5ccae8b306da tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ff19f64-60d4-4d84-87a0-5839b830bd0c.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:05 devstack sudo[105550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ff19f64-60d4-4d84-87a0-5839b830bd0c.info Aug 28 09:51:05 devstack sudo[105550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:05 devstack sudo[105550]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-905eca87-924d-42a9-9dc1-5ccae8b306da tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ff19f64-60d4-4d84-87a0-5839b830bd0c.info" returned: 0 in 0.261s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:05 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-905eca87-924d-42a9-9dc1-5ccae8b306da tempest-ProjectMemberTests-1488584303 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ff19f64-60d4-4d84-87a0-5839b830bd0c.info is being set with open permissions: ugo+rw Aug 28 09:51:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-905eca87-924d-42a9-9dc1-5ccae8b306da tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ff19f64-60d4-4d84-87a0-5839b830bd0c.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:05 devstack sudo[105553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ff19f64-60d4-4d84-87a0-5839b830bd0c.info Aug 28 09:51:05 devstack sudo[105553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:05 devstack sudo[105553]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-905eca87-924d-42a9-9dc1-5ccae8b306da tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ff19f64-60d4-4d84-87a0-5839b830bd0c.info" returned: 0 in 0.306s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:05 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-905eca87-924d-42a9-9dc1-5ccae8b306da tempest-ProjectMemberTests-1488584303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.129s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:51:05 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-905eca87-924d-42a9-9dc1-5ccae8b306da tempest-ProjectMemberTests-1488584303 None] Create snapshot completed successfully Aug 28 09:51:06 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-32dea819-ed17-403d-93ad-246df9e21e7e tempest-ProjectMemberTests-1488584303 None] Acquiring lock "cinder-ffd4f6fa-1d16-4ac4-966b-37ad0152d0cf-delete_snapshot" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:51:06 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-32dea819-ed17-403d-93ad-246df9e21e7e tempest-ProjectMemberTests-1488584303 None] Lock "cinder-ffd4f6fa-1d16-4ac4-966b-37ad0152d0cf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:51:07 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-32dea819-ed17-403d-93ad-246df9e21e7e tempest-ProjectMemberTests-1488584303 None] Acquiring lock "cinder-quobyte-4ff19f64-60d4-4d84-87a0-5839b830bd0c" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:51:07 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-32dea819-ed17-403d-93ad-246df9e21e7e tempest-ProjectMemberTests-1488584303 None] Lock "cinder-quobyte-4ff19f64-60d4-4d84-87a0-5839b830bd0c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:51:07 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-32dea819-ed17-403d-93ad-246df9e21e7e tempest-ProjectMemberTests-1488584303 None] Acquiring lock "cinder-quobyte-ffd4f6fa-1d16-4ac4-966b-37ad0152d0cf" by "_delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:51:07 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-32dea819-ed17-403d-93ad-246df9e21e7e tempest-ProjectMemberTests-1488584303 None] Lock "cinder-quobyte-ffd4f6fa-1d16-4ac4-966b-37ad0152d0cf" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:51:07 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-32dea819-ed17-403d-93ad-246df9e21e7e tempest-ProjectMemberTests-1488584303 None] Deleting offline snapshot ffd4f6fa-1d16-4ac4-966b-37ad0152d0cf of volume 4ff19f64-60d4-4d84-87a0-5839b830bd0c {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:51:07 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-32dea819-ed17-403d-93ad-246df9e21e7e tempest-ProjectMemberTests-1488584303 None] snapshot_file for this snap is: volume-4ff19f64-60d4-4d84-87a0-5839b830bd0c.ffd4f6fa-1d16-4ac4-966b-37ad0152d0cf {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:51:07 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9af1b2-83f9-46cb-bd1e-7e873aa5c9e7]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:51:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-32dea819-ed17-403d-93ad-246df9e21e7e tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ff19f64-60d4-4d84-87a0-5839b830bd0c.ffd4f6fa-1d16-4ac4-966b-37ad0152d0cf {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:07 devstack sudo[105556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ff19f64-60d4-4d84-87a0-5839b830bd0c.ffd4f6fa-1d16-4ac4-966b-37ad0152d0cf Aug 28 09:51:07 devstack sudo[105556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:07 devstack sudo[105556]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-32dea819-ed17-403d-93ad-246df9e21e7e tempest-ProjectMemberTests-1488584303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ff19f64-60d4-4d84-87a0-5839b830bd0c.ffd4f6fa-1d16-4ac4-966b-37ad0152d0cf" returned: 0 in 0.377s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:07 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-32dea819-ed17-403d-93ad-246df9e21e7e tempest-ProjectMemberTests-1488584303 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ff19f64-60d4-4d84-87a0-5839b830bd0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:51:07 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0cf89e5-ccd6-4f72-8459-8e3fb6d7579d]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:51:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-32dea819-ed17-403d-93ad-246df9e21e7e tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ff19f64-60d4-4d84-87a0-5839b830bd0c {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:07 devstack sudo[105561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ff19f64-60d4-4d84-87a0-5839b830bd0c Aug 28 09:51:07 devstack sudo[105561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:07 devstack sudo[105561]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-32dea819-ed17-403d-93ad-246df9e21e7e tempest-ProjectMemberTests-1488584303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ff19f64-60d4-4d84-87a0-5839b830bd0c" returned: 0 in 0.385s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:07 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-32dea819-ed17-403d-93ad-246df9e21e7e tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ff19f64-60d4-4d84-87a0-5839b830bd0c.ffd4f6fa-1d16-4ac4-966b-37ad0152d0cf {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:07 devstack sudo[105567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ff19f64-60d4-4d84-87a0-5839b830bd0c.ffd4f6fa-1d16-4ac4-966b-37ad0152d0cf Aug 28 09:51:07 devstack sudo[105567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:08 devstack sudo[105567]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-32dea819-ed17-403d-93ad-246df9e21e7e tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ff19f64-60d4-4d84-87a0-5839b830bd0c.ffd4f6fa-1d16-4ac4-966b-37ad0152d0cf" returned: 0 in 0.456s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-32dea819-ed17-403d-93ad-246df9e21e7e tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ff19f64-60d4-4d84-87a0-5839b830bd0c.ffd4f6fa-1d16-4ac4-966b-37ad0152d0cf {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:08 devstack sudo[105572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ff19f64-60d4-4d84-87a0-5839b830bd0c.ffd4f6fa-1d16-4ac4-966b-37ad0152d0cf Aug 28 09:51:08 devstack sudo[105572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:08 devstack sudo[105572]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:08 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-32dea819-ed17-403d-93ad-246df9e21e7e tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ff19f64-60d4-4d84-87a0-5839b830bd0c.ffd4f6fa-1d16-4ac4-966b-37ad0152d0cf" returned: 0 in 0.278s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:08 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-32dea819-ed17-403d-93ad-246df9e21e7e tempest-ProjectMemberTests-1488584303 None] Lock "cinder-quobyte-ffd4f6fa-1d16-4ac4-966b-37ad0152d0cf" released by "_delete_snapshot" :: held 1.611s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:51:08 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-32dea819-ed17-403d-93ad-246df9e21e7e tempest-ProjectMemberTests-1488584303 None] Lock "cinder-quobyte-4ff19f64-60d4-4d84-87a0-5839b830bd0c" released by "delete_snapshot" :: held 1.640s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:51:08 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-32dea819-ed17-403d-93ad-246df9e21e7e tempest-ProjectMemberTests-1488584303 None] Created reservations ['6bc42e4f-4d5a-4973-b4d4-a1666e64497b', '57061625-3bc8-401a-995c-c0eb7bfbb5f4', '41967d46-44e7-481c-ae78-9d0f47d20c1b', '629de857-8bf9-42c7-ba06-acc3c934a400'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:51:08 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-32dea819-ed17-403d-93ad-246df9e21e7e tempest-ProjectMemberTests-1488584303 None] Delete snapshot completed successfully. Aug 28 09:51:08 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-32dea819-ed17-403d-93ad-246df9e21e7e tempest-ProjectMemberTests-1488584303 None] Lock "cinder-ffd4f6fa-1d16-4ac4-966b-37ad0152d0cf-delete_snapshot" released by "delete_snapshot" :: held 1.804s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:51:09 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8ddee2ca-ec35-4103-a80e-8cbd38c706a3 tempest-ProjectMemberTests-1488584303 None] Acquiring lock "cinder-4ff19f64-60d4-4d84-87a0-5839b830bd0c-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:51:09 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8ddee2ca-ec35-4103-a80e-8cbd38c706a3 tempest-ProjectMemberTests-1488584303 None] Lock "cinder-4ff19f64-60d4-4d84-87a0-5839b830bd0c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:51:09 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8ddee2ca-ec35-4103-a80e-8cbd38c706a3 tempest-ProjectMemberTests-1488584303 None] Acquiring lock "cinder-quobyte-4ff19f64-60d4-4d84-87a0-5839b830bd0c" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:51:09 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8ddee2ca-ec35-4103-a80e-8cbd38c706a3 tempest-ProjectMemberTests-1488584303 None] Lock "cinder-quobyte-4ff19f64-60d4-4d84-87a0-5839b830bd0c" acquired by "delete_volume" :: waited 0.017s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:51:09 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b321feb-6748-4e29-a4ec-52216903e538]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:51:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8ddee2ca-ec35-4103-a80e-8cbd38c706a3 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ff19f64-60d4-4d84-87a0-5839b830bd0c {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:09 devstack sudo[105575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ff19f64-60d4-4d84-87a0-5839b830bd0c Aug 28 09:51:09 devstack sudo[105575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:09 devstack sudo[105575]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8ddee2ca-ec35-4103-a80e-8cbd38c706a3 tempest-ProjectMemberTests-1488584303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ff19f64-60d4-4d84-87a0-5839b830bd0c" returned: 0 in 0.448s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:09 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8ddee2ca-ec35-4103-a80e-8cbd38c706a3 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ff19f64-60d4-4d84-87a0-5839b830bd0c {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:09 devstack sudo[105582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ff19f64-60d4-4d84-87a0-5839b830bd0c Aug 28 09:51:09 devstack sudo[105582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:10 devstack sudo[105582]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8ddee2ca-ec35-4103-a80e-8cbd38c706a3 tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-4ff19f64-60d4-4d84-87a0-5839b830bd0c" returned: 0 in 0.315s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:10 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8ddee2ca-ec35-4103-a80e-8cbd38c706a3 tempest-ProjectMemberTests-1488584303 None] Lock "cinder-quobyte-4ff19f64-60d4-4d84-87a0-5839b830bd0c" released by "delete_volume" :: held 0.836s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:51:10 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-8ddee2ca-ec35-4103-a80e-8cbd38c706a3 tempest-ProjectMemberTests-1488584303 None] Created reservations ['bc7b446c-d30f-4164-96a4-4a798b977b2b', 'd4b4af5d-03c1-4563-96c7-f16a2cddc6c4', '0137e019-c638-431f-93e5-6cd4edf259cb', '04796480-890f-44ef-8950-6321210831d4'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:51:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8ddee2ca-ec35-4103-a80e-8cbd38c706a3 tempest-ProjectMemberTests-1488584303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:51:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8ddee2ca-ec35-4103-a80e-8cbd38c706a3 tempest-ProjectMemberTests-1488584303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:51:10 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-8ddee2ca-ec35-4103-a80e-8cbd38c706a3 tempest-ProjectMemberTests-1488584303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:51:10 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-8ddee2ca-ec35-4103-a80e-8cbd38c706a3 tempest-ProjectMemberTests-1488584303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:51:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-8ddee2ca-ec35-4103-a80e-8cbd38c706a3 tempest-ProjectMemberTests-1488584303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:51:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8ddee2ca-ec35-4103-a80e-8cbd38c706a3 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:10 devstack sudo[105585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:51:10 devstack sudo[105585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:10 devstack sudo[105585]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8ddee2ca-ec35-4103-a80e-8cbd38c706a3 tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.298s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:10 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-8ddee2ca-ec35-4103-a80e-8cbd38c706a3 tempest-ProjectMemberTests-1488584303 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:51:10 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-8ddee2ca-ec35-4103-a80e-8cbd38c706a3 tempest-ProjectMemberTests-1488584303 None] Deleted volume successfully. Aug 28 09:51:10 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8ddee2ca-ec35-4103-a80e-8cbd38c706a3 tempest-ProjectMemberTests-1488584303 None] Lock "cinder-4ff19f64-60d4-4d84-87a0-5839b830bd0c-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:51:10 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a4edb7a-bffd-41a8-b43d-aaa5a919bc1b tempest-ProjectMemberTests-1488584303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:51:10 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-4a4edb7a-bffd-41a8-b43d-aaa5a919bc1b tempest-ProjectMemberTests-1488584303 None] Flow 'volume_create_manager' (03783e0f-eb4a-4d87-b639-05dd9225d166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:51:10 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-4a4edb7a-bffd-41a8-b43d-aaa5a919bc1b tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96733645-d836-4793-a81b-47bc4ea13f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:51:10 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-4a4edb7a-bffd-41a8-b43d-aaa5a919bc1b tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96733645-d836-4793-a81b-47bc4ea13f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:51:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-415748344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e95529da-09d6-462d-a871-ac01f6fbc8aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b056b8e115744d6a55a8cf4e112ebe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:51:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:51:11Z,use_quota=True,user_id='7e7fc1a0e4d74db1a1b75434c7703666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:51:10 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-4a4edb7a-bffd-41a8-b43d-aaa5a919bc1b tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (412e543f-b259-488a-9ade-f07adba05496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:51:10 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-4a4edb7a-bffd-41a8-b43d-aaa5a919bc1b tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (412e543f-b259-488a-9ade-f07adba05496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:51:10 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-4a4edb7a-bffd-41a8-b43d-aaa5a919bc1b tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7e0d6e0-821e-4f07-abf0-adfc516a2686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:51:10 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-4a4edb7a-bffd-41a8-b43d-aaa5a919bc1b tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7e0d6e0-821e-4f07-abf0-adfc516a2686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e95529da-09d6-462d-a871-ac01f6fbc8aa', 'volume_name': 'volume-e95529da-09d6-462d-a871-ac01f6fbc8aa', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:51:10 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-4a4edb7a-bffd-41a8-b43d-aaa5a919bc1b tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21ec1f26-d556-4147-ac69-b81192887d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:51:10 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-4a4edb7a-bffd-41a8-b43d-aaa5a919bc1b tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21ec1f26-d556-4147-ac69-b81192887d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:51:10 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-4a4edb7a-bffd-41a8-b43d-aaa5a919bc1b tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50d8ef2d-3c09-4206-972f-4b69cca1c1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:51:10 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-4a4edb7a-bffd-41a8-b43d-aaa5a919bc1b tempest-ProjectMemberTests-1488584303 None] Volume e95529da-09d6-462d-a871-ac01f6fbc8aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e95529da-09d6-462d-a871-ac01f6fbc8aa', 'volume_size': 1} Aug 28 09:51:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-4a4edb7a-bffd-41a8-b43d-aaa5a919bc1b tempest-ProjectMemberTests-1488584303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:51:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-4a4edb7a-bffd-41a8-b43d-aaa5a919bc1b tempest-ProjectMemberTests-1488584303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:51:10 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-4a4edb7a-bffd-41a8-b43d-aaa5a919bc1b tempest-ProjectMemberTests-1488584303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:51:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-415748344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e95529da-09d6-462d-a871-ac01f6fbc8aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b056b8e115744d6a55a8cf4e112ebe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:51:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:51:11Z,use_quota=True,user_id='7e7fc1a0e4d74db1a1b75434c7703666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:51:10 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-4a4edb7a-bffd-41a8-b43d-aaa5a919bc1b tempest-ProjectMemberTests-1488584303 None] Creating volume e95529da-09d6-462d-a871-ac01f6fbc8aa {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:51:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-4a4edb7a-bffd-41a8-b43d-aaa5a919bc1b tempest-ProjectMemberTests-1488584303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:51:10 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-4a4edb7a-bffd-41a8-b43d-aaa5a919bc1b tempest-ProjectMemberTests-1488584303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:51:10 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-4a4edb7a-bffd-41a8-b43d-aaa5a919bc1b tempest-ProjectMemberTests-1488584303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:51:11 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-4a4edb7a-bffd-41a8-b43d-aaa5a919bc1b tempest-ProjectMemberTests-1488584303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:51:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-4a4edb7a-bffd-41a8-b43d-aaa5a919bc1b tempest-ProjectMemberTests-1488584303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:51:11 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-4a4edb7a-bffd-41a8-b43d-aaa5a919bc1b tempest-ProjectMemberTests-1488584303 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:51:11 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-4a4edb7a-bffd-41a8-b43d-aaa5a919bc1b tempest-ProjectMemberTests-1488584303 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:51:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4a4edb7a-bffd-41a8-b43d-aaa5a919bc1b tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e95529da-09d6-462d-a871-ac01f6fbc8aa 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:11 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e95529da-09d6-462d-a871-ac01f6fbc8aa 1073741824 Aug 28 09:51:11 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:11 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4a4edb7a-bffd-41a8-b43d-aaa5a919bc1b tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e95529da-09d6-462d-a871-ac01f6fbc8aa 1073741824" returned: 0 in 0.460s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4a4edb7a-bffd-41a8-b43d-aaa5a919bc1b tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e95529da-09d6-462d-a871-ac01f6fbc8aa {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:11 devstack sudo[105594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e95529da-09d6-462d-a871-ac01f6fbc8aa Aug 28 09:51:11 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:11 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-4a4edb7a-bffd-41a8-b43d-aaa5a919bc1b tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e95529da-09d6-462d-a871-ac01f6fbc8aa" returned: 0 in 0.272s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:11 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-4a4edb7a-bffd-41a8-b43d-aaa5a919bc1b tempest-ProjectMemberTests-1488584303 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:51:11 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-4a4edb7a-bffd-41a8-b43d-aaa5a919bc1b tempest-ProjectMemberTests-1488584303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:51:11 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-4a4edb7a-bffd-41a8-b43d-aaa5a919bc1b tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50d8ef2d-3c09-4206-972f-4b69cca1c1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e95529da-09d6-462d-a871-ac01f6fbc8aa', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:51:11 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-4a4edb7a-bffd-41a8-b43d-aaa5a919bc1b tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78cc535d-559c-456d-bee4-2df6b722877a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:51:11 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-4a4edb7a-bffd-41a8-b43d-aaa5a919bc1b tempest-ProjectMemberTests-1488584303 None] Volume volume-e95529da-09d6-462d-a871-ac01f6fbc8aa (e95529da-09d6-462d-a871-ac01f6fbc8aa): created successfully Aug 28 09:51:11 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-4a4edb7a-bffd-41a8-b43d-aaa5a919bc1b tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78cc535d-559c-456d-bee4-2df6b722877a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:51:11 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-4a4edb7a-bffd-41a8-b43d-aaa5a919bc1b tempest-ProjectMemberTests-1488584303 None] Flow 'volume_create_manager' (03783e0f-eb4a-4d87-b639-05dd9225d166) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:51:11 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-4a4edb7a-bffd-41a8-b43d-aaa5a919bc1b tempest-ProjectMemberTests-1488584303 None] Created volume successfully. Aug 28 09:51:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-fef64e6b-3af1-4e9b-bc08-c0bfd1337b60 tempest-ProjectMemberTests-1488584303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:51:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-fef64e6b-3af1-4e9b-bc08-c0bfd1337b60 tempest-ProjectMemberTests-1488584303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:51:12 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-fef64e6b-3af1-4e9b-bc08-c0bfd1337b60 tempest-ProjectMemberTests-1488584303 None] Creating offline snapshot 1ad26020-9dfb-4fd5-8909-afea1eefc753 of volume e95529da-09d6-462d-a871-ac01f6fbc8aa {{(pid=86081) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:51:12 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db32ab5-cf68-4480-8eb8-f646ad691eac]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:51:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fef64e6b-3af1-4e9b-bc08-c0bfd1337b60 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e95529da-09d6-462d-a871-ac01f6fbc8aa {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:12 devstack sudo[105597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e95529da-09d6-462d-a871-ac01f6fbc8aa Aug 28 09:51:12 devstack sudo[105597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:12 devstack sudo[105597]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fef64e6b-3af1-4e9b-bc08-c0bfd1337b60 tempest-ProjectMemberTests-1488584303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e95529da-09d6-462d-a871-ac01f6fbc8aa" returned: 0 in 0.420s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:12 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fef64e6b-3af1-4e9b-bc08-c0bfd1337b60 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e95529da-09d6-462d-a871-ac01f6fbc8aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e95529da-09d6-462d-a871-ac01f6fbc8aa.1ad26020-9dfb-4fd5-8909-afea1eefc753 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:12 devstack sudo[105602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e95529da-09d6-462d-a871-ac01f6fbc8aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e95529da-09d6-462d-a871-ac01f6fbc8aa.1ad26020-9dfb-4fd5-8909-afea1eefc753 1G Aug 28 09:51:12 devstack sudo[105602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:13 devstack sudo[105602]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fef64e6b-3af1-4e9b-bc08-c0bfd1337b60 tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e95529da-09d6-462d-a871-ac01f6fbc8aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e95529da-09d6-462d-a871-ac01f6fbc8aa.1ad26020-9dfb-4fd5-8909-afea1eefc753 1G" returned: 0 in 0.440s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fef64e6b-3af1-4e9b-bc08-c0bfd1337b60 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e95529da-09d6-462d-a871-ac01f6fbc8aa -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e95529da-09d6-462d-a871-ac01f6fbc8aa.1ad26020-9dfb-4fd5-8909-afea1eefc753 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:13 devstack sudo[105609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e95529da-09d6-462d-a871-ac01f6fbc8aa -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e95529da-09d6-462d-a871-ac01f6fbc8aa.1ad26020-9dfb-4fd5-8909-afea1eefc753 Aug 28 09:51:13 devstack sudo[105609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:13 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-58cfa523-0910-474e-a125-39c0f6cb9873 tempest-SnapshotDependencyTests-1355614938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:51:13 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-58cfa523-0910-474e-a125-39c0f6cb9873 tempest-SnapshotDependencyTests-1355614938 None] Flow 'volume_create_manager' (05362f67-a0ea-41a2-9cc0-2f785d69f985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:51:13 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-58cfa523-0910-474e-a125-39c0f6cb9873 tempest-SnapshotDependencyTests-1355614938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb8c543e-3984-4802-b746-c678d2bdfb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:51:13 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-58cfa523-0910-474e-a125-39c0f6cb9873 tempest-SnapshotDependencyTests-1355614938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb8c543e-3984-4802-b746-c678d2bdfb4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:51:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-239431458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd0bb41b-42e7-44b9-81ee-f59685813e2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a5a17495be847babdc3d1f8eaabd2a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:51:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:51:13Z,use_quota=True,user_id='c95fe89113314741a8ab909d832dfefb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:51:13 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-58cfa523-0910-474e-a125-39c0f6cb9873 tempest-SnapshotDependencyTests-1355614938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (006cfa1d-122c-48d6-9552-94ab45289d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:51:13 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-58cfa523-0910-474e-a125-39c0f6cb9873 tempest-SnapshotDependencyTests-1355614938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (006cfa1d-122c-48d6-9552-94ab45289d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:51:13 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-58cfa523-0910-474e-a125-39c0f6cb9873 tempest-SnapshotDependencyTests-1355614938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (673d3ca8-a0be-4434-a514-b8a0acbd2260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:51:13 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-58cfa523-0910-474e-a125-39c0f6cb9873 tempest-SnapshotDependencyTests-1355614938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (673d3ca8-a0be-4434-a514-b8a0acbd2260) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd0bb41b-42e7-44b9-81ee-f59685813e2f', 'volume_name': 'volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:51:13 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-58cfa523-0910-474e-a125-39c0f6cb9873 tempest-SnapshotDependencyTests-1355614938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cd7fc71-044f-4d13-9bdd-7a234b3d721c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:51:13 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-58cfa523-0910-474e-a125-39c0f6cb9873 tempest-SnapshotDependencyTests-1355614938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cd7fc71-044f-4d13-9bdd-7a234b3d721c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:51:13 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-58cfa523-0910-474e-a125-39c0f6cb9873 tempest-SnapshotDependencyTests-1355614938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed59c556-fb02-4862-bd8b-647baad0f056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:51:13 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-58cfa523-0910-474e-a125-39c0f6cb9873 tempest-SnapshotDependencyTests-1355614938 None] Volume cd0bb41b-42e7-44b9-81ee-f59685813e2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f', 'volume_size': 1} Aug 28 09:51:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-58cfa523-0910-474e-a125-39c0f6cb9873 tempest-SnapshotDependencyTests-1355614938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:51:13 devstack sudo[105609]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fef64e6b-3af1-4e9b-bc08-c0bfd1337b60 tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e95529da-09d6-462d-a871-ac01f6fbc8aa -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e95529da-09d6-462d-a871-ac01f6fbc8aa.1ad26020-9dfb-4fd5-8909-afea1eefc753" returned: 0 in 0.291s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:13 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-fef64e6b-3af1-4e9b-bc08-c0bfd1337b60 tempest-ProjectMemberTests-1488584303 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e95529da-09d6-462d-a871-ac01f6fbc8aa.1ad26020-9dfb-4fd5-8909-afea1eefc753 is being set with open permissions: ugo+rw Aug 28 09:51:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fef64e6b-3af1-4e9b-bc08-c0bfd1337b60 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e95529da-09d6-462d-a871-ac01f6fbc8aa.1ad26020-9dfb-4fd5-8909-afea1eefc753 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:13 devstack sudo[105614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e95529da-09d6-462d-a871-ac01f6fbc8aa.1ad26020-9dfb-4fd5-8909-afea1eefc753 Aug 28 09:51:13 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:13 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fef64e6b-3af1-4e9b-bc08-c0bfd1337b60 tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e95529da-09d6-462d-a871-ac01f6fbc8aa.1ad26020-9dfb-4fd5-8909-afea1eefc753" returned: 0 in 0.237s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fef64e6b-3af1-4e9b-bc08-c0bfd1337b60 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e95529da-09d6-462d-a871-ac01f6fbc8aa.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:13 devstack sudo[105617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e95529da-09d6-462d-a871-ac01f6fbc8aa.info Aug 28 09:51:13 devstack sudo[105617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:13 devstack sudo[105617]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fef64e6b-3af1-4e9b-bc08-c0bfd1337b60 tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e95529da-09d6-462d-a871-ac01f6fbc8aa.info" returned: 0 in 0.246s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:13 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-fef64e6b-3af1-4e9b-bc08-c0bfd1337b60 tempest-ProjectMemberTests-1488584303 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e95529da-09d6-462d-a871-ac01f6fbc8aa.info is being set with open permissions: ugo+rw Aug 28 09:51:13 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fef64e6b-3af1-4e9b-bc08-c0bfd1337b60 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e95529da-09d6-462d-a871-ac01f6fbc8aa.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:13 devstack sudo[105620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e95529da-09d6-462d-a871-ac01f6fbc8aa.info Aug 28 09:51:13 devstack sudo[105620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:14 devstack sudo[105620]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-fef64e6b-3af1-4e9b-bc08-c0bfd1337b60 tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e95529da-09d6-462d-a871-ac01f6fbc8aa.info" returned: 0 in 0.249s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-fef64e6b-3af1-4e9b-bc08-c0bfd1337b60 tempest-ProjectMemberTests-1488584303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.969s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:51:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-58cfa523-0910-474e-a125-39c0f6cb9873 tempest-SnapshotDependencyTests-1355614938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.891s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:51:14 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-58cfa523-0910-474e-a125-39c0f6cb9873 tempest-SnapshotDependencyTests-1355614938 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:51:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-239431458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd0bb41b-42e7-44b9-81ee-f59685813e2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a5a17495be847babdc3d1f8eaabd2a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:51:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:51:13Z,use_quota=True,user_id='c95fe89113314741a8ab909d832dfefb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:51:14 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-58cfa523-0910-474e-a125-39c0f6cb9873 tempest-SnapshotDependencyTests-1355614938 None] Creating volume cd0bb41b-42e7-44b9-81ee-f59685813e2f {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:51:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-58cfa523-0910-474e-a125-39c0f6cb9873 tempest-SnapshotDependencyTests-1355614938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:51:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-58cfa523-0910-474e-a125-39c0f6cb9873 tempest-SnapshotDependencyTests-1355614938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:51:14 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-58cfa523-0910-474e-a125-39c0f6cb9873 tempest-SnapshotDependencyTests-1355614938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:51:14 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-58cfa523-0910-474e-a125-39c0f6cb9873 tempest-SnapshotDependencyTests-1355614938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:51:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-58cfa523-0910-474e-a125-39c0f6cb9873 tempest-SnapshotDependencyTests-1355614938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:51:14 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-58cfa523-0910-474e-a125-39c0f6cb9873 tempest-SnapshotDependencyTests-1355614938 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:51:14 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-58cfa523-0910-474e-a125-39c0f6cb9873 tempest-SnapshotDependencyTests-1355614938 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:51:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-58cfa523-0910-474e-a125-39c0f6cb9873 tempest-SnapshotDependencyTests-1355614938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:14 devstack sudo[105623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f 1073741824 Aug 28 09:51:14 devstack sudo[105623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:14 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-fef64e6b-3af1-4e9b-bc08-c0bfd1337b60 tempest-ProjectMemberTests-1488584303 None] Create snapshot completed successfully Aug 28 09:51:14 devstack sudo[105623]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-58cfa523-0910-474e-a125-39c0f6cb9873 tempest-SnapshotDependencyTests-1355614938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f 1073741824" returned: 0 in 0.421s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-58cfa523-0910-474e-a125-39c0f6cb9873 tempest-SnapshotDependencyTests-1355614938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:14 devstack sudo[105629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f Aug 28 09:51:14 devstack sudo[105629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:14 devstack sudo[105629]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-58cfa523-0910-474e-a125-39c0f6cb9873 tempest-SnapshotDependencyTests-1355614938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f" returned: 0 in 0.234s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:14 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-58cfa523-0910-474e-a125-39c0f6cb9873 tempest-SnapshotDependencyTests-1355614938 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:51:14 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-58cfa523-0910-474e-a125-39c0f6cb9873 tempest-SnapshotDependencyTests-1355614938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:51:14 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-58cfa523-0910-474e-a125-39c0f6cb9873 tempest-SnapshotDependencyTests-1355614938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed59c556-fb02-4862-bd8b-647baad0f056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:51:14 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-58cfa523-0910-474e-a125-39c0f6cb9873 tempest-SnapshotDependencyTests-1355614938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5455289e-1fb4-4f15-9a4d-a5233482c7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:51:14 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-58cfa523-0910-474e-a125-39c0f6cb9873 tempest-SnapshotDependencyTests-1355614938 None] Volume volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f (cd0bb41b-42e7-44b9-81ee-f59685813e2f): created successfully Aug 28 09:51:14 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-58cfa523-0910-474e-a125-39c0f6cb9873 tempest-SnapshotDependencyTests-1355614938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5455289e-1fb4-4f15-9a4d-a5233482c7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:51:14 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-58cfa523-0910-474e-a125-39c0f6cb9873 tempest-SnapshotDependencyTests-1355614938 None] Flow 'volume_create_manager' (05362f67-a0ea-41a2-9cc0-2f785d69f985) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:51:14 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-58cfa523-0910-474e-a125-39c0f6cb9873 tempest-SnapshotDependencyTests-1355614938 None] Created volume successfully. Aug 28 09:51:15 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8d57c36b-0eae-40b7-985d-b4d85358519b tempest-ProjectMemberTests-1488584303 None] Acquiring lock "cinder-1ad26020-9dfb-4fd5-8909-afea1eefc753-delete_snapshot" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:51:15 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8d57c36b-0eae-40b7-985d-b4d85358519b tempest-ProjectMemberTests-1488584303 None] Lock "cinder-1ad26020-9dfb-4fd5-8909-afea1eefc753-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:51:15 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8d57c36b-0eae-40b7-985d-b4d85358519b tempest-ProjectMemberTests-1488584303 None] Acquiring lock "cinder-quobyte-e95529da-09d6-462d-a871-ac01f6fbc8aa" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:51:15 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8d57c36b-0eae-40b7-985d-b4d85358519b tempest-ProjectMemberTests-1488584303 None] Lock "cinder-quobyte-e95529da-09d6-462d-a871-ac01f6fbc8aa" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:51:15 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8d57c36b-0eae-40b7-985d-b4d85358519b tempest-ProjectMemberTests-1488584303 None] Acquiring lock "cinder-quobyte-1ad26020-9dfb-4fd5-8909-afea1eefc753" by "_delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:51:15 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8d57c36b-0eae-40b7-985d-b4d85358519b tempest-ProjectMemberTests-1488584303 None] Lock "cinder-quobyte-1ad26020-9dfb-4fd5-8909-afea1eefc753" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:51:15 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-8d57c36b-0eae-40b7-985d-b4d85358519b tempest-ProjectMemberTests-1488584303 None] Deleting offline snapshot 1ad26020-9dfb-4fd5-8909-afea1eefc753 of volume e95529da-09d6-462d-a871-ac01f6fbc8aa {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:51:15 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-8d57c36b-0eae-40b7-985d-b4d85358519b tempest-ProjectMemberTests-1488584303 None] snapshot_file for this snap is: volume-e95529da-09d6-462d-a871-ac01f6fbc8aa.1ad26020-9dfb-4fd5-8909-afea1eefc753 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:51:15 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e50200-76d1-46c3-a145-071d717454e5]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:51:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8d57c36b-0eae-40b7-985d-b4d85358519b tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e95529da-09d6-462d-a871-ac01f6fbc8aa.1ad26020-9dfb-4fd5-8909-afea1eefc753 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-d13f976b-06df-4610-bff9-4d9b49a03111 tempest-SnapshotDependencyTests-1355614938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:51:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-d13f976b-06df-4610-bff9-4d9b49a03111 tempest-SnapshotDependencyTests-1355614938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:51:15 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writing DB stats cinder:SELECT=135,cinder:INSERT=43,cinder:UPDATE=175,cinder:DELETE=16 {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:51:15 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-d13f976b-06df-4610-bff9-4d9b49a03111 tempest-SnapshotDependencyTests-1355614938 None] Creating offline snapshot 5c83f977-b22b-4668-8dc4-ea7078ebc637 of volume cd0bb41b-42e7-44b9-81ee-f59685813e2f {{(pid=86081) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:51:15 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[66861ca9-735b-4933-80bb-39d91ecf379c]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:51:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d13f976b-06df-4610-bff9-4d9b49a03111 tempest-SnapshotDependencyTests-1355614938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:15 devstack sudo[105632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e95529da-09d6-462d-a871-ac01f6fbc8aa.1ad26020-9dfb-4fd5-8909-afea1eefc753 Aug 28 09:51:15 devstack sudo[105632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:15 devstack sudo[105633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f Aug 28 09:51:15 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:15 devstack sudo[105632]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8d57c36b-0eae-40b7-985d-b4d85358519b tempest-ProjectMemberTests-1488584303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e95529da-09d6-462d-a871-ac01f6fbc8aa.1ad26020-9dfb-4fd5-8909-afea1eefc753" returned: 0 in 0.380s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:15 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-8d57c36b-0eae-40b7-985d-b4d85358519b tempest-ProjectMemberTests-1488584303 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e95529da-09d6-462d-a871-ac01f6fbc8aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:51:15 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4968950-ff36-46b3-bdaf-4c400c1d2fca]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:51:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8d57c36b-0eae-40b7-985d-b4d85358519b tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e95529da-09d6-462d-a871-ac01f6fbc8aa {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:15 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d13f976b-06df-4610-bff9-4d9b49a03111 tempest-SnapshotDependencyTests-1355614938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f" returned: 0 in 0.376s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:15 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d13f976b-06df-4610-bff9-4d9b49a03111 tempest-SnapshotDependencyTests-1355614938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f.5c83f977-b22b-4668-8dc4-ea7078ebc637 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:15 devstack sudo[105643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f.5c83f977-b22b-4668-8dc4-ea7078ebc637 1G Aug 28 09:51:15 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:15 devstack sudo[105641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e95529da-09d6-462d-a871-ac01f6fbc8aa Aug 28 09:51:15 devstack sudo[105641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:16 devstack sudo[105641]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8d57c36b-0eae-40b7-985d-b4d85358519b tempest-ProjectMemberTests-1488584303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e95529da-09d6-462d-a871-ac01f6fbc8aa" returned: 0 in 0.375s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8d57c36b-0eae-40b7-985d-b4d85358519b tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e95529da-09d6-462d-a871-ac01f6fbc8aa.1ad26020-9dfb-4fd5-8909-afea1eefc753 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:16 devstack sudo[105686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e95529da-09d6-462d-a871-ac01f6fbc8aa.1ad26020-9dfb-4fd5-8909-afea1eefc753 Aug 28 09:51:16 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:16 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d13f976b-06df-4610-bff9-4d9b49a03111 tempest-SnapshotDependencyTests-1355614938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f.5c83f977-b22b-4668-8dc4-ea7078ebc637 1G" returned: 0 in 0.433s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d13f976b-06df-4610-bff9-4d9b49a03111 tempest-SnapshotDependencyTests-1355614938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f.5c83f977-b22b-4668-8dc4-ea7078ebc637 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:16 devstack sudo[105689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f.5c83f977-b22b-4668-8dc4-ea7078ebc637 Aug 28 09:51:16 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:16 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8d57c36b-0eae-40b7-985d-b4d85358519b tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e95529da-09d6-462d-a871-ac01f6fbc8aa.1ad26020-9dfb-4fd5-8909-afea1eefc753" returned: 0 in 0.378s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8d57c36b-0eae-40b7-985d-b4d85358519b tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e95529da-09d6-462d-a871-ac01f6fbc8aa.1ad26020-9dfb-4fd5-8909-afea1eefc753 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:16 devstack sudo[105698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e95529da-09d6-462d-a871-ac01f6fbc8aa.1ad26020-9dfb-4fd5-8909-afea1eefc753 Aug 28 09:51:16 devstack sudo[105698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:16 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d13f976b-06df-4610-bff9-4d9b49a03111 tempest-SnapshotDependencyTests-1355614938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f.5c83f977-b22b-4668-8dc4-ea7078ebc637" returned: 0 in 0.349s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:16 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-d13f976b-06df-4610-bff9-4d9b49a03111 tempest-SnapshotDependencyTests-1355614938 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f.5c83f977-b22b-4668-8dc4-ea7078ebc637 is being set with open permissions: ugo+rw Aug 28 09:51:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d13f976b-06df-4610-bff9-4d9b49a03111 tempest-SnapshotDependencyTests-1355614938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f.5c83f977-b22b-4668-8dc4-ea7078ebc637 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:16 devstack sudo[105702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f.5c83f977-b22b-4668-8dc4-ea7078ebc637 Aug 28 09:51:16 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:16 devstack sudo[105698]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-8d57c36b-0eae-40b7-985d-b4d85358519b tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e95529da-09d6-462d-a871-ac01f6fbc8aa.1ad26020-9dfb-4fd5-8909-afea1eefc753" returned: 0 in 0.262s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:16 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8d57c36b-0eae-40b7-985d-b4d85358519b tempest-ProjectMemberTests-1488584303 None] Lock "cinder-quobyte-1ad26020-9dfb-4fd5-8909-afea1eefc753" released by "_delete_snapshot" :: held 1.505s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:51:16 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8d57c36b-0eae-40b7-985d-b4d85358519b tempest-ProjectMemberTests-1488584303 None] Lock "cinder-quobyte-e95529da-09d6-462d-a871-ac01f6fbc8aa" released by "delete_snapshot" :: held 1.532s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:51:16 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writing DB stats cinder:SELECT=126,cinder:INSERT=48,cinder:UPDATE=167,cinder:DELETE=14 {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:51:16 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:16 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-8d57c36b-0eae-40b7-985d-b4d85358519b tempest-ProjectMemberTests-1488584303 None] Created reservations ['2aa08920-1da4-4850-a492-1b7eac1f7f8a', 'c056bec1-9d98-4237-9fcb-8e0078820c7c', '79e4ca91-c5d5-4de5-875d-d78aa61b2bd6', '8bae43cb-bea7-4380-946b-c6309a48b130'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:51:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d13f976b-06df-4610-bff9-4d9b49a03111 tempest-SnapshotDependencyTests-1355614938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f.5c83f977-b22b-4668-8dc4-ea7078ebc637" returned: 0 in 0.281s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:16 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d13f976b-06df-4610-bff9-4d9b49a03111 tempest-SnapshotDependencyTests-1355614938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:17 devstack sudo[105706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f.info Aug 28 09:51:17 devstack sudo[105706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:17 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-8d57c36b-0eae-40b7-985d-b4d85358519b tempest-ProjectMemberTests-1488584303 None] Delete snapshot completed successfully. Aug 28 09:51:17 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-8d57c36b-0eae-40b7-985d-b4d85358519b tempest-ProjectMemberTests-1488584303 None] Lock "cinder-1ad26020-9dfb-4fd5-8909-afea1eefc753-delete_snapshot" released by "delete_snapshot" :: held 1.702s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:51:17 devstack sudo[105706]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d13f976b-06df-4610-bff9-4d9b49a03111 tempest-SnapshotDependencyTests-1355614938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f.info" returned: 0 in 0.261s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:17 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-d13f976b-06df-4610-bff9-4d9b49a03111 tempest-SnapshotDependencyTests-1355614938 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f.info is being set with open permissions: ugo+rw Aug 28 09:51:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d13f976b-06df-4610-bff9-4d9b49a03111 tempest-SnapshotDependencyTests-1355614938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:17 devstack sudo[105709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f.info Aug 28 09:51:17 devstack sudo[105709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:17 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e059c5a2-a713-445f-84ee-620efaa7e1c0 tempest-ProjectMemberTests-1488584303 None] Acquiring lock "cinder-e95529da-09d6-462d-a871-ac01f6fbc8aa-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:51:17 devstack sudo[105709]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:17 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e059c5a2-a713-445f-84ee-620efaa7e1c0 tempest-ProjectMemberTests-1488584303 None] Lock "cinder-e95529da-09d6-462d-a871-ac01f6fbc8aa-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:51:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-d13f976b-06df-4610-bff9-4d9b49a03111 tempest-SnapshotDependencyTests-1355614938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f.info" returned: 0 in 0.277s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-d13f976b-06df-4610-bff9-4d9b49a03111 tempest-SnapshotDependencyTests-1355614938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.081s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:51:17 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-d13f976b-06df-4610-bff9-4d9b49a03111 tempest-SnapshotDependencyTests-1355614938 None] Create snapshot completed successfully Aug 28 09:51:17 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e059c5a2-a713-445f-84ee-620efaa7e1c0 tempest-ProjectMemberTests-1488584303 None] Acquiring lock "cinder-quobyte-e95529da-09d6-462d-a871-ac01f6fbc8aa" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:51:17 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e059c5a2-a713-445f-84ee-620efaa7e1c0 tempest-ProjectMemberTests-1488584303 None] Lock "cinder-quobyte-e95529da-09d6-462d-a871-ac01f6fbc8aa" acquired by "delete_volume" :: waited 0.014s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:51:17 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2103c86-a8cc-47fd-8f0b-b903668135ba]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:51:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e059c5a2-a713-445f-84ee-620efaa7e1c0 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e95529da-09d6-462d-a871-ac01f6fbc8aa {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:17 devstack sudo[105712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e95529da-09d6-462d-a871-ac01f6fbc8aa Aug 28 09:51:17 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:17 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e059c5a2-a713-445f-84ee-620efaa7e1c0 tempest-ProjectMemberTests-1488584303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e95529da-09d6-462d-a871-ac01f6fbc8aa" returned: 0 in 0.354s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e059c5a2-a713-445f-84ee-620efaa7e1c0 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e95529da-09d6-462d-a871-ac01f6fbc8aa {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:18 devstack sudo[105717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e95529da-09d6-462d-a871-ac01f6fbc8aa Aug 28 09:51:18 devstack sudo[105717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:18 devstack sudo[105717]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e059c5a2-a713-445f-84ee-620efaa7e1c0 tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-e95529da-09d6-462d-a871-ac01f6fbc8aa" returned: 0 in 0.263s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:18 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e059c5a2-a713-445f-84ee-620efaa7e1c0 tempest-ProjectMemberTests-1488584303 None] Lock "cinder-quobyte-e95529da-09d6-462d-a871-ac01f6fbc8aa" released by "delete_volume" :: held 0.671s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:51:18 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-e059c5a2-a713-445f-84ee-620efaa7e1c0 tempest-ProjectMemberTests-1488584303 None] Created reservations ['f6258755-3295-4a51-af7b-86bd7a151598', '05336873-a6b3-405d-9e11-b7997a9fea8d', 'ccf2d1ff-9fc9-4830-8ae9-2aaebf8cd90b', '023487d1-1726-4820-84a4-43ecef14433d'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:51:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e059c5a2-a713-445f-84ee-620efaa7e1c0 tempest-ProjectMemberTests-1488584303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:51:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e059c5a2-a713-445f-84ee-620efaa7e1c0 tempest-ProjectMemberTests-1488584303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:51:18 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e059c5a2-a713-445f-84ee-620efaa7e1c0 tempest-ProjectMemberTests-1488584303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:51:18 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-e059c5a2-a713-445f-84ee-620efaa7e1c0 tempest-ProjectMemberTests-1488584303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:51:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e059c5a2-a713-445f-84ee-620efaa7e1c0 tempest-ProjectMemberTests-1488584303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:51:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e059c5a2-a713-445f-84ee-620efaa7e1c0 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:18 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:51:18 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:18 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e059c5a2-a713-445f-84ee-620efaa7e1c0 tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.267s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:18 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-e059c5a2-a713-445f-84ee-620efaa7e1c0 tempest-ProjectMemberTests-1488584303 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:51:18 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-e059c5a2-a713-445f-84ee-620efaa7e1c0 tempest-ProjectMemberTests-1488584303 None] Deleted volume successfully. Aug 28 09:51:18 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-e059c5a2-a713-445f-84ee-620efaa7e1c0 tempest-ProjectMemberTests-1488584303 None] Lock "cinder-e95529da-09d6-462d-a871-ac01f6fbc8aa-delete_volume" released by "delete_volume" :: held 1.180s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:51:19 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b172178-0362-479d-833a-95bcb6178a62 tempest-ProjectMemberTests-1488584303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:51:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2b172178-0362-479d-833a-95bcb6178a62 tempest-ProjectMemberTests-1488584303 None] Flow 'volume_create_manager' (b3e3e6d0-4321-49ba-af60-61b1390195a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:51:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2b172178-0362-479d-833a-95bcb6178a62 tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16a070b6-ed1a-48f5-aabe-4d3c69fef105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:51:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2b172178-0362-479d-833a-95bcb6178a62 tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16a070b6-ed1a-48f5-aabe-4d3c69fef105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-443685206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8180c676-013e-4e6e-b39d-6e0108e70421,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b056b8e115744d6a55a8cf4e112ebe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:51:19Z,use_quota=True,user_id='7e7fc1a0e4d74db1a1b75434c7703666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:51:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2b172178-0362-479d-833a-95bcb6178a62 tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (726b0e0a-bd74-495c-ab04-1509b5f8d782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:51:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2b172178-0362-479d-833a-95bcb6178a62 tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (726b0e0a-bd74-495c-ab04-1509b5f8d782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:51:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2b172178-0362-479d-833a-95bcb6178a62 tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d9d4e4c-c9c3-43af-9f60-e5cd92916f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:51:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2b172178-0362-479d-833a-95bcb6178a62 tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d9d4e4c-c9c3-43af-9f60-e5cd92916f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8180c676-013e-4e6e-b39d-6e0108e70421', 'volume_name': 'volume-8180c676-013e-4e6e-b39d-6e0108e70421', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:51:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2b172178-0362-479d-833a-95bcb6178a62 tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58b245f0-2465-42f4-bf01-a398fac2d41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:51:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2b172178-0362-479d-833a-95bcb6178a62 tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58b245f0-2465-42f4-bf01-a398fac2d41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:51:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2b172178-0362-479d-833a-95bcb6178a62 tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db787aa4-3db3-4dab-949f-3f8c7ce54cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:51:19 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-2b172178-0362-479d-833a-95bcb6178a62 tempest-ProjectMemberTests-1488584303 None] Volume 8180c676-013e-4e6e-b39d-6e0108e70421: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8180c676-013e-4e6e-b39d-6e0108e70421', 'volume_size': 1} Aug 28 09:51:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-2b172178-0362-479d-833a-95bcb6178a62 tempest-ProjectMemberTests-1488584303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:51:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-2b172178-0362-479d-833a-95bcb6178a62 tempest-ProjectMemberTests-1488584303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:51:19 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-2b172178-0362-479d-833a-95bcb6178a62 tempest-ProjectMemberTests-1488584303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-443685206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8180c676-013e-4e6e-b39d-6e0108e70421,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b056b8e115744d6a55a8cf4e112ebe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:51:19Z,use_quota=True,user_id='7e7fc1a0e4d74db1a1b75434c7703666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:51:19 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-2b172178-0362-479d-833a-95bcb6178a62 tempest-ProjectMemberTests-1488584303 None] Creating volume 8180c676-013e-4e6e-b39d-6e0108e70421 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:51:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-2b172178-0362-479d-833a-95bcb6178a62 tempest-ProjectMemberTests-1488584303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:51:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-2b172178-0362-479d-833a-95bcb6178a62 tempest-ProjectMemberTests-1488584303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:51:19 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-2b172178-0362-479d-833a-95bcb6178a62 tempest-ProjectMemberTests-1488584303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:51:19 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-2b172178-0362-479d-833a-95bcb6178a62 tempest-ProjectMemberTests-1488584303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:51:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-2b172178-0362-479d-833a-95bcb6178a62 tempest-ProjectMemberTests-1488584303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:51:19 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-2b172178-0362-479d-833a-95bcb6178a62 tempest-ProjectMemberTests-1488584303 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:51:19 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-2b172178-0362-479d-833a-95bcb6178a62 tempest-ProjectMemberTests-1488584303 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:51:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2b172178-0362-479d-833a-95bcb6178a62 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8180c676-013e-4e6e-b39d-6e0108e70421 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:19 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8180c676-013e-4e6e-b39d-6e0108e70421 1073741824 Aug 28 09:51:19 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:19 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-55e4f0cb-d81f-48f5-81bd-1796b57211bb tempest-SnapshotDependencyTests-1355614938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:51:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-55e4f0cb-d81f-48f5-81bd-1796b57211bb tempest-SnapshotDependencyTests-1355614938 None] Flow 'volume_create_manager' (079aa188-6ea2-46a5-af80-6831e9bc9403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:51:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-55e4f0cb-d81f-48f5-81bd-1796b57211bb tempest-SnapshotDependencyTests-1355614938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc3b3e83-e1cb-498b-8519-234537e00851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:51:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-55e4f0cb-d81f-48f5-81bd-1796b57211bb tempest-SnapshotDependencyTests-1355614938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc3b3e83-e1cb-498b-8519-234537e00851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac3326d9-f630-42ef-8f78-dfdb7c391a97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a5a17495be847babdc3d1f8eaabd2a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5c83f977-b22b-4668-8dc4-ea7078ebc637,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:51:19Z,use_quota=True,user_id='c95fe89113314741a8ab909d832dfefb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:51:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-55e4f0cb-d81f-48f5-81bd-1796b57211bb tempest-SnapshotDependencyTests-1355614938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (624c85e9-0b37-48ad-8f88-03dadd2cfa89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:51:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-55e4f0cb-d81f-48f5-81bd-1796b57211bb tempest-SnapshotDependencyTests-1355614938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (624c85e9-0b37-48ad-8f88-03dadd2cfa89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:51:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-55e4f0cb-d81f-48f5-81bd-1796b57211bb tempest-SnapshotDependencyTests-1355614938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2e55175-72d7-4e5b-9ac8-1adbddc5a62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:51:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-55e4f0cb-d81f-48f5-81bd-1796b57211bb tempest-SnapshotDependencyTests-1355614938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2e55175-72d7-4e5b-9ac8-1adbddc5a62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ac3326d9-f630-42ef-8f78-dfdb7c391a97', 'volume_name': 'volume-ac3326d9-f630-42ef-8f78-dfdb7c391a97', 'volume_size': 1, 'snapshot_id': '5c83f977-b22b-4668-8dc4-ea7078ebc637'}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:51:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-55e4f0cb-d81f-48f5-81bd-1796b57211bb tempest-SnapshotDependencyTests-1355614938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b8f7286-0832-424e-9b4f-7ba615009087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:51:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-55e4f0cb-d81f-48f5-81bd-1796b57211bb tempest-SnapshotDependencyTests-1355614938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b8f7286-0832-424e-9b4f-7ba615009087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:51:19 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-55e4f0cb-d81f-48f5-81bd-1796b57211bb tempest-SnapshotDependencyTests-1355614938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3b84967-002c-47bc-b33f-b5cbfd479e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:51:19 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-55e4f0cb-d81f-48f5-81bd-1796b57211bb tempest-SnapshotDependencyTests-1355614938 None] Volume ac3326d9-f630-42ef-8f78-dfdb7c391a97: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ac3326d9-f630-42ef-8f78-dfdb7c391a97', 'volume_size': 1, 'snapshot_id': '5c83f977-b22b-4668-8dc4-ea7078ebc637'} Aug 28 09:51:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-55e4f0cb-d81f-48f5-81bd-1796b57211bb tempest-SnapshotDependencyTests-1355614938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:51:19 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2b172178-0362-479d-833a-95bcb6178a62 tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8180c676-013e-4e6e-b39d-6e0108e70421 1073741824" returned: 0 in 0.426s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2b172178-0362-479d-833a-95bcb6178a62 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8180c676-013e-4e6e-b39d-6e0108e70421 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:19 devstack sudo[105732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8180c676-013e-4e6e-b39d-6e0108e70421 Aug 28 09:51:19 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:20 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-2b172178-0362-479d-833a-95bcb6178a62 tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8180c676-013e-4e6e-b39d-6e0108e70421" returned: 0 in 0.240s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:20 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-2b172178-0362-479d-833a-95bcb6178a62 tempest-ProjectMemberTests-1488584303 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:51:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-2b172178-0362-479d-833a-95bcb6178a62 tempest-ProjectMemberTests-1488584303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:51:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-55e4f0cb-d81f-48f5-81bd-1796b57211bb tempest-SnapshotDependencyTests-1355614938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.512s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:51:20 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-55e4f0cb-d81f-48f5-81bd-1796b57211bb tempest-SnapshotDependencyTests-1355614938 None] Acquiring lock "cinder-quobyte-5c83f977-b22b-4668-8dc4-ea7078ebc637-ac3326d9-f630-42ef-8f78-dfdb7c391a97" by "_create_volume_from_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:51:20 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2b172178-0362-479d-833a-95bcb6178a62 tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db787aa4-3db3-4dab-949f-3f8c7ce54cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8180c676-013e-4e6e-b39d-6e0108e70421', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:51:20 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2b172178-0362-479d-833a-95bcb6178a62 tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa4966b8-571c-4ca8-b6ee-3cb00a099a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:51:20 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-55e4f0cb-d81f-48f5-81bd-1796b57211bb tempest-SnapshotDependencyTests-1355614938 None] Lock "cinder-quobyte-5c83f977-b22b-4668-8dc4-ea7078ebc637-ac3326d9-f630-42ef-8f78-dfdb7c391a97" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:51:20 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-55e4f0cb-d81f-48f5-81bd-1796b57211bb tempest-SnapshotDependencyTests-1355614938 None] Creating volume ac3326d9-f630-42ef-8f78-dfdb7c391a97 from snapshot 5c83f977-b22b-4668-8dc4-ea7078ebc637 {{(pid=86081) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 28 09:51:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-55e4f0cb-d81f-48f5-81bd-1796b57211bb tempest-SnapshotDependencyTests-1355614938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:51:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-55e4f0cb-d81f-48f5-81bd-1796b57211bb tempest-SnapshotDependencyTests-1355614938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:51:20 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-55e4f0cb-d81f-48f5-81bd-1796b57211bb tempest-SnapshotDependencyTests-1355614938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:51:20 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-55e4f0cb-d81f-48f5-81bd-1796b57211bb tempest-SnapshotDependencyTests-1355614938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:51:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-55e4f0cb-d81f-48f5-81bd-1796b57211bb tempest-SnapshotDependencyTests-1355614938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:51:20 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-55e4f0cb-d81f-48f5-81bd-1796b57211bb tempest-SnapshotDependencyTests-1355614938 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:51:20 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-55e4f0cb-d81f-48f5-81bd-1796b57211bb tempest-SnapshotDependencyTests-1355614938 None] Acquiring lock "cinder-quobyte-ac3326d9-f630-42ef-8f78-dfdb7c391a97" by "_copy_volume_from_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:51:20 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-2b172178-0362-479d-833a-95bcb6178a62 tempest-ProjectMemberTests-1488584303 None] Volume volume-8180c676-013e-4e6e-b39d-6e0108e70421 (8180c676-013e-4e6e-b39d-6e0108e70421): created successfully Aug 28 09:51:20 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2b172178-0362-479d-833a-95bcb6178a62 tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa4966b8-571c-4ca8-b6ee-3cb00a099a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:51:20 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-2b172178-0362-479d-833a-95bcb6178a62 tempest-ProjectMemberTests-1488584303 None] Flow 'volume_create_manager' (b3e3e6d0-4321-49ba-af60-61b1390195a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:51:20 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-55e4f0cb-d81f-48f5-81bd-1796b57211bb tempest-SnapshotDependencyTests-1355614938 None] Lock "cinder-quobyte-ac3326d9-f630-42ef-8f78-dfdb7c391a97" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:51:20 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-55e4f0cb-d81f-48f5-81bd-1796b57211bb tempest-SnapshotDependencyTests-1355614938 None] snapshot: 5c83f977-b22b-4668-8dc4-ea7078ebc637, volume: ac3326d9-f630-42ef-8f78-dfdb7c391a97, {{(pid=86081) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 28 09:51:20 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-2b172178-0362-479d-833a-95bcb6178a62 tempest-ProjectMemberTests-1488584303 None] Created volume successfully. Aug 28 09:51:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-55e4f0cb-d81f-48f5-81bd-1796b57211bb tempest-SnapshotDependencyTests-1355614938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:51:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-55e4f0cb-d81f-48f5-81bd-1796b57211bb tempest-SnapshotDependencyTests-1355614938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:51:20 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-55e4f0cb-d81f-48f5-81bd-1796b57211bb tempest-SnapshotDependencyTests-1355614938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:51:20 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-55e4f0cb-d81f-48f5-81bd-1796b57211bb tempest-SnapshotDependencyTests-1355614938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:51:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-55e4f0cb-d81f-48f5-81bd-1796b57211bb tempest-SnapshotDependencyTests-1355614938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:51:20 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[784ba4b0-bfb1-4422-9f07-78aff9e4a245]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:51:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-55e4f0cb-d81f-48f5-81bd-1796b57211bb tempest-SnapshotDependencyTests-1355614938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f.5c83f977-b22b-4668-8dc4-ea7078ebc637 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:20 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f.5c83f977-b22b-4668-8dc4-ea7078ebc637 Aug 28 09:51:20 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-186163da-07bd-4767-adcb-04c87e93be66 tempest-ProjectMemberTests-1488584303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:51:20 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-55e4f0cb-d81f-48f5-81bd-1796b57211bb tempest-SnapshotDependencyTests-1355614938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f.5c83f977-b22b-4668-8dc4-ea7078ebc637" returned: 0 in 0.386s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:20 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-55e4f0cb-d81f-48f5-81bd-1796b57211bb tempest-SnapshotDependencyTests-1355614938 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:51:20 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[1accdc26-0380-46ae-b2e3-cef551f54a5f]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:51:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-55e4f0cb-d81f-48f5-81bd-1796b57211bb tempest-SnapshotDependencyTests-1355614938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:20 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f Aug 28 09:51:20 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:20 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-55e4f0cb-d81f-48f5-81bd-1796b57211bb tempest-SnapshotDependencyTests-1355614938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f" returned: 0 in 0.347s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:20 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-55e4f0cb-d81f-48f5-81bd-1796b57211bb tempest-SnapshotDependencyTests-1355614938 None] will copy from snapshot at /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f {{(pid=86081) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 28 09:51:20 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-55e4f0cb-d81f-48f5-81bd-1796b57211bb tempest-SnapshotDependencyTests-1355614938 None] Creating direct copy from snapshot {{(pid=86081) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 28 09:51:20 devstack cinder-volume[86081]: DEBUG cinder.utils [None req-55e4f0cb-d81f-48f5-81bd-1796b57211bb tempest-SnapshotDependencyTests-1355614938 None] Path /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ac3326d9-f630-42ef-8f78-dfdb7c391a97 not found in is_blk_device check {{(pid=86081) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 28 09:51:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-55e4f0cb-d81f-48f5-81bd-1796b57211bb tempest-SnapshotDependencyTests-1355614938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ac3326d9-f630-42ef-8f78-dfdb7c391a97 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:20 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ac3326d9-f630-42ef-8f78-dfdb7c391a97 Aug 28 09:51:20 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:24 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-55e4f0cb-d81f-48f5-81bd-1796b57211bb tempest-SnapshotDependencyTests-1355614938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ac3326d9-f630-42ef-8f78-dfdb7c391a97" returned: 0 in 4.049s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:24 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-55e4f0cb-d81f-48f5-81bd-1796b57211bb tempest-SnapshotDependencyTests-1355614938 None] Image conversion details: src /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f, size 1024.00 MB, duration 4.05 sec, destination /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ac3326d9-f630-42ef-8f78-dfdb7c391a97 {{(pid=86081) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 09:51:24 devstack cinder-volume[86081]: INFO cinder.image.image_utils [None req-55e4f0cb-d81f-48f5-81bd-1796b57211bb tempest-SnapshotDependencyTests-1355614938 None] Converted 1024.00 MB image at 252.85 MB/s Aug 28 09:51:24 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-55e4f0cb-d81f-48f5-81bd-1796b57211bb tempest-SnapshotDependencyTests-1355614938 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ac3326d9-f630-42ef-8f78-dfdb7c391a97 is being set with open permissions: ugo+rw Aug 28 09:51:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-55e4f0cb-d81f-48f5-81bd-1796b57211bb tempest-SnapshotDependencyTests-1355614938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ac3326d9-f630-42ef-8f78-dfdb7c391a97 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:24 devstack sudo[105758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ac3326d9-f630-42ef-8f78-dfdb7c391a97 Aug 28 09:51:24 devstack sudo[105758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:25 devstack sudo[105758]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-55e4f0cb-d81f-48f5-81bd-1796b57211bb tempest-SnapshotDependencyTests-1355614938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ac3326d9-f630-42ef-8f78-dfdb7c391a97" returned: 0 in 0.236s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:25 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-55e4f0cb-d81f-48f5-81bd-1796b57211bb tempest-SnapshotDependencyTests-1355614938 None] Lock "cinder-quobyte-ac3326d9-f630-42ef-8f78-dfdb7c391a97" released by "_copy_volume_from_snapshot" :: held 5.106s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:51:25 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-55e4f0cb-d81f-48f5-81bd-1796b57211bb tempest-SnapshotDependencyTests-1355614938 None] Lock "cinder-quobyte-5c83f977-b22b-4668-8dc4-ea7078ebc637-ac3326d9-f630-42ef-8f78-dfdb7c391a97" released by "_create_volume_from_snapshot" :: held 5.173s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:51:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-55e4f0cb-d81f-48f5-81bd-1796b57211bb tempest-SnapshotDependencyTests-1355614938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.205s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:51:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-186163da-07bd-4767-adcb-04c87e93be66 tempest-ProjectMemberTests-1488584303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.848s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:51:25 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-186163da-07bd-4767-adcb-04c87e93be66 tempest-ProjectMemberTests-1488584303 None] Creating offline snapshot 739cd7c8-dd34-4a52-b93a-16a2aea0dc43 of volume 8180c676-013e-4e6e-b39d-6e0108e70421 {{(pid=86081) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:51:25 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-55e4f0cb-d81f-48f5-81bd-1796b57211bb tempest-SnapshotDependencyTests-1355614938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3b84967-002c-47bc-b33f-b5cbfd479e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac3326d9-f630-42ef-8f78-dfdb7c391a97', 'volume_size': 1, 'snapshot_id': '5c83f977-b22b-4668-8dc4-ea7078ebc637'}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:51:25 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-55e4f0cb-d81f-48f5-81bd-1796b57211bb tempest-SnapshotDependencyTests-1355614938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61517894-eb1f-41a0-a36a-e36ad5994257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:51:25 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[82cd59e3-2ff3-42d0-bba8-99868e39b6f4]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:51:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-186163da-07bd-4767-adcb-04c87e93be66 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8180c676-013e-4e6e-b39d-6e0108e70421 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:25 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-55e4f0cb-d81f-48f5-81bd-1796b57211bb tempest-SnapshotDependencyTests-1355614938 None] Volume volume-ac3326d9-f630-42ef-8f78-dfdb7c391a97 (ac3326d9-f630-42ef-8f78-dfdb7c391a97): created successfully Aug 28 09:51:25 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-55e4f0cb-d81f-48f5-81bd-1796b57211bb tempest-SnapshotDependencyTests-1355614938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61517894-eb1f-41a0-a36a-e36ad5994257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:51:25 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-55e4f0cb-d81f-48f5-81bd-1796b57211bb tempest-SnapshotDependencyTests-1355614938 None] Flow 'volume_create_manager' (079aa188-6ea2-46a5-af80-6831e9bc9403) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:51:25 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-55e4f0cb-d81f-48f5-81bd-1796b57211bb tempest-SnapshotDependencyTests-1355614938 None] Created volume successfully. Aug 28 09:51:25 devstack sudo[105761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8180c676-013e-4e6e-b39d-6e0108e70421 Aug 28 09:51:25 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:25 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-186163da-07bd-4767-adcb-04c87e93be66 tempest-ProjectMemberTests-1488584303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8180c676-013e-4e6e-b39d-6e0108e70421" returned: 0 in 0.351s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:25 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-186163da-07bd-4767-adcb-04c87e93be66 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8180c676-013e-4e6e-b39d-6e0108e70421,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8180c676-013e-4e6e-b39d-6e0108e70421.739cd7c8-dd34-4a52-b93a-16a2aea0dc43 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:25 devstack sudo[105766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8180c676-013e-4e6e-b39d-6e0108e70421,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8180c676-013e-4e6e-b39d-6e0108e70421.739cd7c8-dd34-4a52-b93a-16a2aea0dc43 1G Aug 28 09:51:25 devstack sudo[105766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:25 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-bda9a4d5-aff5-4737-aff2-2983cdf90095 tempest-SnapshotDependencyTests-1355614938 None] Acquiring lock "cinder-5c83f977-b22b-4668-8dc4-ea7078ebc637-delete_snapshot" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:51:25 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-bda9a4d5-aff5-4737-aff2-2983cdf90095 tempest-SnapshotDependencyTests-1355614938 None] Lock "cinder-5c83f977-b22b-4668-8dc4-ea7078ebc637-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:51:25 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-bda9a4d5-aff5-4737-aff2-2983cdf90095 tempest-SnapshotDependencyTests-1355614938 None] Acquiring lock "cinder-quobyte-cd0bb41b-42e7-44b9-81ee-f59685813e2f" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:51:25 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-bda9a4d5-aff5-4737-aff2-2983cdf90095 tempest-SnapshotDependencyTests-1355614938 None] Lock "cinder-quobyte-cd0bb41b-42e7-44b9-81ee-f59685813e2f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:51:25 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-bda9a4d5-aff5-4737-aff2-2983cdf90095 tempest-SnapshotDependencyTests-1355614938 None] Acquiring lock "cinder-quobyte-5c83f977-b22b-4668-8dc4-ea7078ebc637" by "_delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:51:25 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-bda9a4d5-aff5-4737-aff2-2983cdf90095 tempest-SnapshotDependencyTests-1355614938 None] Lock "cinder-quobyte-5c83f977-b22b-4668-8dc4-ea7078ebc637" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:51:25 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-bda9a4d5-aff5-4737-aff2-2983cdf90095 tempest-SnapshotDependencyTests-1355614938 None] Deleting offline snapshot 5c83f977-b22b-4668-8dc4-ea7078ebc637 of volume cd0bb41b-42e7-44b9-81ee-f59685813e2f {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:51:26 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-bda9a4d5-aff5-4737-aff2-2983cdf90095 tempest-SnapshotDependencyTests-1355614938 None] snapshot_file for this snap is: volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f.5c83f977-b22b-4668-8dc4-ea7078ebc637 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:51:26 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[152c2a4a-e671-4ccc-9ea5-fdd35813abea]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:51:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bda9a4d5-aff5-4737-aff2-2983cdf90095 tempest-SnapshotDependencyTests-1355614938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f.5c83f977-b22b-4668-8dc4-ea7078ebc637 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:26 devstack sudo[105766]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-186163da-07bd-4767-adcb-04c87e93be66 tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8180c676-013e-4e6e-b39d-6e0108e70421,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8180c676-013e-4e6e-b39d-6e0108e70421.739cd7c8-dd34-4a52-b93a-16a2aea0dc43 1G" returned: 0 in 0.418s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-186163da-07bd-4767-adcb-04c87e93be66 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8180c676-013e-4e6e-b39d-6e0108e70421 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8180c676-013e-4e6e-b39d-6e0108e70421.739cd7c8-dd34-4a52-b93a-16a2aea0dc43 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:26 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8180c676-013e-4e6e-b39d-6e0108e70421 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8180c676-013e-4e6e-b39d-6e0108e70421.739cd7c8-dd34-4a52-b93a-16a2aea0dc43 Aug 28 09:51:26 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:26 devstack sudo[105772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f.5c83f977-b22b-4668-8dc4-ea7078ebc637 Aug 28 09:51:26 devstack sudo[105772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:26 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:26 devstack sudo[105772]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-186163da-07bd-4767-adcb-04c87e93be66 tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8180c676-013e-4e6e-b39d-6e0108e70421 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8180c676-013e-4e6e-b39d-6e0108e70421.739cd7c8-dd34-4a52-b93a-16a2aea0dc43" returned: 0 in 0.315s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:26 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-186163da-07bd-4767-adcb-04c87e93be66 tempest-ProjectMemberTests-1488584303 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8180c676-013e-4e6e-b39d-6e0108e70421.739cd7c8-dd34-4a52-b93a-16a2aea0dc43 is being set with open permissions: ugo+rw Aug 28 09:51:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-186163da-07bd-4767-adcb-04c87e93be66 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8180c676-013e-4e6e-b39d-6e0108e70421.739cd7c8-dd34-4a52-b93a-16a2aea0dc43 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bda9a4d5-aff5-4737-aff2-2983cdf90095 tempest-SnapshotDependencyTests-1355614938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f.5c83f977-b22b-4668-8dc4-ea7078ebc637" returned: 0 in 0.368s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:26 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-bda9a4d5-aff5-4737-aff2-2983cdf90095 tempest-SnapshotDependencyTests-1355614938 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:51:26 devstack sudo[105784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8180c676-013e-4e6e-b39d-6e0108e70421.739cd7c8-dd34-4a52-b93a-16a2aea0dc43 Aug 28 09:51:26 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:26 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4f4957-3dbe-47cf-a6a6-0b8248fd5a39]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:51:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bda9a4d5-aff5-4737-aff2-2983cdf90095 tempest-SnapshotDependencyTests-1355614938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:26 devstack sudo[105786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f Aug 28 09:51:26 devstack sudo[105786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:26 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-186163da-07bd-4767-adcb-04c87e93be66 tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8180c676-013e-4e6e-b39d-6e0108e70421.739cd7c8-dd34-4a52-b93a-16a2aea0dc43" returned: 0 in 0.259s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-186163da-07bd-4767-adcb-04c87e93be66 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8180c676-013e-4e6e-b39d-6e0108e70421.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:26 devstack sudo[105789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8180c676-013e-4e6e-b39d-6e0108e70421.info Aug 28 09:51:26 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:26 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-186163da-07bd-4767-adcb-04c87e93be66 tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8180c676-013e-4e6e-b39d-6e0108e70421.info" returned: 0 in 0.258s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:26 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-186163da-07bd-4767-adcb-04c87e93be66 tempest-ProjectMemberTests-1488584303 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8180c676-013e-4e6e-b39d-6e0108e70421.info is being set with open permissions: ugo+rw Aug 28 09:51:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-186163da-07bd-4767-adcb-04c87e93be66 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8180c676-013e-4e6e-b39d-6e0108e70421.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:26 devstack sudo[105795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8180c676-013e-4e6e-b39d-6e0108e70421.info Aug 28 09:51:26 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:26 devstack sudo[105786]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bda9a4d5-aff5-4737-aff2-2983cdf90095 tempest-SnapshotDependencyTests-1355614938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f" returned: 0 in 0.550s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:26 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bda9a4d5-aff5-4737-aff2-2983cdf90095 tempest-SnapshotDependencyTests-1355614938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f.5c83f977-b22b-4668-8dc4-ea7078ebc637 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:26 devstack sudo[105797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f.5c83f977-b22b-4668-8dc4-ea7078ebc637 Aug 28 09:51:26 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:27 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-186163da-07bd-4767-adcb-04c87e93be66 tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8180c676-013e-4e6e-b39d-6e0108e70421.info" returned: 0 in 0.243s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-186163da-07bd-4767-adcb-04c87e93be66 tempest-ProjectMemberTests-1488584303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.937s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:51:27 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-186163da-07bd-4767-adcb-04c87e93be66 tempest-ProjectMemberTests-1488584303 None] Create snapshot completed successfully Aug 28 09:51:27 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bda9a4d5-aff5-4737-aff2-2983cdf90095 tempest-SnapshotDependencyTests-1355614938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f.5c83f977-b22b-4668-8dc4-ea7078ebc637" returned: 0 in 0.335s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bda9a4d5-aff5-4737-aff2-2983cdf90095 tempest-SnapshotDependencyTests-1355614938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f.5c83f977-b22b-4668-8dc4-ea7078ebc637 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:27 devstack sudo[105803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f.5c83f977-b22b-4668-8dc4-ea7078ebc637 Aug 28 09:51:27 devstack sudo[105803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:27 devstack sudo[105803]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bda9a4d5-aff5-4737-aff2-2983cdf90095 tempest-SnapshotDependencyTests-1355614938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f.5c83f977-b22b-4668-8dc4-ea7078ebc637" returned: 0 in 0.236s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:27 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-bda9a4d5-aff5-4737-aff2-2983cdf90095 tempest-SnapshotDependencyTests-1355614938 None] Lock "cinder-quobyte-5c83f977-b22b-4668-8dc4-ea7078ebc637" released by "_delete_snapshot" :: held 1.584s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:51:27 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-bda9a4d5-aff5-4737-aff2-2983cdf90095 tempest-SnapshotDependencyTests-1355614938 None] Lock "cinder-quobyte-cd0bb41b-42e7-44b9-81ee-f59685813e2f" released by "delete_snapshot" :: held 1.610s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:51:27 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-bda9a4d5-aff5-4737-aff2-2983cdf90095 tempest-SnapshotDependencyTests-1355614938 None] Created reservations ['6efee811-666e-49c3-9cc5-515015a9285d', 'a8f790c6-96fe-4641-b515-5591b56f5ece', '5268fc47-50d7-4f26-bf7d-f34b64dfb8f4', 'f705577e-67d7-47bd-a1dc-0a1e50209ee4'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:51:27 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-bda9a4d5-aff5-4737-aff2-2983cdf90095 tempest-SnapshotDependencyTests-1355614938 None] Delete snapshot completed successfully. Aug 28 09:51:27 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-bda9a4d5-aff5-4737-aff2-2983cdf90095 tempest-SnapshotDependencyTests-1355614938 None] Lock "cinder-5c83f977-b22b-4668-8dc4-ea7078ebc637-delete_snapshot" released by "delete_snapshot" :: held 1.737s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:51:27 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-657e4616-f29b-4e74-a0f2-b834782c6741 tempest-ProjectMemberTests-1488584303 None] Acquiring lock "cinder-739cd7c8-dd34-4a52-b93a-16a2aea0dc43-delete_snapshot" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:51:27 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-657e4616-f29b-4e74-a0f2-b834782c6741 tempest-ProjectMemberTests-1488584303 None] Lock "cinder-739cd7c8-dd34-4a52-b93a-16a2aea0dc43-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:51:27 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-657e4616-f29b-4e74-a0f2-b834782c6741 tempest-ProjectMemberTests-1488584303 None] Acquiring lock "cinder-quobyte-8180c676-013e-4e6e-b39d-6e0108e70421" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:51:27 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-657e4616-f29b-4e74-a0f2-b834782c6741 tempest-ProjectMemberTests-1488584303 None] Lock "cinder-quobyte-8180c676-013e-4e6e-b39d-6e0108e70421" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:51:27 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-657e4616-f29b-4e74-a0f2-b834782c6741 tempest-ProjectMemberTests-1488584303 None] Acquiring lock "cinder-quobyte-739cd7c8-dd34-4a52-b93a-16a2aea0dc43" by "_delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:51:27 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-657e4616-f29b-4e74-a0f2-b834782c6741 tempest-ProjectMemberTests-1488584303 None] Lock "cinder-quobyte-739cd7c8-dd34-4a52-b93a-16a2aea0dc43" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:51:27 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-657e4616-f29b-4e74-a0f2-b834782c6741 tempest-ProjectMemberTests-1488584303 None] Deleting offline snapshot 739cd7c8-dd34-4a52-b93a-16a2aea0dc43 of volume 8180c676-013e-4e6e-b39d-6e0108e70421 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:51:27 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-657e4616-f29b-4e74-a0f2-b834782c6741 tempest-ProjectMemberTests-1488584303 None] snapshot_file for this snap is: volume-8180c676-013e-4e6e-b39d-6e0108e70421.739cd7c8-dd34-4a52-b93a-16a2aea0dc43 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:51:27 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c38022a-aa6a-46f7-84bf-69822c722bcc]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:51:27 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-657e4616-f29b-4e74-a0f2-b834782c6741 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8180c676-013e-4e6e-b39d-6e0108e70421.739cd7c8-dd34-4a52-b93a-16a2aea0dc43 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:28 devstack sudo[105806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8180c676-013e-4e6e-b39d-6e0108e70421.739cd7c8-dd34-4a52-b93a-16a2aea0dc43 Aug 28 09:51:28 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:28 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-1ac05e95-9a8b-4003-9e30-c592651dd7ea tempest-SnapshotDependencyTests-1355614938 None] Acquiring lock "cinder-cd0bb41b-42e7-44b9-81ee-f59685813e2f-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:51:28 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-1ac05e95-9a8b-4003-9e30-c592651dd7ea tempest-SnapshotDependencyTests-1355614938 None] Lock "cinder-cd0bb41b-42e7-44b9-81ee-f59685813e2f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:51:28 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-1ac05e95-9a8b-4003-9e30-c592651dd7ea tempest-SnapshotDependencyTests-1355614938 None] Acquiring lock "cinder-quobyte-cd0bb41b-42e7-44b9-81ee-f59685813e2f" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:51:28 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-1ac05e95-9a8b-4003-9e30-c592651dd7ea tempest-SnapshotDependencyTests-1355614938 None] Lock "cinder-quobyte-cd0bb41b-42e7-44b9-81ee-f59685813e2f" acquired by "delete_volume" :: waited 0.019s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:51:28 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee63923-49c3-486c-a541-04d8f50e82a4]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:51:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1ac05e95-9a8b-4003-9e30-c592651dd7ea tempest-SnapshotDependencyTests-1355614938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:28 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-657e4616-f29b-4e74-a0f2-b834782c6741 tempest-ProjectMemberTests-1488584303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8180c676-013e-4e6e-b39d-6e0108e70421.739cd7c8-dd34-4a52-b93a-16a2aea0dc43" returned: 0 in 0.363s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:28 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-657e4616-f29b-4e74-a0f2-b834782c6741 tempest-ProjectMemberTests-1488584303 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8180c676-013e-4e6e-b39d-6e0108e70421(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:51:28 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68bcb85-e479-4f7f-8130-36a9784e5ef4]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:51:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-657e4616-f29b-4e74-a0f2-b834782c6741 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8180c676-013e-4e6e-b39d-6e0108e70421 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:28 devstack sudo[105809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f Aug 28 09:51:28 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:28 devstack sudo[105812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8180c676-013e-4e6e-b39d-6e0108e70421 Aug 28 09:51:28 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:28 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1ac05e95-9a8b-4003-9e30-c592651dd7ea tempest-SnapshotDependencyTests-1355614938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f" returned: 0 in 0.373s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1ac05e95-9a8b-4003-9e30-c592651dd7ea tempest-SnapshotDependencyTests-1355614938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:28 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f Aug 28 09:51:28 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:28 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-657e4616-f29b-4e74-a0f2-b834782c6741 tempest-ProjectMemberTests-1488584303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8180c676-013e-4e6e-b39d-6e0108e70421" returned: 0 in 0.363s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-657e4616-f29b-4e74-a0f2-b834782c6741 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8180c676-013e-4e6e-b39d-6e0108e70421.739cd7c8-dd34-4a52-b93a-16a2aea0dc43 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:28 devstack sudo[105823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8180c676-013e-4e6e-b39d-6e0108e70421.739cd7c8-dd34-4a52-b93a-16a2aea0dc43 Aug 28 09:51:28 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:28 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1ac05e95-9a8b-4003-9e30-c592651dd7ea tempest-SnapshotDependencyTests-1355614938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-cd0bb41b-42e7-44b9-81ee-f59685813e2f" returned: 0 in 0.243s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:28 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-1ac05e95-9a8b-4003-9e30-c592651dd7ea tempest-SnapshotDependencyTests-1355614938 None] Lock "cinder-quobyte-cd0bb41b-42e7-44b9-81ee-f59685813e2f" released by "delete_volume" :: held 0.680s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:51:28 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-1ac05e95-9a8b-4003-9e30-c592651dd7ea tempest-SnapshotDependencyTests-1355614938 None] Created reservations ['50cb8962-2827-45b5-96b3-28f88cfb1503', 'baaecc04-c7a2-4b61-873e-e3a42561a7fe', '8af8b9b3-af76-4b85-b68c-ba688ba95310', 'dae7270f-66f6-44ff-9f42-fd2d0dbb1b0f'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:51:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-1ac05e95-9a8b-4003-9e30-c592651dd7ea tempest-SnapshotDependencyTests-1355614938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:51:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-1ac05e95-9a8b-4003-9e30-c592651dd7ea tempest-SnapshotDependencyTests-1355614938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:51:28 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-1ac05e95-9a8b-4003-9e30-c592651dd7ea tempest-SnapshotDependencyTests-1355614938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:51:28 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-1ac05e95-9a8b-4003-9e30-c592651dd7ea tempest-SnapshotDependencyTests-1355614938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:51:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-1ac05e95-9a8b-4003-9e30-c592651dd7ea tempest-SnapshotDependencyTests-1355614938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:51:28 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1ac05e95-9a8b-4003-9e30-c592651dd7ea tempest-SnapshotDependencyTests-1355614938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:29 devstack sudo[105829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:51:29 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:29 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-657e4616-f29b-4e74-a0f2-b834782c6741 tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8180c676-013e-4e6e-b39d-6e0108e70421.739cd7c8-dd34-4a52-b93a-16a2aea0dc43" returned: 0 in 0.355s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-657e4616-f29b-4e74-a0f2-b834782c6741 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8180c676-013e-4e6e-b39d-6e0108e70421.739cd7c8-dd34-4a52-b93a-16a2aea0dc43 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:29 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8180c676-013e-4e6e-b39d-6e0108e70421.739cd7c8-dd34-4a52-b93a-16a2aea0dc43 Aug 28 09:51:29 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:29 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1ac05e95-9a8b-4003-9e30-c592651dd7ea tempest-SnapshotDependencyTests-1355614938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.267s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:29 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-1ac05e95-9a8b-4003-9e30-c592651dd7ea tempest-SnapshotDependencyTests-1355614938 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:51:29 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-1ac05e95-9a8b-4003-9e30-c592651dd7ea tempest-SnapshotDependencyTests-1355614938 None] Deleted volume successfully. Aug 28 09:51:29 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-98141581-eea3-4165-b7e8-2ddcd853cd00 tempest-SnapshotDependencyTests-1355614938 None] Acquiring lock "cinder-ac3326d9-f630-42ef-8f78-dfdb7c391a97-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:51:29 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-1ac05e95-9a8b-4003-9e30-c592651dd7ea tempest-SnapshotDependencyTests-1355614938 None] Lock "cinder-cd0bb41b-42e7-44b9-81ee-f59685813e2f-delete_volume" released by "delete_volume" :: held 1.179s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:51:29 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-657e4616-f29b-4e74-a0f2-b834782c6741 tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8180c676-013e-4e6e-b39d-6e0108e70421.739cd7c8-dd34-4a52-b93a-16a2aea0dc43" returned: 0 in 0.273s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:29 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-98141581-eea3-4165-b7e8-2ddcd853cd00 tempest-SnapshotDependencyTests-1355614938 None] Lock "cinder-ac3326d9-f630-42ef-8f78-dfdb7c391a97-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:51:29 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-657e4616-f29b-4e74-a0f2-b834782c6741 tempest-ProjectMemberTests-1488584303 None] Lock "cinder-quobyte-739cd7c8-dd34-4a52-b93a-16a2aea0dc43" released by "_delete_snapshot" :: held 1.451s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:51:29 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-657e4616-f29b-4e74-a0f2-b834782c6741 tempest-ProjectMemberTests-1488584303 None] Lock "cinder-quobyte-8180c676-013e-4e6e-b39d-6e0108e70421" released by "delete_snapshot" :: held 1.478s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:51:29 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-98141581-eea3-4165-b7e8-2ddcd853cd00 tempest-SnapshotDependencyTests-1355614938 None] Acquiring lock "cinder-quobyte-ac3326d9-f630-42ef-8f78-dfdb7c391a97" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:51:29 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-98141581-eea3-4165-b7e8-2ddcd853cd00 tempest-SnapshotDependencyTests-1355614938 None] Lock "cinder-quobyte-ac3326d9-f630-42ef-8f78-dfdb7c391a97" acquired by "delete_volume" :: waited 0.019s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:51:29 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd12d2e8-981b-41ac-af6e-039753d6ff96]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:51:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-98141581-eea3-4165-b7e8-2ddcd853cd00 tempest-SnapshotDependencyTests-1355614938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ac3326d9-f630-42ef-8f78-dfdb7c391a97 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:29 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-657e4616-f29b-4e74-a0f2-b834782c6741 tempest-ProjectMemberTests-1488584303 None] Created reservations ['5c9131d2-1dd0-4404-be22-beb82596c9fc', 'ec782266-ca91-46b3-bf07-e9904f8de1f7', '9e75bb79-fa67-40b1-b80d-9963b7021591', '12d74d46-f12b-4069-9ebe-7e9df62c956f'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:51:29 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-657e4616-f29b-4e74-a0f2-b834782c6741 tempest-ProjectMemberTests-1488584303 None] Delete snapshot completed successfully. Aug 28 09:51:29 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-657e4616-f29b-4e74-a0f2-b834782c6741 tempest-ProjectMemberTests-1488584303 None] Lock "cinder-739cd7c8-dd34-4a52-b93a-16a2aea0dc43-delete_snapshot" released by "delete_snapshot" :: held 1.649s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:51:29 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ac3326d9-f630-42ef-8f78-dfdb7c391a97 Aug 28 09:51:29 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:29 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-98141581-eea3-4165-b7e8-2ddcd853cd00 tempest-SnapshotDependencyTests-1355614938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ac3326d9-f630-42ef-8f78-dfdb7c391a97" returned: 0 in 0.367s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:29 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-98141581-eea3-4165-b7e8-2ddcd853cd00 tempest-SnapshotDependencyTests-1355614938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ac3326d9-f630-42ef-8f78-dfdb7c391a97 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:29 devstack sudo[105841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ac3326d9-f630-42ef-8f78-dfdb7c391a97 Aug 28 09:51:29 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:30 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a93630ce-9e64-4bb1-94da-f12e06efcd6a tempest-ProjectMemberTests-1488584303 None] Acquiring lock "cinder-8180c676-013e-4e6e-b39d-6e0108e70421-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:51:30 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a93630ce-9e64-4bb1-94da-f12e06efcd6a tempest-ProjectMemberTests-1488584303 None] Lock "cinder-8180c676-013e-4e6e-b39d-6e0108e70421-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:51:30 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-98141581-eea3-4165-b7e8-2ddcd853cd00 tempest-SnapshotDependencyTests-1355614938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-ac3326d9-f630-42ef-8f78-dfdb7c391a97" returned: 0 in 0.252s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:30 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-98141581-eea3-4165-b7e8-2ddcd853cd00 tempest-SnapshotDependencyTests-1355614938 None] Lock "cinder-quobyte-ac3326d9-f630-42ef-8f78-dfdb7c391a97" released by "delete_volume" :: held 0.667s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:51:30 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a93630ce-9e64-4bb1-94da-f12e06efcd6a tempest-ProjectMemberTests-1488584303 None] Acquiring lock "cinder-quobyte-8180c676-013e-4e6e-b39d-6e0108e70421" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:51:30 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a93630ce-9e64-4bb1-94da-f12e06efcd6a tempest-ProjectMemberTests-1488584303 None] Lock "cinder-quobyte-8180c676-013e-4e6e-b39d-6e0108e70421" acquired by "delete_volume" :: waited 0.017s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:51:30 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f80fa1e-7d4e-4397-92fa-4e32aef78fa0]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:51:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a93630ce-9e64-4bb1-94da-f12e06efcd6a tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8180c676-013e-4e6e-b39d-6e0108e70421 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:30 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-98141581-eea3-4165-b7e8-2ddcd853cd00 tempest-SnapshotDependencyTests-1355614938 None] Created reservations ['3f0c3036-1735-40ab-8166-f2f296d0ff98', '82458419-96c6-4c9a-9078-bef90988d31e', 'd6f3c01e-f09d-4ba0-8dc8-674d562a3c1d', 'd9c88f0d-329f-4c71-8703-9d006a1b9cbd'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:51:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-98141581-eea3-4165-b7e8-2ddcd853cd00 tempest-SnapshotDependencyTests-1355614938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:51:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-98141581-eea3-4165-b7e8-2ddcd853cd00 tempest-SnapshotDependencyTests-1355614938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:51:30 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-98141581-eea3-4165-b7e8-2ddcd853cd00 tempest-SnapshotDependencyTests-1355614938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:51:30 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-98141581-eea3-4165-b7e8-2ddcd853cd00 tempest-SnapshotDependencyTests-1355614938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:51:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-98141581-eea3-4165-b7e8-2ddcd853cd00 tempest-SnapshotDependencyTests-1355614938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:51:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-98141581-eea3-4165-b7e8-2ddcd853cd00 tempest-SnapshotDependencyTests-1355614938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:30 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:51:30 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:30 devstack sudo[105844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8180c676-013e-4e6e-b39d-6e0108e70421 Aug 28 09:51:30 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:30 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-98141581-eea3-4165-b7e8-2ddcd853cd00 tempest-SnapshotDependencyTests-1355614938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.265s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:30 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-98141581-eea3-4165-b7e8-2ddcd853cd00 tempest-SnapshotDependencyTests-1355614938 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:51:30 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-98141581-eea3-4165-b7e8-2ddcd853cd00 tempest-SnapshotDependencyTests-1355614938 None] Deleted volume successfully. Aug 28 09:51:30 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-98141581-eea3-4165-b7e8-2ddcd853cd00 tempest-SnapshotDependencyTests-1355614938 None] Lock "cinder-ac3326d9-f630-42ef-8f78-dfdb7c391a97-delete_volume" released by "delete_volume" :: held 1.198s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:51:30 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a93630ce-9e64-4bb1-94da-f12e06efcd6a tempest-ProjectMemberTests-1488584303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8180c676-013e-4e6e-b39d-6e0108e70421" returned: 0 in 0.446s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a93630ce-9e64-4bb1-94da-f12e06efcd6a tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8180c676-013e-4e6e-b39d-6e0108e70421 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:30 devstack sudo[105852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8180c676-013e-4e6e-b39d-6e0108e70421 Aug 28 09:51:30 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:30 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:30 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a93630ce-9e64-4bb1-94da-f12e06efcd6a tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-8180c676-013e-4e6e-b39d-6e0108e70421" returned: 0 in 0.262s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:30 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a93630ce-9e64-4bb1-94da-f12e06efcd6a tempest-ProjectMemberTests-1488584303 None] Lock "cinder-quobyte-8180c676-013e-4e6e-b39d-6e0108e70421" released by "delete_volume" :: held 0.776s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:51:30 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-a93630ce-9e64-4bb1-94da-f12e06efcd6a tempest-ProjectMemberTests-1488584303 None] Created reservations ['393e1b9e-820d-4e9e-b697-566091ce8a1a', '7edc4e25-ec72-499b-9411-9b6a5db32d3f', 'f56c8277-7093-41ad-984d-6b07cce3eff1', '4cbe54fd-5106-4086-a3c4-5628a2cc44a9'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:51:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a93630ce-9e64-4bb1-94da-f12e06efcd6a tempest-ProjectMemberTests-1488584303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:51:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a93630ce-9e64-4bb1-94da-f12e06efcd6a tempest-ProjectMemberTests-1488584303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:51:31 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-a93630ce-9e64-4bb1-94da-f12e06efcd6a tempest-ProjectMemberTests-1488584303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:51:31 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-a93630ce-9e64-4bb1-94da-f12e06efcd6a tempest-ProjectMemberTests-1488584303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:51:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a93630ce-9e64-4bb1-94da-f12e06efcd6a tempest-ProjectMemberTests-1488584303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:51:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a93630ce-9e64-4bb1-94da-f12e06efcd6a tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:31 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:51:31 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:31 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a93630ce-9e64-4bb1-94da-f12e06efcd6a tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.367s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:31 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-a93630ce-9e64-4bb1-94da-f12e06efcd6a tempest-ProjectMemberTests-1488584303 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:51:31 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-a93630ce-9e64-4bb1-94da-f12e06efcd6a tempest-ProjectMemberTests-1488584303 None] Deleted volume successfully. Aug 28 09:51:31 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a93630ce-9e64-4bb1-94da-f12e06efcd6a tempest-ProjectMemberTests-1488584303 None] Lock "cinder-8180c676-013e-4e6e-b39d-6e0108e70421-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:51:31 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-77b0c1e8-f919-4f02-ae42-d8d363cec3e4 tempest-ProjectMemberTests-1488584303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:51:31 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-77b0c1e8-f919-4f02-ae42-d8d363cec3e4 tempest-ProjectMemberTests-1488584303 None] Flow 'volume_create_manager' (d09b4d3a-0011-4794-8f1c-62aa76a3c183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:51:31 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-77b0c1e8-f919-4f02-ae42-d8d363cec3e4 tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d58880c5-3f16-4467-a872-ad5565745bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:51:31 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-77b0c1e8-f919-4f02-ae42-d8d363cec3e4 tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d58880c5-3f16-4467-a872-ad5565745bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:51:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1451715411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b84aea90-9299-44db-81a0-8b9112f5ee03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b056b8e115744d6a55a8cf4e112ebe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:51:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:51:32Z,use_quota=True,user_id='7e7fc1a0e4d74db1a1b75434c7703666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:51:31 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-77b0c1e8-f919-4f02-ae42-d8d363cec3e4 tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37797858-f35a-4c46-aff4-b3cd47f2d4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:51:31 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-77b0c1e8-f919-4f02-ae42-d8d363cec3e4 tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37797858-f35a-4c46-aff4-b3cd47f2d4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:51:31 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-77b0c1e8-f919-4f02-ae42-d8d363cec3e4 tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d69ceb80-4b57-40f5-b504-7a1a3cfc984e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:51:31 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-77b0c1e8-f919-4f02-ae42-d8d363cec3e4 tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d69ceb80-4b57-40f5-b504-7a1a3cfc984e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b84aea90-9299-44db-81a0-8b9112f5ee03', 'volume_name': 'volume-b84aea90-9299-44db-81a0-8b9112f5ee03', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:51:31 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-77b0c1e8-f919-4f02-ae42-d8d363cec3e4 tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (488f471f-281b-4d98-8459-25d7db078e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:51:31 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-77b0c1e8-f919-4f02-ae42-d8d363cec3e4 tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (488f471f-281b-4d98-8459-25d7db078e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:51:31 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-77b0c1e8-f919-4f02-ae42-d8d363cec3e4 tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fac5fd8-f445-4b3a-9367-a79c6c0d1eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:51:31 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-77b0c1e8-f919-4f02-ae42-d8d363cec3e4 tempest-ProjectMemberTests-1488584303 None] Volume b84aea90-9299-44db-81a0-8b9112f5ee03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b84aea90-9299-44db-81a0-8b9112f5ee03', 'volume_size': 1} Aug 28 09:51:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-77b0c1e8-f919-4f02-ae42-d8d363cec3e4 tempest-ProjectMemberTests-1488584303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:51:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-77b0c1e8-f919-4f02-ae42-d8d363cec3e4 tempest-ProjectMemberTests-1488584303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:51:31 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-77b0c1e8-f919-4f02-ae42-d8d363cec3e4 tempest-ProjectMemberTests-1488584303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:51:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1451715411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b84aea90-9299-44db-81a0-8b9112f5ee03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b056b8e115744d6a55a8cf4e112ebe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:51:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:51:32Z,use_quota=True,user_id='7e7fc1a0e4d74db1a1b75434c7703666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:51:31 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-77b0c1e8-f919-4f02-ae42-d8d363cec3e4 tempest-ProjectMemberTests-1488584303 None] Creating volume b84aea90-9299-44db-81a0-8b9112f5ee03 {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:51:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-77b0c1e8-f919-4f02-ae42-d8d363cec3e4 tempest-ProjectMemberTests-1488584303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:51:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-77b0c1e8-f919-4f02-ae42-d8d363cec3e4 tempest-ProjectMemberTests-1488584303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:51:31 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-77b0c1e8-f919-4f02-ae42-d8d363cec3e4 tempest-ProjectMemberTests-1488584303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:51:31 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-77b0c1e8-f919-4f02-ae42-d8d363cec3e4 tempest-ProjectMemberTests-1488584303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:51:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-77b0c1e8-f919-4f02-ae42-d8d363cec3e4 tempest-ProjectMemberTests-1488584303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:51:31 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-77b0c1e8-f919-4f02-ae42-d8d363cec3e4 tempest-ProjectMemberTests-1488584303 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:51:31 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-77b0c1e8-f919-4f02-ae42-d8d363cec3e4 tempest-ProjectMemberTests-1488584303 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:51:31 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-77b0c1e8-f919-4f02-ae42-d8d363cec3e4 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b84aea90-9299-44db-81a0-8b9112f5ee03 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:31 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b84aea90-9299-44db-81a0-8b9112f5ee03 1073741824 Aug 28 09:51:31 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:32 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-77b0c1e8-f919-4f02-ae42-d8d363cec3e4 tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b84aea90-9299-44db-81a0-8b9112f5ee03 1073741824" returned: 0 in 0.473s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-77b0c1e8-f919-4f02-ae42-d8d363cec3e4 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b84aea90-9299-44db-81a0-8b9112f5ee03 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:32 devstack sudo[105866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b84aea90-9299-44db-81a0-8b9112f5ee03 Aug 28 09:51:32 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:32 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-77b0c1e8-f919-4f02-ae42-d8d363cec3e4 tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b84aea90-9299-44db-81a0-8b9112f5ee03" returned: 0 in 0.255s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:32 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-77b0c1e8-f919-4f02-ae42-d8d363cec3e4 tempest-ProjectMemberTests-1488584303 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:51:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-77b0c1e8-f919-4f02-ae42-d8d363cec3e4 tempest-ProjectMemberTests-1488584303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:51:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-77b0c1e8-f919-4f02-ae42-d8d363cec3e4 tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fac5fd8-f445-4b3a-9367-a79c6c0d1eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b84aea90-9299-44db-81a0-8b9112f5ee03', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:51:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-77b0c1e8-f919-4f02-ae42-d8d363cec3e4 tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d42c207a-ba50-4bab-898b-0304dc0f4b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:51:32 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-77b0c1e8-f919-4f02-ae42-d8d363cec3e4 tempest-ProjectMemberTests-1488584303 None] Volume volume-b84aea90-9299-44db-81a0-8b9112f5ee03 (b84aea90-9299-44db-81a0-8b9112f5ee03): created successfully Aug 28 09:51:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-77b0c1e8-f919-4f02-ae42-d8d363cec3e4 tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d42c207a-ba50-4bab-898b-0304dc0f4b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:51:32 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-77b0c1e8-f919-4f02-ae42-d8d363cec3e4 tempest-ProjectMemberTests-1488584303 None] Flow 'volume_create_manager' (d09b4d3a-0011-4794-8f1c-62aa76a3c183) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:51:32 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-77b0c1e8-f919-4f02-ae42-d8d363cec3e4 tempest-ProjectMemberTests-1488584303 None] Created volume successfully. Aug 28 09:51:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-1c268f13-e30a-4668-88de-3fa580c147ab tempest-ProjectMemberTests-1488584303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:51:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-1c268f13-e30a-4668-88de-3fa580c147ab tempest-ProjectMemberTests-1488584303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:51:32 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-1c268f13-e30a-4668-88de-3fa580c147ab tempest-ProjectMemberTests-1488584303 None] Creating offline snapshot 7f402840-1759-4429-96b3-6ff203164542 of volume b84aea90-9299-44db-81a0-8b9112f5ee03 {{(pid=86081) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:51:32 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60ab7ac-0ed7-45fb-a557-ed189371f8b1]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:51:32 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1c268f13-e30a-4668-88de-3fa580c147ab tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b84aea90-9299-44db-81a0-8b9112f5ee03 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:33 devstack sudo[105869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b84aea90-9299-44db-81a0-8b9112f5ee03 Aug 28 09:51:33 devstack sudo[105869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:33 devstack sudo[105869]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1c268f13-e30a-4668-88de-3fa580c147ab tempest-ProjectMemberTests-1488584303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b84aea90-9299-44db-81a0-8b9112f5ee03" returned: 0 in 0.396s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1c268f13-e30a-4668-88de-3fa580c147ab tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b84aea90-9299-44db-81a0-8b9112f5ee03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b84aea90-9299-44db-81a0-8b9112f5ee03.7f402840-1759-4429-96b3-6ff203164542 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:33 devstack sudo[105874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b84aea90-9299-44db-81a0-8b9112f5ee03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b84aea90-9299-44db-81a0-8b9112f5ee03.7f402840-1759-4429-96b3-6ff203164542 1G Aug 28 09:51:33 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:33 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1c268f13-e30a-4668-88de-3fa580c147ab tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b84aea90-9299-44db-81a0-8b9112f5ee03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b84aea90-9299-44db-81a0-8b9112f5ee03.7f402840-1759-4429-96b3-6ff203164542 1G" returned: 0 in 0.375s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1c268f13-e30a-4668-88de-3fa580c147ab tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b84aea90-9299-44db-81a0-8b9112f5ee03 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b84aea90-9299-44db-81a0-8b9112f5ee03.7f402840-1759-4429-96b3-6ff203164542 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:33 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b84aea90-9299-44db-81a0-8b9112f5ee03 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b84aea90-9299-44db-81a0-8b9112f5ee03.7f402840-1759-4429-96b3-6ff203164542 Aug 28 09:51:33 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:33 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1c268f13-e30a-4668-88de-3fa580c147ab tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b84aea90-9299-44db-81a0-8b9112f5ee03 -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b84aea90-9299-44db-81a0-8b9112f5ee03.7f402840-1759-4429-96b3-6ff203164542" returned: 0 in 0.289s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:33 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-1c268f13-e30a-4668-88de-3fa580c147ab tempest-ProjectMemberTests-1488584303 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b84aea90-9299-44db-81a0-8b9112f5ee03.7f402840-1759-4429-96b3-6ff203164542 is being set with open permissions: ugo+rw Aug 28 09:51:33 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1c268f13-e30a-4668-88de-3fa580c147ab tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b84aea90-9299-44db-81a0-8b9112f5ee03.7f402840-1759-4429-96b3-6ff203164542 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:34 devstack sudo[105885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b84aea90-9299-44db-81a0-8b9112f5ee03.7f402840-1759-4429-96b3-6ff203164542 Aug 28 09:51:34 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:34 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1c268f13-e30a-4668-88de-3fa580c147ab tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b84aea90-9299-44db-81a0-8b9112f5ee03.7f402840-1759-4429-96b3-6ff203164542" returned: 0 in 0.316s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1c268f13-e30a-4668-88de-3fa580c147ab tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b84aea90-9299-44db-81a0-8b9112f5ee03.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:34 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b84aea90-9299-44db-81a0-8b9112f5ee03.info Aug 28 09:51:34 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:34 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1c268f13-e30a-4668-88de-3fa580c147ab tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b84aea90-9299-44db-81a0-8b9112f5ee03.info" returned: 0 in 0.258s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:34 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-1c268f13-e30a-4668-88de-3fa580c147ab tempest-ProjectMemberTests-1488584303 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b84aea90-9299-44db-81a0-8b9112f5ee03.info is being set with open permissions: ugo+rw Aug 28 09:51:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1c268f13-e30a-4668-88de-3fa580c147ab tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b84aea90-9299-44db-81a0-8b9112f5ee03.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:34 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b84aea90-9299-44db-81a0-8b9112f5ee03.info Aug 28 09:51:34 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:34 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-1c268f13-e30a-4668-88de-3fa580c147ab tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b84aea90-9299-44db-81a0-8b9112f5ee03.info" returned: 0 in 0.259s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:34 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-1c268f13-e30a-4668-88de-3fa580c147ab tempest-ProjectMemberTests-1488584303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.986s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:51:34 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-1c268f13-e30a-4668-88de-3fa580c147ab tempest-ProjectMemberTests-1488584303 None] Create snapshot completed successfully Aug 28 09:51:35 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a323f6a8-0f48-4210-856a-0ff7b323b9dd tempest-ProjectMemberTests-1488584303 None] Acquiring lock "cinder-7f402840-1759-4429-96b3-6ff203164542-delete_snapshot" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:51:35 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a323f6a8-0f48-4210-856a-0ff7b323b9dd tempest-ProjectMemberTests-1488584303 None] Lock "cinder-7f402840-1759-4429-96b3-6ff203164542-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:51:35 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a323f6a8-0f48-4210-856a-0ff7b323b9dd tempest-ProjectMemberTests-1488584303 None] Acquiring lock "cinder-quobyte-b84aea90-9299-44db-81a0-8b9112f5ee03" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:51:35 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a323f6a8-0f48-4210-856a-0ff7b323b9dd tempest-ProjectMemberTests-1488584303 None] Lock "cinder-quobyte-b84aea90-9299-44db-81a0-8b9112f5ee03" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:51:35 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a323f6a8-0f48-4210-856a-0ff7b323b9dd tempest-ProjectMemberTests-1488584303 None] Acquiring lock "cinder-quobyte-7f402840-1759-4429-96b3-6ff203164542" by "_delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:51:35 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a323f6a8-0f48-4210-856a-0ff7b323b9dd tempest-ProjectMemberTests-1488584303 None] Lock "cinder-quobyte-7f402840-1759-4429-96b3-6ff203164542" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:51:35 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-a323f6a8-0f48-4210-856a-0ff7b323b9dd tempest-ProjectMemberTests-1488584303 None] Deleting offline snapshot 7f402840-1759-4429-96b3-6ff203164542 of volume b84aea90-9299-44db-81a0-8b9112f5ee03 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:51:35 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-a323f6a8-0f48-4210-856a-0ff7b323b9dd tempest-ProjectMemberTests-1488584303 None] snapshot_file for this snap is: volume-b84aea90-9299-44db-81a0-8b9112f5ee03.7f402840-1759-4429-96b3-6ff203164542 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:51:35 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd376513-7bb0-421d-87c3-eb24231ad86e]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:51:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a323f6a8-0f48-4210-856a-0ff7b323b9dd tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b84aea90-9299-44db-81a0-8b9112f5ee03.7f402840-1759-4429-96b3-6ff203164542 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:35 devstack sudo[105895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b84aea90-9299-44db-81a0-8b9112f5ee03.7f402840-1759-4429-96b3-6ff203164542 Aug 28 09:51:35 devstack sudo[105895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:35 devstack sudo[105895]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a323f6a8-0f48-4210-856a-0ff7b323b9dd tempest-ProjectMemberTests-1488584303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b84aea90-9299-44db-81a0-8b9112f5ee03.7f402840-1759-4429-96b3-6ff203164542" returned: 0 in 0.363s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:35 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-a323f6a8-0f48-4210-856a-0ff7b323b9dd tempest-ProjectMemberTests-1488584303 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b84aea90-9299-44db-81a0-8b9112f5ee03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:51:35 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0f7352-5a4e-4181-8eb0-14995f80cb58]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:51:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a323f6a8-0f48-4210-856a-0ff7b323b9dd tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b84aea90-9299-44db-81a0-8b9112f5ee03 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:35 devstack sudo[105900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b84aea90-9299-44db-81a0-8b9112f5ee03 Aug 28 09:51:35 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:35 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a323f6a8-0f48-4210-856a-0ff7b323b9dd tempest-ProjectMemberTests-1488584303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b84aea90-9299-44db-81a0-8b9112f5ee03" returned: 0 in 0.384s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a323f6a8-0f48-4210-856a-0ff7b323b9dd tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b84aea90-9299-44db-81a0-8b9112f5ee03.7f402840-1759-4429-96b3-6ff203164542 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:35 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b84aea90-9299-44db-81a0-8b9112f5ee03.7f402840-1759-4429-96b3-6ff203164542 Aug 28 09:51:35 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:36 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a323f6a8-0f48-4210-856a-0ff7b323b9dd tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b84aea90-9299-44db-81a0-8b9112f5ee03.7f402840-1759-4429-96b3-6ff203164542" returned: 0 in 0.339s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a323f6a8-0f48-4210-856a-0ff7b323b9dd tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b84aea90-9299-44db-81a0-8b9112f5ee03.7f402840-1759-4429-96b3-6ff203164542 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:36 devstack sudo[105911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b84aea90-9299-44db-81a0-8b9112f5ee03.7f402840-1759-4429-96b3-6ff203164542 Aug 28 09:51:36 devstack sudo[105911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:36 devstack sudo[105911]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a323f6a8-0f48-4210-856a-0ff7b323b9dd tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b84aea90-9299-44db-81a0-8b9112f5ee03.7f402840-1759-4429-96b3-6ff203164542" returned: 0 in 0.279s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:36 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a323f6a8-0f48-4210-856a-0ff7b323b9dd tempest-ProjectMemberTests-1488584303 None] Lock "cinder-quobyte-7f402840-1759-4429-96b3-6ff203164542" released by "_delete_snapshot" :: held 1.465s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:51:36 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a323f6a8-0f48-4210-856a-0ff7b323b9dd tempest-ProjectMemberTests-1488584303 None] Lock "cinder-quobyte-b84aea90-9299-44db-81a0-8b9112f5ee03" released by "delete_snapshot" :: held 1.489s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:51:36 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-a323f6a8-0f48-4210-856a-0ff7b323b9dd tempest-ProjectMemberTests-1488584303 None] Created reservations ['a936e90b-ed62-4256-895b-caeaea50fb7d', '0abdc40b-57b2-453a-869c-398912ff0619', '5aefed51-a860-4577-b9eb-c736ead38165', '1201f2be-5d33-4920-9cca-bf2c111d0f9b'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:51:36 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-a323f6a8-0f48-4210-856a-0ff7b323b9dd tempest-ProjectMemberTests-1488584303 None] Delete snapshot completed successfully. Aug 28 09:51:36 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a323f6a8-0f48-4210-856a-0ff7b323b9dd tempest-ProjectMemberTests-1488584303 None] Lock "cinder-7f402840-1759-4429-96b3-6ff203164542-delete_snapshot" released by "delete_snapshot" :: held 1.629s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:51:37 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-36c1c6ee-c2a5-4196-9be7-de141ce6d0e1 tempest-ProjectMemberTests-1488584303 None] Acquiring lock "cinder-b84aea90-9299-44db-81a0-8b9112f5ee03-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:51:37 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-36c1c6ee-c2a5-4196-9be7-de141ce6d0e1 tempest-ProjectMemberTests-1488584303 None] Lock "cinder-b84aea90-9299-44db-81a0-8b9112f5ee03-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:51:37 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-36c1c6ee-c2a5-4196-9be7-de141ce6d0e1 tempest-ProjectMemberTests-1488584303 None] Acquiring lock "cinder-quobyte-b84aea90-9299-44db-81a0-8b9112f5ee03" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:51:37 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-36c1c6ee-c2a5-4196-9be7-de141ce6d0e1 tempest-ProjectMemberTests-1488584303 None] Lock "cinder-quobyte-b84aea90-9299-44db-81a0-8b9112f5ee03" acquired by "delete_volume" :: waited 0.018s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:51:37 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51352e2-09e4-4d61-a29e-f5f5f7077e83]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:51:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-36c1c6ee-c2a5-4196-9be7-de141ce6d0e1 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b84aea90-9299-44db-81a0-8b9112f5ee03 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:37 devstack sudo[105915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b84aea90-9299-44db-81a0-8b9112f5ee03 Aug 28 09:51:37 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:37 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-36c1c6ee-c2a5-4196-9be7-de141ce6d0e1 tempest-ProjectMemberTests-1488584303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b84aea90-9299-44db-81a0-8b9112f5ee03" returned: 0 in 0.385s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-36c1c6ee-c2a5-4196-9be7-de141ce6d0e1 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b84aea90-9299-44db-81a0-8b9112f5ee03 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:37 devstack sudo[105920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b84aea90-9299-44db-81a0-8b9112f5ee03 Aug 28 09:51:37 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:37 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:37 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-36c1c6ee-c2a5-4196-9be7-de141ce6d0e1 tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-b84aea90-9299-44db-81a0-8b9112f5ee03" returned: 0 in 0.233s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:37 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-36c1c6ee-c2a5-4196-9be7-de141ce6d0e1 tempest-ProjectMemberTests-1488584303 None] Lock "cinder-quobyte-b84aea90-9299-44db-81a0-8b9112f5ee03" released by "delete_volume" :: held 0.672s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:51:38 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-36c1c6ee-c2a5-4196-9be7-de141ce6d0e1 tempest-ProjectMemberTests-1488584303 None] Created reservations ['c694b455-7d96-4bcc-8279-833e878e1268', 'fddfbbd7-3ff1-4f2e-82ee-c77c4dbb1ca6', '0d2b76b0-5e09-4515-b142-fa239f35ec36', '59d464ca-4c67-4d5d-ba38-405b46f2d10e'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:51:38 devstack cinder-volume[86081]: DEBUG oslo_service.periodic_task [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86081) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:51:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:51:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:51:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:51:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:51:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:51:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-36c1c6ee-c2a5-4196-9be7-de141ce6d0e1 tempest-ProjectMemberTests-1488584303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:51:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-36c1c6ee-c2a5-4196-9be7-de141ce6d0e1 tempest-ProjectMemberTests-1488584303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:51:38 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:51:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-36c1c6ee-c2a5-4196-9be7-de141ce6d0e1 tempest-ProjectMemberTests-1488584303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:51:38 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:38 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-36c1c6ee-c2a5-4196-9be7-de141ce6d0e1 tempest-ProjectMemberTests-1488584303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:51:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-36c1c6ee-c2a5-4196-9be7-de141ce6d0e1 tempest-ProjectMemberTests-1488584303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:51:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-36c1c6ee-c2a5-4196-9be7-de141ce6d0e1 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:38 devstack sudo[105925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:51:38 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:38 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.332s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:38 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:51:38 devstack cinder-volume[86081]: DEBUG oslo_service.periodic_task [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] Running periodic task VolumeManager._thread_info {{(pid=86081) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 09:51:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] thread count: 28 {{(pid=86081) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 09:51:38 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-0798da25-4abb-412d-8736-745cdbe2dbed None None] thread info: [<_MainThread(MainThread, started 129914189705344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86081) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 09:51:38 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:38 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-36c1c6ee-c2a5-4196-9be7-de141ce6d0e1 tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.313s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:38 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-36c1c6ee-c2a5-4196-9be7-de141ce6d0e1 tempest-ProjectMemberTests-1488584303 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:51:38 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-36c1c6ee-c2a5-4196-9be7-de141ce6d0e1 tempest-ProjectMemberTests-1488584303 None] Deleted volume successfully. Aug 28 09:51:38 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-36c1c6ee-c2a5-4196-9be7-de141ce6d0e1 tempest-ProjectMemberTests-1488584303 None] Lock "cinder-b84aea90-9299-44db-81a0-8b9112f5ee03-delete_volume" released by "delete_volume" :: held 1.239s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:51:38 devstack cinder-volume[86081]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b5393b3-2583-411a-a2ab-07b878516b3a tempest-ProjectMemberTests-1488584303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86081) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 09:51:39 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-3b5393b3-2583-411a-a2ab-07b878516b3a tempest-ProjectMemberTests-1488584303 None] Flow 'volume_create_manager' (d9b50788-b3f4-4499-ba28-53966bb46895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:51:39 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-3b5393b3-2583-411a-a2ab-07b878516b3a tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dc38e9f-4e82-4912-a642-ebae057c1239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:51:39 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-3b5393b3-2583-411a-a2ab-07b878516b3a tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dc38e9f-4e82-4912-a642-ebae057c1239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:51:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2102272149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f482339-31f7-4ce6-99b9-29d0d193696b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b056b8e115744d6a55a8cf4e112ebe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:51:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:51:39Z,use_quota=True,user_id='7e7fc1a0e4d74db1a1b75434c7703666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:51:39 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-3b5393b3-2583-411a-a2ab-07b878516b3a tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21abd616-000f-49fa-969b-bf9305def28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:51:39 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-3b5393b3-2583-411a-a2ab-07b878516b3a tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21abd616-000f-49fa-969b-bf9305def28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:51:39 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-3b5393b3-2583-411a-a2ab-07b878516b3a tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e906c40e-fb23-4379-bf6a-861f3ad20347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:51:39 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-3b5393b3-2583-411a-a2ab-07b878516b3a tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e906c40e-fb23-4379-bf6a-861f3ad20347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f482339-31f7-4ce6-99b9-29d0d193696b', 'volume_name': 'volume-1f482339-31f7-4ce6-99b9-29d0d193696b', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:51:39 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-3b5393b3-2583-411a-a2ab-07b878516b3a tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (296070b8-90dd-4a23-9737-9e67da82734f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:51:39 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-3b5393b3-2583-411a-a2ab-07b878516b3a tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (296070b8-90dd-4a23-9737-9e67da82734f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:51:39 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-3b5393b3-2583-411a-a2ab-07b878516b3a tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a09f2c4f-8a50-4f12-8559-7eac3cfea4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:51:39 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-3b5393b3-2583-411a-a2ab-07b878516b3a tempest-ProjectMemberTests-1488584303 None] Volume 1f482339-31f7-4ce6-99b9-29d0d193696b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f482339-31f7-4ce6-99b9-29d0d193696b', 'volume_size': 1} Aug 28 09:51:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-3b5393b3-2583-411a-a2ab-07b878516b3a tempest-ProjectMemberTests-1488584303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:51:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-3b5393b3-2583-411a-a2ab-07b878516b3a tempest-ProjectMemberTests-1488584303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:51:39 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-3b5393b3-2583-411a-a2ab-07b878516b3a tempest-ProjectMemberTests-1488584303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T07:51:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2102272149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f482339-31f7-4ce6-99b9-29d0d193696b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b056b8e115744d6a55a8cf4e112ebe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T07:51:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T07:51:39Z,use_quota=True,user_id='7e7fc1a0e4d74db1a1b75434c7703666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be16537-7ca3-4f07-9f33-0812b2b215d3),volume_type_id=8be16537-7ca3-4f07-9f33-0812b2b215d3)}" {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 09:51:39 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-3b5393b3-2583-411a-a2ab-07b878516b3a tempest-ProjectMemberTests-1488584303 None] Creating volume 1f482339-31f7-4ce6-99b9-29d0d193696b {{(pid=86081) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 09:51:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-3b5393b3-2583-411a-a2ab-07b878516b3a tempest-ProjectMemberTests-1488584303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:51:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-3b5393b3-2583-411a-a2ab-07b878516b3a tempest-ProjectMemberTests-1488584303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:51:39 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-3b5393b3-2583-411a-a2ab-07b878516b3a tempest-ProjectMemberTests-1488584303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:51:39 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-3b5393b3-2583-411a-a2ab-07b878516b3a tempest-ProjectMemberTests-1488584303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:51:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-3b5393b3-2583-411a-a2ab-07b878516b3a tempest-ProjectMemberTests-1488584303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:51:39 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-3b5393b3-2583-411a-a2ab-07b878516b3a tempest-ProjectMemberTests-1488584303 None] Selected osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b as target Quobyte volume. {{(pid=86081) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 09:51:39 devstack cinder-volume[86081]: INFO cinder.volume.drivers.remotefs [None req-3b5393b3-2583-411a-a2ab-07b878516b3a tempest-ProjectMemberTests-1488584303 None] casted to osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b Aug 28 09:51:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3b5393b3-2583-411a-a2ab-07b878516b3a tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1f482339-31f7-4ce6-99b9-29d0d193696b 1073741824 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:39 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1f482339-31f7-4ce6-99b9-29d0d193696b 1073741824 Aug 28 09:51:39 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:39 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3b5393b3-2583-411a-a2ab-07b878516b3a tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1f482339-31f7-4ce6-99b9-29d0d193696b 1073741824" returned: 0 in 0.498s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3b5393b3-2583-411a-a2ab-07b878516b3a tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1f482339-31f7-4ce6-99b9-29d0d193696b {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:39 devstack sudo[105937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1f482339-31f7-4ce6-99b9-29d0d193696b Aug 28 09:51:39 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:39 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-3b5393b3-2583-411a-a2ab-07b878516b3a tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1f482339-31f7-4ce6-99b9-29d0d193696b" returned: 0 in 0.255s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:39 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-3b5393b3-2583-411a-a2ab-07b878516b3a tempest-ProjectMemberTests-1488584303 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'} {{(pid=86081) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 09:51:39 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-3b5393b3-2583-411a-a2ab-07b878516b3a tempest-ProjectMemberTests-1488584303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:51:39 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-3b5393b3-2583-411a-a2ab-07b878516b3a tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a09f2c4f-8a50-4f12-8559-7eac3cfea4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f482339-31f7-4ce6-99b9-29d0d193696b', 'volume_size': 1}' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:51:39 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-3b5393b3-2583-411a-a2ab-07b878516b3a tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cffe8fb-6b56-46f0-b174-81a9e5930f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 09:51:39 devstack cinder-volume[86081]: INFO cinder.volume.flows.manager.create_volume [None req-3b5393b3-2583-411a-a2ab-07b878516b3a tempest-ProjectMemberTests-1488584303 None] Volume volume-1f482339-31f7-4ce6-99b9-29d0d193696b (1f482339-31f7-4ce6-99b9-29d0d193696b): created successfully Aug 28 09:51:39 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-3b5393b3-2583-411a-a2ab-07b878516b3a tempest-ProjectMemberTests-1488584303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cffe8fb-6b56-46f0-b174-81a9e5930f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86081) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 09:51:39 devstack cinder-volume[86081]: DEBUG cinder.volume.manager [None req-3b5393b3-2583-411a-a2ab-07b878516b3a tempest-ProjectMemberTests-1488584303 None] Flow 'volume_create_manager' (d9b50788-b3f4-4499-ba28-53966bb46895) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86081) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 09:51:39 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-3b5393b3-2583-411a-a2ab-07b878516b3a tempest-ProjectMemberTests-1488584303 None] Created volume successfully. Aug 28 09:51:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e20d0580-87ea-418e-99e8-d067ef5bc43d tempest-ProjectMemberTests-1488584303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:51:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e20d0580-87ea-418e-99e8-d067ef5bc43d tempest-ProjectMemberTests-1488584303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:51:41 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-e20d0580-87ea-418e-99e8-d067ef5bc43d tempest-ProjectMemberTests-1488584303 None] Creating offline snapshot f766dec2-1be7-4ead-b603-5b27fb4f4fb4 of volume 1f482339-31f7-4ce6-99b9-29d0d193696b {{(pid=86081) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 09:51:41 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c26ac1-c930-4080-be9d-a7ff4c406e90]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:51:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e20d0580-87ea-418e-99e8-d067ef5bc43d tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1f482339-31f7-4ce6-99b9-29d0d193696b {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:41 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1f482339-31f7-4ce6-99b9-29d0d193696b Aug 28 09:51:41 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:41 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e20d0580-87ea-418e-99e8-d067ef5bc43d tempest-ProjectMemberTests-1488584303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1f482339-31f7-4ce6-99b9-29d0d193696b" returned: 0 in 0.375s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e20d0580-87ea-418e-99e8-d067ef5bc43d tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1f482339-31f7-4ce6-99b9-29d0d193696b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1f482339-31f7-4ce6-99b9-29d0d193696b.f766dec2-1be7-4ead-b603-5b27fb4f4fb4 1G {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:41 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1f482339-31f7-4ce6-99b9-29d0d193696b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1f482339-31f7-4ce6-99b9-29d0d193696b.f766dec2-1be7-4ead-b603-5b27fb4f4fb4 1G Aug 28 09:51:41 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:42 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:42 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e20d0580-87ea-418e-99e8-d067ef5bc43d tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1f482339-31f7-4ce6-99b9-29d0d193696b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1f482339-31f7-4ce6-99b9-29d0d193696b.f766dec2-1be7-4ead-b603-5b27fb4f4fb4 1G" returned: 0 in 0.391s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:42 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e20d0580-87ea-418e-99e8-d067ef5bc43d tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f482339-31f7-4ce6-99b9-29d0d193696b -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1f482339-31f7-4ce6-99b9-29d0d193696b.f766dec2-1be7-4ead-b603-5b27fb4f4fb4 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:42 devstack sudo[105951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f482339-31f7-4ce6-99b9-29d0d193696b -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1f482339-31f7-4ce6-99b9-29d0d193696b.f766dec2-1be7-4ead-b603-5b27fb4f4fb4 Aug 28 09:51:42 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:42 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:42 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e20d0580-87ea-418e-99e8-d067ef5bc43d tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f482339-31f7-4ce6-99b9-29d0d193696b -F qcow2 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1f482339-31f7-4ce6-99b9-29d0d193696b.f766dec2-1be7-4ead-b603-5b27fb4f4fb4" returned: 0 in 0.292s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:42 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-e20d0580-87ea-418e-99e8-d067ef5bc43d tempest-ProjectMemberTests-1488584303 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1f482339-31f7-4ce6-99b9-29d0d193696b.f766dec2-1be7-4ead-b603-5b27fb4f4fb4 is being set with open permissions: ugo+rw Aug 28 09:51:42 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e20d0580-87ea-418e-99e8-d067ef5bc43d tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1f482339-31f7-4ce6-99b9-29d0d193696b.f766dec2-1be7-4ead-b603-5b27fb4f4fb4 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:42 devstack sudo[105956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1f482339-31f7-4ce6-99b9-29d0d193696b.f766dec2-1be7-4ead-b603-5b27fb4f4fb4 Aug 28 09:51:42 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:42 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:42 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e20d0580-87ea-418e-99e8-d067ef5bc43d tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1f482339-31f7-4ce6-99b9-29d0d193696b.f766dec2-1be7-4ead-b603-5b27fb4f4fb4" returned: 0 in 0.252s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:42 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e20d0580-87ea-418e-99e8-d067ef5bc43d tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1f482339-31f7-4ce6-99b9-29d0d193696b.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:42 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1f482339-31f7-4ce6-99b9-29d0d193696b.info Aug 28 09:51:42 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:42 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:42 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e20d0580-87ea-418e-99e8-d067ef5bc43d tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1f482339-31f7-4ce6-99b9-29d0d193696b.info" returned: 0 in 0.301s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:42 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.remotefs [None req-e20d0580-87ea-418e-99e8-d067ef5bc43d tempest-ProjectMemberTests-1488584303 None] /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1f482339-31f7-4ce6-99b9-29d0d193696b.info is being set with open permissions: ugo+rw Aug 28 09:51:42 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e20d0580-87ea-418e-99e8-d067ef5bc43d tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1f482339-31f7-4ce6-99b9-29d0d193696b.info {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:42 devstack sudo[105963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1f482339-31f7-4ce6-99b9-29d0d193696b.info Aug 28 09:51:42 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:43 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-e20d0580-87ea-418e-99e8-d067ef5bc43d tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1f482339-31f7-4ce6-99b9-29d0d193696b.info" returned: 0 in 0.265s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-e20d0580-87ea-418e-99e8-d067ef5bc43d tempest-ProjectMemberTests-1488584303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.960s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:51:43 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-e20d0580-87ea-418e-99e8-d067ef5bc43d tempest-ProjectMemberTests-1488584303 None] Create snapshot completed successfully Aug 28 09:51:43 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a465578e-61f5-45d6-9466-6f99ed0c359b tempest-ProjectMemberTests-1488584303 None] Acquiring lock "cinder-f766dec2-1be7-4ead-b603-5b27fb4f4fb4-delete_snapshot" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:51:43 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a465578e-61f5-45d6-9466-6f99ed0c359b tempest-ProjectMemberTests-1488584303 None] Lock "cinder-f766dec2-1be7-4ead-b603-5b27fb4f4fb4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:51:43 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a465578e-61f5-45d6-9466-6f99ed0c359b tempest-ProjectMemberTests-1488584303 None] Acquiring lock "cinder-quobyte-1f482339-31f7-4ce6-99b9-29d0d193696b" by "delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:51:43 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a465578e-61f5-45d6-9466-6f99ed0c359b tempest-ProjectMemberTests-1488584303 None] Lock "cinder-quobyte-1f482339-31f7-4ce6-99b9-29d0d193696b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:51:43 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a465578e-61f5-45d6-9466-6f99ed0c359b tempest-ProjectMemberTests-1488584303 None] Acquiring lock "cinder-quobyte-f766dec2-1be7-4ead-b603-5b27fb4f4fb4" by "_delete_snapshot" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:51:43 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a465578e-61f5-45d6-9466-6f99ed0c359b tempest-ProjectMemberTests-1488584303 None] Lock "cinder-quobyte-f766dec2-1be7-4ead-b603-5b27fb4f4fb4" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:51:43 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-a465578e-61f5-45d6-9466-6f99ed0c359b tempest-ProjectMemberTests-1488584303 None] Deleting offline snapshot f766dec2-1be7-4ead-b603-5b27fb4f4fb4 of volume 1f482339-31f7-4ce6-99b9-29d0d193696b {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 09:51:43 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-a465578e-61f5-45d6-9466-6f99ed0c359b tempest-ProjectMemberTests-1488584303 None] snapshot_file for this snap is: volume-1f482339-31f7-4ce6-99b9-29d0d193696b.f766dec2-1be7-4ead-b603-5b27fb4f4fb4 {{(pid=86081) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 09:51:43 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4504db9-1446-4c5a-b685-2b0665c8184c]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:51:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a465578e-61f5-45d6-9466-6f99ed0c359b tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1f482339-31f7-4ce6-99b9-29d0d193696b.f766dec2-1be7-4ead-b603-5b27fb4f4fb4 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:43 devstack sudo[105966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1f482339-31f7-4ce6-99b9-29d0d193696b.f766dec2-1be7-4ead-b603-5b27fb4f4fb4 Aug 28 09:51:43 devstack sudo[105966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:43 devstack sudo[105966]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a465578e-61f5-45d6-9466-6f99ed0c359b tempest-ProjectMemberTests-1488584303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1f482339-31f7-4ce6-99b9-29d0d193696b.f766dec2-1be7-4ead-b603-5b27fb4f4fb4" returned: 0 in 0.346s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:43 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-a465578e-61f5-45d6-9466-6f99ed0c359b tempest-ProjectMemberTests-1488584303 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f482339-31f7-4ce6-99b9-29d0d193696b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86081) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 09:51:43 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b14c739-d7c2-4152-847c-5aad4981bbfb]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:51:43 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a465578e-61f5-45d6-9466-6f99ed0c359b tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1f482339-31f7-4ce6-99b9-29d0d193696b {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:44 devstack sudo[105971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1f482339-31f7-4ce6-99b9-29d0d193696b Aug 28 09:51:44 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:44 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a465578e-61f5-45d6-9466-6f99ed0c359b tempest-ProjectMemberTests-1488584303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1f482339-31f7-4ce6-99b9-29d0d193696b" returned: 0 in 0.353s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a465578e-61f5-45d6-9466-6f99ed0c359b tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1f482339-31f7-4ce6-99b9-29d0d193696b.f766dec2-1be7-4ead-b603-5b27fb4f4fb4 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:44 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1f482339-31f7-4ce6-99b9-29d0d193696b.f766dec2-1be7-4ead-b603-5b27fb4f4fb4 Aug 28 09:51:44 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:44 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a465578e-61f5-45d6-9466-6f99ed0c359b tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1f482339-31f7-4ce6-99b9-29d0d193696b.f766dec2-1be7-4ead-b603-5b27fb4f4fb4" returned: 0 in 0.317s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a465578e-61f5-45d6-9466-6f99ed0c359b tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1f482339-31f7-4ce6-99b9-29d0d193696b.f766dec2-1be7-4ead-b603-5b27fb4f4fb4 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:44 devstack sudo[105981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1f482339-31f7-4ce6-99b9-29d0d193696b.f766dec2-1be7-4ead-b603-5b27fb4f4fb4 Aug 28 09:51:44 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:44 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a465578e-61f5-45d6-9466-6f99ed0c359b tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1f482339-31f7-4ce6-99b9-29d0d193696b.f766dec2-1be7-4ead-b603-5b27fb4f4fb4" returned: 0 in 0.252s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:44 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a465578e-61f5-45d6-9466-6f99ed0c359b tempest-ProjectMemberTests-1488584303 None] Lock "cinder-quobyte-f766dec2-1be7-4ead-b603-5b27fb4f4fb4" released by "_delete_snapshot" :: held 1.359s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:51:44 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a465578e-61f5-45d6-9466-6f99ed0c359b tempest-ProjectMemberTests-1488584303 None] Lock "cinder-quobyte-1f482339-31f7-4ce6-99b9-29d0d193696b" released by "delete_snapshot" :: held 1.382s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:51:44 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-a465578e-61f5-45d6-9466-6f99ed0c359b tempest-ProjectMemberTests-1488584303 None] Created reservations ['9e59c911-2463-4978-a7fe-c6561e7426a6', '976255cc-b7a2-4caf-9f25-0d73be5aafbf', '7ad395c9-7fe4-4b62-864d-7437eabe4f8d', 'b04f1c26-b342-4e40-96ba-720ac4306708'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:51:44 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-a465578e-61f5-45d6-9466-6f99ed0c359b tempest-ProjectMemberTests-1488584303 None] Delete snapshot completed successfully. Aug 28 09:51:44 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-a465578e-61f5-45d6-9466-6f99ed0c359b tempest-ProjectMemberTests-1488584303 None] Lock "cinder-f766dec2-1be7-4ead-b603-5b27fb4f4fb4-delete_snapshot" released by "delete_snapshot" :: held 1.525s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:51:45 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-bab6561b-7440-4eec-bf82-27b4d9473bb3 tempest-ProjectMemberTests-1488584303 None] Acquiring lock "cinder-1f482339-31f7-4ce6-99b9-29d0d193696b-delete_volume" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:51:45 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-bab6561b-7440-4eec-bf82-27b4d9473bb3 tempest-ProjectMemberTests-1488584303 None] Lock "cinder-1f482339-31f7-4ce6-99b9-29d0d193696b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:51:45 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-bab6561b-7440-4eec-bf82-27b4d9473bb3 tempest-ProjectMemberTests-1488584303 None] Acquiring lock "cinder-quobyte-1f482339-31f7-4ce6-99b9-29d0d193696b" by "delete_volume" {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 09:51:45 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-bab6561b-7440-4eec-bf82-27b4d9473bb3 tempest-ProjectMemberTests-1488584303 None] Lock "cinder-quobyte-1f482339-31f7-4ce6-99b9-29d0d193696b" acquired by "delete_volume" :: waited 0.015s {{(pid=86081) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 09:51:45 devstack cinder-volume[86081]: DEBUG oslo.privsep.daemon [-] privsep: reply[512fb4bd-bdb4-4ba7-bd90-8effc39ec6c2]: (4, 'qcow2') {{(pid=87219) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 09:51:45 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bab6561b-7440-4eec-bf82-27b4d9473bb3 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1f482339-31f7-4ce6-99b9-29d0d193696b {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:45 devstack sudo[105984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1f482339-31f7-4ce6-99b9-29d0d193696b Aug 28 09:51:45 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:46 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bab6561b-7440-4eec-bf82-27b4d9473bb3 tempest-ProjectMemberTests-1488584303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1f482339-31f7-4ce6-99b9-29d0d193696b" returned: 0 in 0.342s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bab6561b-7440-4eec-bf82-27b4d9473bb3 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1f482339-31f7-4ce6-99b9-29d0d193696b {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:46 devstack sudo[105989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1f482339-31f7-4ce6-99b9-29d0d193696b Aug 28 09:51:46 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:46 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bab6561b-7440-4eec-bf82-27b4d9473bb3 tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356/volume-1f482339-31f7-4ce6-99b9-29d0d193696b" returned: 0 in 0.240s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:46 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-bab6561b-7440-4eec-bf82-27b4d9473bb3 tempest-ProjectMemberTests-1488584303 None] Lock "cinder-quobyte-1f482339-31f7-4ce6-99b9-29d0d193696b" released by "delete_volume" :: held 0.635s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:51:46 devstack cinder-volume[86081]: DEBUG cinder.quota [None req-bab6561b-7440-4eec-bf82-27b4d9473bb3 tempest-ProjectMemberTests-1488584303 None] Created reservations ['67a90f9c-8f80-476f-abc5-0660b30287f8', '7aa76c94-c153-40ae-868d-b310e68d46a8', '72ae1cff-6039-4c09-bc0d-97bfe6cef463', '14b71d99-bdd3-4c8b-8e02-c2f4305ed49b'] {{(pid=86081) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 09:51:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-bab6561b-7440-4eec-bf82-27b4d9473bb3 tempest-ProjectMemberTests-1488584303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 09:51:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-bab6561b-7440-4eec-bf82-27b4d9473bb3 tempest-ProjectMemberTests-1488584303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 09:51:46 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-bab6561b-7440-4eec-bf82-27b4d9473bb3 tempest-ProjectMemberTests-1488584303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 09:51:46 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-bab6561b-7440-4eec-bf82-27b4d9473bb3 tempest-ProjectMemberTests-1488584303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-df5134ca-6c2f-416c-b699-91583cc4432b'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 09:51:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-bab6561b-7440-4eec-bf82-27b4d9473bb3 tempest-ProjectMemberTests-1488584303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 09:51:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bab6561b-7440-4eec-bf82-27b4d9473bb3 tempest-ProjectMemberTests-1488584303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 09:51:46 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356 Aug 28 09:51:46 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 09:51:46 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Aug 28 09:51:46 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-bab6561b-7440-4eec-bf82-27b4d9473bb3 tempest-ProjectMemberTests-1488584303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/475d2350dd66f1156e60fc66deb80356" returned: 0 in 0.264s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 09:51:46 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-bab6561b-7440-4eec-bf82-27b4d9473bb3 tempest-ProjectMemberTests-1488584303 None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 09:51:46 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-bab6561b-7440-4eec-bf82-27b4d9473bb3 tempest-ProjectMemberTests-1488584303 None] Deleted volume successfully. Aug 28 09:51:46 devstack cinder-volume[86081]: DEBUG cinder.coordination [None req-bab6561b-7440-4eec-bf82-27b4d9473bb3 tempest-ProjectMemberTests-1488584303 None] Lock "cinder-1f482339-31f7-4ce6-99b9-29d0d193696b-delete_volume" released by "delete_volume" :: held 1.101s {{(pid=86081) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 09:51:56 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writing DB stats cinder:SELECT=67,cinder:INSERT=27,cinder:UPDATE=96,cinder:DELETE=7 {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:51:56 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writing DB stats cinder:SELECT=78,cinder:INSERT=25,cinder:UPDATE=90,cinder:DELETE=7 {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:52:31 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writing DB stats cinder:SELECT=1 {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 09:52:31 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writing DB stats cinder:UPDATE=1 {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}